Content-based multimedia information retrieval: State of the art and challenges
The DOI matches its Crossref record; 150 of the 152 references it cites were found in a registry or an index.
Abstract
Extending beyond the boundaries of science, art, and culture, content-based multimedia information retrieval provides new paradigms and methods for searching through the myriad variety of media all over the world. This survey reviews 100+ recent articles on content-based multimedia information retrieval and discusses their role in current research directions which include browsing and search paradigms, user studies, affective computing, learning, semantic queries, new features and media types, high performance indexing, and evaluation techniques. Based on the current state of the art, we discuss the major challenges for the future.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, given a diagnostically challenging WSI, retrieving a similar WSI via slide search5,46–53 or pathology reports through cross-modal report search10,54–56 typically requires specialized algorithms to bridge the gap between fine-grained patch embeddings and slide-level information, introducing hurdles to clinical adoption.”
From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [46]
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
Content-based image retrieval at the end of the early years
Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., & Jain, R. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895972 · Cited by 6,056
Self-citation2009 IEEE Conference on Computer Vision and Pattern Recognition
(2009) · doi:10.1109/cvpr14067.2009 · Cited by 5,550
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
Haralock, R. M., & Shapiro, L. G. (1991) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 3,933
Scale & Affine Invariant Interest Point Detectors
Mikolajczyk, K., & Schmid, C. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000027790.02288.f2 · Cited by 3,436
Detecting faces in images: a survey
Yang, M.-H., Kriegman, D. J., & Ahuja, N. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982883 · Cited by 3,427
Query by image and video content: the QBIC system
Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., et al. (1995) · Computer · doi:10.1109/2.410146 · Cited by 3,060
Statistical shape analysis: clustering, learning, and testing
Srivastava, A., Joshi, S. H., Mio, W., & Liu, X. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.86 · Cited by 2,727
Relevance feedback in information retrieval
Rocchio, J. J. (1971) · Medical Entomology and Zoology · Cited by 2,680
Feature detection with automatic scale selection
Lindeberg, T. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008045108935 · Cited by 2,541
Query by Image and Video Content: The QBIC System
Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., et al. (2002) · Readings in Multimedia Computing and Networking · doi:10.1016/b978-155860651-7/50108-x · Cited by 1,559
Evaluation of Interest Point Detectors
Schmid, C., Mohr, R., & Bauckhage, C. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008199403446 · Cited by 1,484
Automatic linguistic indexing of pictures by a statistical modeling approach
Li, J., & Wang, J. Z. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227984 · Cited by 1,087
Multimodal human–computer interaction: A survey
Jaimes, A., & Sebe, N. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.019 · Cited by 965
Self-citationFunkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., & Jacobs, D. (2003) · ACM Transactions on Graphics · doi:10.1145/588272.588279 · Cited by 935
Virage image search engine: an open framework for image management:
Bach, J. R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R. C., & Shu, C.-F. (1996) · SPIE Proceedings · doi:10.1117/12.234785 · Cited by 776
Self-citationRecognition of shapes by editing their shock graphs
Sebastian, T. B., Klein, P. N., & Kimia, B. B. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273924 · Cited by 727
British Machine Vision Conference 2000
Mirmehdi, M. (2002) · Image and Vision Computing · doi:10.1016/s0262-8856(02)00048-3 · Cited by 716
One-class SVM for learning in image retrieval
Chen, Y., Zhou, X. S., & Huang, T. S. (2002) · Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205) · doi:10.1109/icip.2001.958946 · Cited by 635
Reliable feature matching across widely separated views
Baumberg, A. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855899 · Cited by 627
Affective video content representation and modeling
Hanjalic, A., & Xu, L.-Q. (2005) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2004.840618 · Cited by 594
The search: how Google and its rivals rewrote the rules of business and transformed our culture
(2006) · Choice Reviews Online · doi:10.5860/choice.43-4123 · Cited by 541
State of the Art in Shape Matching
Veltkamp, R. C., & Hagedoorn, M. (2001) · Advances in Pattern Recognition · doi:10.1007/978-1-4471-3702-3_4 · Cited by 535
Wide Baseline Stereo Matching based on Local, Affinely Invariant Regions
Tuytelaars, T., & Gool, L. V. (2000) · Procedings of the British Machine Vision Conference 2000 · doi:10.5244/c.14.38 · Cited by 450
(1985) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(85)80079-7 · Cited by 423
A survey of content based 3D shape retrieval methods
Tangelder, J. W. H., & Veltkamp, R. C. (2004) · Proceedings Shape Modeling Applications, 2004. · doi:10.1109/smi.2004.1314502 · Cited by 409
How do people manage their digital photographs?
Rodden, K., & Wood, K. R. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642682 · Cited by 408
Automatic audio segmentation using a measure of audio novelty
Foote, J. (2002) · 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532) · doi:10.1109/icme.2000.869637 · Cited by 408
Frohlich, D., Kuchinsky, A., Pering, C., Don, A., & Ariss, S. (2002) · Proceedings of the 2002 ACM conference on Computer supported cooperative work · doi:10.1145/587078.587102 · Cited by 383
Radon transform orientation estimation for rotation invariant texture analysis
Jafari-Khouzani, K., & Soltanian-Zadeh, H. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.126 · Cited by 378
(1995) · Cited by 359
Visually searching the Web for content
Smith, J. R., & Chang, S.-F. (1997) · IEEE Multimedia · doi:10.1109/93.621578 · Cited by 350
Object Detection Using the Statistics of Parts
Schneiderman, H., & Kanade, T. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000011202.85607.00 · Cited by 349
An overview of audio information retrieval
Foote, J. (1999) · Multimedia Systems · doi:10.1007/s005300050106 · Cited by 338
WebSeer: An Image Search Engine for the World Wide Web
Frankel, C., Swain, M. J., & Athitsos, V. (1996) · Cited by 320
Decision, estimation, and classification: an introduction to pattern recognition and related topics
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0356 · Cited by 294
Video Manga: generating semantically meaningful video summaries
Uchihashi, S., Foote, J., Girgensohn, A., & Boreczky, J. (1999) · Proceedings of the seventh ACM international conference on Multimedia (Part 1) · doi:10.1145/319463.319654 · Cited by 291
Time as essence for photo browsing through personal digital libraries
Graham, A., Garcia-Molina, H., Paepcke, A., & Winograd, T. (2002) · Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries · doi:10.1145/544220.544301 · Cited by 282
Tieu, K., & Viola, P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000004830.93820.78 · Cited by 280
Applications of video-content analysis and retrieval
Dimitrova, N., Zhang, H.-J., Shahraray, B., Sezan, I., Huang, T., & Zakhor, A. (2002) · IEEE Multimedia · doi:10.1109/mmul.2002.1022858 · Cited by 278
RELIABLE TRANSITION DETECTION IN VIDEOS: A SURVEY AND PRACTITIONER'S GUIDE
LIENHART, R. (2001) · International Journal of Image and Graphics · doi:10.1142/s021946780100027x · Cited by 275
Lindeberg, T., & Gårding, J. (1997) · Image and Vision Computing · doi:10.1016/s0262-8856(97)01144-x · Cited by 269
Unsupervised feature selection applied to content-based retrieval of lung images
Dy, J. G., Brodley, C. E., Kak, A., Broderick, L. S., & Aisen, A. M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1182100 · Cited by 255
Principles of Visual Information Retrieval
(2001) · Advances in Pattern Recognition · doi:10.1007/978-1-4471-3702-3 · Cited by 245
Self-citationFoundations of Library and Information Science.
Rubin, R. E. (2004) · Cited by 244
Decision Estimation and Classification
Magoun, A. D. (1990) · Technometrics · doi:10.1080/00401706.1990.10484755 · Cited by 227
Efficient matching and indexing of graph models in content-based retrieval
Berretti, S., Del Bimbo, A., & Vicario, E. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954600 · Cited by 225
Does organisation by similarity assist image browsing?
Rodden, K., Basalaj, W., Sinclair, D., & Wood, K. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365097 · Cited by 215
Classification with nonmetric distances: image retrieval and class representation
Jacobs, D. W., Weinshall, D., & Gdalyahu, Y. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.862197 · Cited by 210
WARP: accurate retrieval of shapes using phase of Fourier descriptors and time warping distance
Bartolini, I., Ciaccia, P., & Patella, M. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.21 · Cited by 201
Temporal event clustering for digital photo collections
Cooper, M., Foote, J., Girgensohn, A., & Wilcox, L. (2005) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/1083314.1083317 · Cited by 192
European signal processing conference
Jain, V. (1980) · IEEE Acoustics, Speech, and Signal Processing Newsletter · doi:10.1109/msp.1980.237652 · Cited by 189
End-User Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive
Markkula, M., & Sormunen, E. (2000) · Information Retrieval · doi:10.1023/a:1009995816485 · Cited by 187
Semantic visual templates: linking visual features to semantics
Cheng, S.-F., Chen, W., & Sundaram, H. (2002) · Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269) · doi:10.1109/icip.1998.727321 · Cited by 178
On image classification: city vs. landscape
Vailaya, A., Jain, A., & Zhang, H. J. (2002) · Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173) · doi:10.1109/ivl.1998.694464 · Cited by 163
The Truth about Corel - Evaluation in Image Retrieval
Müller, H., Marchand-Maillet, S., & Pun, T. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45479-9_5 · Cited by 161
Automatic Detection of Human Nudes
Forsyth, D. A., & Fleck, M. M. (1999) · International Journal of Computer Vision · doi:10.1023/a:1008145029462 · Cited by 155
Probabilistic space-time video modeling via piecewise gmm
Greenspan, H. K., Goldberger, J., & Mayer, A. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1262334 · Cited by 146
Matching images with different resolutions
Dufournaud, Y., Schmid, C., & Horaud, R. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855876 · Cited by 141
The SMART retrieval system; experiments in automatic document processing
Hayes, R. M. (1973) · Information Processing & Management · doi:10.1016/0020-0271(73)90067-3 · Cited by 139
Emotion recognition using a Cauchy Naive Bayes classifier
Sebe, N., Lew, M. S., Cohen, I., Garg, A., & Huang, T. S. (2003) · Object recognition supported by user interaction for service robots · doi:10.1109/icpr.2002.1044578 · Cited by 138
Self-citationProceedings of the 17th ACM international conference on Multimedia
(2009) · doi:10.1145/1631272 · Cited by 135
Next-generation Web searches for visual content
Lew, M. S. (2000) · Computer · doi:10.1109/2.881694 · Cited by 132
Self-citationMultimodal Human Computer Interaction: A Survey
Jaimes, A., & Sebe, N. (2005) · Lecture notes in computer science · doi:10.1007/11573425_1 · Cited by 130
Self-citationImage retrieval using wavelet-based salient points
Tian, Q., Sebe, N., S., L. M., Loupias, E., & Huang, T. S. (2001) · Journal of Electronic Imaging · doi:10.1117/1.1406945 · Cited by 129
Self-citationJain, R. (2003) · Communications of the ACM · doi:10.1145/792704.792729 · Cited by 129
Self-citationTRECVID: evaluating the effectiveness of information retrieval tasks on digital video
Smeaton, A. F., Over, P., & Kraaij, W. (2004) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1027527.1027678 · Cited by 125
Multi-level annotation of natural scenes using dominant image components and semantic concepts
Fan, J., Gao, Y., & Luo, H. (2004) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1027527.1027660 · Cited by 121
ACM SIGMM retreat report on future directions in multimedia research
Rowe, L. A., & Jain, R. (2005) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/1047936.1047938 · Cited by 120
Self-citationStrategies for positive and negative relevance feedback in image retrieval
Müller, H., Müller, W., Marchand‐Maillet, S., Pun, T., & Squire, D. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2000.905650 · Cited by 120
Shen, H. T., Ooi, B. C., & Tan, K. (2000) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/354384.376098 · Cited by 119
Content-based image retrieval based on a fuzzy approach
Krishnapuram, R. J., Medasani, S., Jung, S., Choi, Y.-S., & Balasubramaniam, R. (2004) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2004.53 · Cited by 113
Toward improved ranking metrics
Sebe, N., Lew, M. S., & Huijsmans, D. P. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.879793 · Cited by 107
Self-citationHome photo content modeling for personalized event-based retrieval
Lim, J., Tian, Q., & Mulhem, P. (2003) · IEEE Multimedia · doi:10.1109/mmul.2003.1237548 · Cited by 106
Comparing discriminating transformations and SVM for learning during multimedia retrieval
Zhou, X. S., & Huang, T. S. (2001) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/500141.500163 · Cited by 101
The State of the Art in Image and Video Retrieval
Sebe, N., Lew, M. S., Zhou, X. S., Huang, T. S., & Bakker, E. M. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45113-7_1 · Cited by 100
Self-citationHuijsmans, D. P., & Sebe, N. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.30 · Cited by 93
Self-citationIntegrating relevance feedback techniques for image retrieval using reinforcement learning
Yin, P.-Y., Bhanu, B., Chang, K.-C., & Dong, A. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.201 · Cited by 93
HPAT Indexing for Fast Object/Scene Recognition Based on Local Appearance
Shao, H., Svoboda, T., Tuytelaars, T., & Gool, L. V. (2007) · Springer eBooks · doi:10.1007/3-540-45113-7_8 · Cited by 90
Non-retrieval: Blocking Pornographic Images
Bosson, A., Cawley, G. C., Chan, Y., & Harvey, R. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45479-9_6 · Cited by 90
Extracting information about emotions in films
Salway, A., & Graham, M. (2003) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/957013.957076 · Cited by 88
Evaluation of salient point techniques
Sebe, N., Tian, Q., Loupias, E., Lew, M. S., & Huang, T. S. (2003) · Image and Vision Computing · doi:10.1016/j.imavis.2003.08.012 · Cited by 88
Self-citationA utility framework for the automatic generation of audio-visual skims
Sundaram, H., Xie, L., & Chang, S. (2002) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/641007.641042 · Cited by 84
Effective browsing of web image search results
Liu, H., Xie, X., Tang, X., Li, Z., & Ma, W. (2004) · doi:10.1145/1026711.1026726 · Cited by 83
Multispace KL for pattern representation and classification
Cappelli, R., & Maltoni, D. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.955111 · Cited by 80
Learning and inferring a semantic space from user's relevance feedback for image retrieval
He, X., Ma, W., King, O. D., Li, M., & Zhang, H. (2002) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/641007.641080 · Cited by 70
Video Classification Based On Hmm Using Text And Faces
Dimitrova, N., Agnihotri, L., & Wei, G. (2000) · doi:10.5281/zenodo.37651 · Cited by 68
Evaluation of key frame-based retrieval techniques for video
Pickering, M. J., & Rüger, S. (2003) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2003.06.002 · Cited by 66
Crennell, K. M., & Baker, K. D. (1990) · Image and Vision Computing · doi:10.1016/0262-8856(90)90048-a · Cited by 64
MediaMill: exploring news video archives based on learned semantics
Snoek, C. G. M., Worring, M., van Gemert, J. C., Geusebroek, J., Koelma, D. C., Giang, N. T. P., de Rooij, O., & Seinstra, F. J. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101188 · Cited by 58
Content-based multimedia indexing and retrieval
Djeraba, C. (2002) · IEEE Multimedia · doi:10.1109/mmul.2002.998047 · Cited by 55
Self-citationToward The Scientific Evaluation Of Music Information Retrieval Systems.
Downie, J. S. (2003) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1417120 · Cited by 52
Association and content-based retrieval
Djeraba, C. (2003) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2003.1161586 · Cited by 52
Self-citationShape Feature Matching for Trademark Image Retrieval
Eakins, J. P., Riley, K. J., & Edwards, J. D. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45113-7_4 · Cited by 49
Relevance Feedback Techniques in Image Retrieval
Rui, Y., & Huang, T. S. (2001) · Advances in computer vision and pattern recognition · doi:10.1007/978-1-4471-3702-3_9 · Cited by 49
Information theory and face detection
Lew, M. S., & Huijsmans, N. (1996) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1996.547017 · Cited by 49
Self-citationSemantic knowledge construction from annotated image collections
Benitez, A. B., & Chang, S. (2003) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2002.1035549 · Cited by 48
Jain, R., Kim, P., & Li, Z. (2003) · doi:10.1145/982484.982486 · Cited by 47
Self-citationPivot vector space approach for audio-video mixing
Mulhem, P., Kankanhalli, M., Yi, J. H., & Hassan, H. (2003) · IEEE Multimedia · doi:10.1109/mmul.2003.1195159 · Cited by 47
A New Method for Key Frame Based Video Content Representation
Hanjalić, A., Lagendijk, R. L., & Biemond, J. (1998) · Series on software engineering and knowledge engineering · doi:10.1142/9789812797988_0009 · Cited by 45
Evaluation of Image Retrieval Systems: Role of User Feedback
Hastings, S. K. (1999) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 44
Evaluation of video summarization for a large number of cameras in ubiquitous home
de Silva, G. C., Yamasaki, T., & Aizawa, K. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101329 · Cited by 43
Efficient content-based indexing of large image databases
El-Kwae, E. A., & Kabuka, M. R. (2000) · ACM Transactions on Information Systems · doi:10.1145/348751.348762 · Cited by 42
Foundations of library and information science
McCallum, I. (2021) · Journal of the Australian Library and Information Association · doi:10.1080/24750158.2021.1875792 · Cited by 41
Developing a DataBlade for a new index
Bliujute, R., Šaltenis, S., Slivinskas, G., & Jensen, C. S. (1999) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.1999.754947 · Cited by 36
(2004) · Sage eBooks · doi:10.4135/9781412950589.n25 · Cited by 35
Fast retrieval of high-dimensional feature vectors in P2P networks using compact peer data summaries
Müller, W., & Henrich, A. (2003) · Multimedia Information Retrieval · doi:10.1145/973264.973278 · Cited by 34
A multi-modal system for the retrieval of semantic video events
Amir, A., Basu, S., Iyengar, G., Lin, C., Naphade, M., Smith, J. R., Srinivasan, S., & Tseng, B. L. (2004) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.02.006 · Cited by 32
A GAME EXPERIENCE IN EVERY APPLICATION
Rosenbloom, A. (2003) · Communications of the ACM · Cited by 30
Sebe, N., & Lew, M. S. (2001) · Pattern Recognition Letters · doi:10.1016/s0167-8655(00)00092-1 · Cited by 30
Self-citationAutomatic Annotation of Images from the Practitioner Perspective
Enser, P. G. B., Sandom, C. J., & Lewis, P. H. (2005) · Lecture notes in computer science · doi:10.1007/11526346_53 · Cited by 29
MediaMetro: browsing multimedia document collections with a 3D city metaphor
Chiu, P., Girgensohn, A., Lertsithichai, S., Polak, W., & Shipman, F. M., III (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101182 · Cited by 25
Boosting for content-based audio classification and retrieval: an evaluation
Guo, G., Zhang, H.-J., & li, S. (2001) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2001.1237892 · Cited by 25
Image emotional classification: static vs. dynamic
Wei-ning, W., Yu, Y., & Jian-chao, Z. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1401407 · Cited by 24
Jolion, J.-M. (2001) · Advances in computer vision and pattern recognition · doi:10.1007/978-1-4471-3702-3_5 · Cited by 23
Gevers, T. (2001) · Advances in computer vision and pattern recognition · doi:10.1007/978-1-4471-3702-3_2 · Cited by 22
Multimedia Content Analysis: The Next Wave
Dimitrova, N. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45113-7_2 · Cited by 22
Semantic Video Retrieval Using Audio Analysis
Bakker, E. M., & Lew, M. S. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45479-9_29 · Cited by 21
Self-citationMedSMan: a streaming data management system over live multimedia
Liu, B., Gupta, A., & Jain, R. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101174 · Cited by 21
Self-citationINTERACTIVE RETRIEVAL OF COLOR IMAGES
Worring, M., & Gevers, T. (2001) · International Journal of Image and Graphics · doi:10.1142/s0219467801000244 · Cited by 21
Relevance feedback: perceptual learning and retrieval in bio-computing, photos, and video
Haas, M., Rijsdam, J. T., Thomée, B., & Lew, M. S. (2004) · doi:10.1145/1026711.1026737 · Cited by 21
Self-citationA Closer Look at Boosted Image Retrieval
Howe, N. R. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45113-7_7 · Cited by 19
Detection of human faces in a compressed domain for video stratification
Chua, T., Zhao, Y., & Kankanhalli, M. (2002) · The Visual Computer · doi:10.1007/s003710100137 · Cited by 19
Balakrishnan, N., Hariharakrishnan, K., & Schonfeld, D. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.170 · Cited by 18
EBS k-d Tree: An Entropy Balanced Statistical k-d Tree for Image Databases with Ground-Truth Labels
Scott, G. J., & Shyu, C. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45113-7_46 · Cited by 16
MPEG-7: A STANDARD FOR MULTIMEDIA CONTENT DESCRIPTION
Pereira, F. M. B., & Koenen, R. (2001) · International Journal of Image and Graphics · doi:10.1142/s021946780100030x · Cited by 16
Adapting k-d Trees to Visual Retrieval
Egas, R., Huijsmans, N., Lew, M. S., & Sebe, N. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48762-x_66 · Cited by 15
Self-citationDetecting Semantic Concepts from Video Using Temporal Gradients and Audio Classification
Rautiainen, M., Seppänen, T., Penttilä, J., & Peltola, J. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45113-7_26 · Cited by 13
On the efficient evaluation of relaxed queries in biological databases
Chen, Y., Che, D., & Aberer, K. (2002) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/584792.584832 · Cited by 13
Sebe, N., & Lew, M. S. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45479-9_3 · Cited by 12
Self-citationFast Search in Large-Scale Image Database Using Vector Quantization
Ye, H., & Xu, G. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45113-7_47 · Cited by 12
Analyzing user's behavior on a video database
Mongy, S., Bouali, F., & Djeraba, C. (2005) · doi:10.1145/1133890.1133902 · Cited by 12
Self-citationRetrieval of 3D objects by visual similarity
Assfalg, J., Bimbo, A. D., & Pala, P. (2004) · doi:10.1145/1026711.1026725 · Cited by 12
Mix and Match Features in the ImageRover Search Engine
Sclaroff, S., Cascia, M. L., Sethi, S., & Taycher, L. (2001) · Advances in computer vision and pattern recognition · doi:10.1007/978-1-4471-3702-3_10 · Cited by 11
Wu, P., Choi, Y., Ro, Y. M., & Won, C. S. (2001) · International Journal of Image and Graphics · doi:10.1142/s0219467801000311 · Cited by 11
Visualization, Estimation and User-Modeling for Interactive Browsing of Image Libraries
Tian, Q., Moghaddam, B., & Huang, T. S. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45479-9_2 · Cited by 10
Researchexplorer: gaining insights through exploration in multimedia scientific data
Gong, B., Singh, R., & Jain, R. (2004) · doi:10.1145/1026711.1026714 · Cited by 10
Self-citationTowards a comprehensive integration of subjective parameters in database browsing
Bianchi‐Berthouze, N., Berthouze, L., & Kato, T. (2002) · International Workshop on Database and Expert Systems Applications (DEXA) · doi:10.1109/dexa.1998.707507 · Cited by 9
Accessing video archives using interactive search
Worring, M., Nguyen, G. P., Hollink, L., van Gemert, J. C., & Koelma, D. C. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2004.1394184 · Cited by 8
Fisher keys for content based retrieval
Lew, M. S., & Denteneer, D. (2001) · Image and Vision Computing · doi:10.1016/s0262-8856(00)00102-5 · Cited by 5
Self-citationShot Break Detection and Camera Motion Classification in Digital Video
Haas, M., Lew, M. S., & Huijsmans, D. P. (1998) · Series on software engineering and knowledge engineering · doi:10.1142/9789812797988_0016 · Cited by 5
Self-citationLearning Optimal Representations for Image Retrieval Applications
Liu, X., Srivastava, A., & Sun, D. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45113-7_6 · Cited by 4
Spierenburg, J. A., & Huijsmans, D. P. (1997) · British Machine Vision Conference (BMVC) · Cited by 4
A new relevance for multimedia when we record everything personal
Bell, G. (2004) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1027527.1027528 · Cited by 3
Research works printed but not linked: 5
- Bach , J. R. , Fuller , C. , Gupta , A. , Hampapur , A. , Horowitz , B. , Humphrey , R. , Jain , R. , and Shu , C. F . 1996. Virage image search engine: An open framework for image management . In Proceedings of the SPIE Storage and Retrieval for Still Image and Video Databases. 76--87 .]] Bach, J. R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R., and Shu, C. F. 1996. Virage image search engine: An open framework for image management. In Proceedings of the SPIE Storage and Retrieval for Still Image and Video Databases. 76--87.]]
- Eiter T. and Libkin L. 2005. Database Theory. Springer London. UK.]] Eiter T. and Libkin L. 2005. Database Theory. Springer London. UK.]]
- Enser , P. G. B. and Sandom , C. J . 2003. Towards a comprehensive survey of the semantic gap in visual information retrieval . In Proceedings of the 2nd International Conference on Image and Video Retrieval. (July) , Urbana, IL, E. M. Bakker, T. S. Huang, M. S. Lew, N. Sebe and X. Zhou, Eds. Springer-Verlag, London, UK. 291--299.]] Enser, P. G. B. and Sandom, C. J. 2003. Towards a comprehensive survey of the semantic gap in visual information retrieval. In Proceedings of the 2nd International Conference on Image and Video Retrieval. (July), Urbana, IL, E. M. Bakker, T. S. Huang, M. S. Lew, N. Sebe and X. Zhou, Eds. Springer-Verlag, London, UK. 291--299.]]
- Lew , M. S. 2001. Principles of Visual Information Retrieval . Springer , London, UK .]] Lew, M. S. 2001. Principles of Visual Information Retrieval. Springer, London, UK.]]
- Tian , Q. , Moghaddam , B. , and Huang , T. S . 2002. Visualization, estimation and user-modeling . In Proceedings of the 1st International Conference on Image and Video Retrieval. (July) , London, UK, M. S. Lew, N. Sebe, and J. P. Eakins, Eds. Springer-Verlag, London, UK, 7--16.]] Tian, Q., Moghaddam, B., and Huang, T. S. 2002. Visualization, estimation and user-modeling. In Proceedings of the 1st International Conference on Image and Video Retrieval. (July), London, UK, M. S. Lew, N. Sebe, and J. P. Eakins, Eds. Springer-Verlag, London, UK, 7--16.]]
Cited by
Image retrieval: Ideas, influences, and trends of the new age
Datta, R., Joshi, D., Li, J., & Wang, J. Z. (2008) · ACM Computing Surveys · doi:10.1145/1348246.1348248 · Cited by 3,040
Chen, M., Mao, S., & Liu, Y. (2014) · Mobile Networks and Applications · doi:10.1007/s11036-013-0489-0 · Cited by 2,913
Image-Based Recommendations on Styles and Substitutes
McAuley, J., Targett, C., Shi, Q., & van den Hengel, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767755 · Cited by 2,280
The MIR flickr retrieval evaluation
Huiskes, M. J., & Lew, M. S. (2008) · Proceedings of the 1st ACM international conference on Multimedia information retrieval · doi:10.1145/1460096.1460104 · Cited by 1,836
Self-citationHow to Evaluate Foreground Maps
Margolin, R., Zelnik-Manor, L., & Tal, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.39 · Cited by 1,106
Metadata
- Authors
- Lew, M. S., Sebe, N., Djeraba, C., & Jain, R.
- Affiliations
- Leiden University (NL)
- University of Amsterdam (NL)
- Laboratoire d'Informatique Fondamentale de Lille (FR)
- University of California, Irvine (US)
- Venue
- ACM Transactions on Multimedia Computing, Communications, and Applications
- Published
- 2006-02
- Volume
- 2
- Issue
- 1
- Pages
- 1-19
- ISSN
- 1551-6857 (ISSN-L)
- 1551-6865
- OpenAlex
- W2147069236
- Semantic Scholar
- cabe73e89b6389a163393ecbf1b82d20ba4ea10f
- Cited by
- 1,528
- References
- 152
- Citations by year
- 2026: 17 · 2025: 13 · 2024: 20 · 2023: 25 · 2022: 18 · 2021: 31 · 2020: 34 · 2019: 58 · 2018: 64 · 2017: 88 · 2016: 77 · 2015: 102 · 2014: 113 · 2013: 132 · 2012: 160
- FWCI
- 113.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Multimedia Computing Communications and Applications (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- HAL (submittedVersion)
- Iris (University of Trento) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- multimedia browsing, multimedia retrieval, user study, affective computing, multimedia learning, semantic queries, indexing, evaluation techniques, media types
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.