Image retrieval using scene graphs
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph. Our scene graphs represent objects (“man”, “boat”), attributes of objects (“boat is white”) and relationships between objects (“man standing on boat”). We use these scene graphs as queries to retrieve semantically related images. To this end, we design a conditional random field model that reasons about possible groundings of scene graphs to test images. The likelihoods of these groundings are used as ranking scores for retrieval. We introduce a novel dataset of 5,000 human-generated scene graphs grounded to images and use this dataset to evaluate our method for image retrieval. In particular, we evaluate retrieval using full scene graphs and small scene subgraphs, and show that our method outperforms retrieval methods that use only objects or low-level image features. In addition, we show that our full model can be used to improve object localization compared to baseline methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Datasets have been a driving force of computer vision algorithms, ranging from classi-fication [64] to object recognition and segmentation [18, 12, 55, 15].”
MethodAre we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 1×
“Their sys-tem is constrained to the six object classes from KITTI [23] while our system uses an open-world vocabulary; our scene graphs also tend to be more complex than their semantic graphs.”
MethodConditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Research works printed but not linked: 5
- jurafsky, 2000, Speech & language processing
- lampert, 2013, Attribute-based classification for zero-shot learning of object categories, PAMI
- yao, 2011, Classifying actions and measuring action similarity by modeling the mutual context of objects and human poses, a) A 1(D2) D3
- 0, OpenSceneGraph
- 10.1145/1964921.1964929 · DOI · Paper page
Cited by
Items 501–600 of 1,001
RepSGG: Novel Representations of Entities and Relationships for Scene Graph Generation
Liu, H., & Bhanu, B. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3402143 · Cited by 18
Toward Complex-query Referring Image Segmentation: A Novel Benchmark
Ji, W., Li, L., Fei, H., Liu, X., Yang, X., Li, J., & Zimmermann, R. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3701733 · Cited by 18
Self-citationLearning 4D Panoptic Scene Graph Generation from Rich 2D Visual Scene
Wu, S., Fei, H., Yang, J., Li, X., Li, J., Zhang, H., & Chua, T. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02285 · Cited by 18
Scene Graph Disentanglement and Composition for Generalizable Complex Image Generation
Wang, Y., Li, Z., Zhang, W., Zhang, Z., Xie, B., Liu, X., Zeng, W., & Jin, X. (2024) · neural information processing systems · doi:10.52202/079017-3125 · Cited by 18
Probabilistic Semantic Retrieval for Surveillance Videos With Activity Graphs
Chen, Y., Wang, J., Bai, Y., Castanon, G. D., & Saligrama, V. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2865860 · Cited by 18
Adversarial Adaptation of Scene Graph Models for Understanding Civic Issues
Kumar, S., Atreja, S., Singh, A., & Jain, M. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313681 · Cited by 18
Answering Visual-Relational Queries in Web-Extracted Knowledge Graphs
Oñoro-Rubio, D., Niepert, M., García-Durán, A., González-Sánchez, R., & López-Sastre, R. J. (2019) · Automated Knowledge Base Construction · Cited by 18
Self-supervised relationship probing
Gu, J., Kuen, J., Joty, S., Cai, J., Morariu, V. I., Zhao, H., & Sun, T. (2020) · Monash University Research Portal (Monash University) · Cited by 18
Reliable Extraction of Semantic Information and Rate of Innovation Estimation for Graph Signals
Kalfa, M., Yetim, S. Y., Atalık, A., Gok, M., Ge, Y., Li, R., Tong, W., Duman, T. M., & Arıkan, O. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3221950 · Cited by 18
Fu, Z., Zheng, C., Feng, J., Cai, Y., Wei, X.-Y., Wang, Y., & Li, Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3231437 · Cited by 18
Referring Expression Comprehension with Semantic Visual Relationship and Word Mapping
Zhang, C., Li, W., Ouyang, W., Wang, Q., Kim, W.-S., & Hong, S. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3351063 · Cited by 18
Interactive Visual Pattern Search on Graph Data via Graph Representation Learning
Song, H., Dai, Z., Xu, P., & Ren, L. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114857 · Cited by 18
A System for Morphology-Task Generalization via Unified Representation and Behavior DistillationPreprint
Furuta, H., Iwasawa, Y., Matsuo, Y., & Gu, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.14296 · Cited by 18
Open World Scene Graph Generation using Vision Language ModelsPreprint
Dutta, A., Mehrab, K. S., Sawhney, M., Neog, A., Khurana, M., Fatemi, S., Pradhan, A., Maruf, M., Lourentzou, I., Daw, A., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.08189 · Cited by 18
Fully Functional Image Manipulation Using Scene Graphs in A Bounding-Box Free Way
Su, S., Gao, L., Zhu, J., Shao, J., & Song, J. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475326 · Cited by 17
EgoSG: Learning 3D Scene Graphs from Egocentric RGB-D Sequences
Zhang, C., Yang, X., Hou, J., Kitani, K., Cai, W., & Chu, F.-J. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00260 · Cited by 17
Leveraging Style and Content features for Text Conditioned Image Retrieval
Chawla, P., Jandial, S., Badjatiya, P., Chopra, A., Sarkar, M., & Krishnamurthy, B. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00448 · Cited by 17
Scene Graph Parsing via Abstract Meaning Representation in Pre-trained Language Models
Choi, W. S., Heo, Y., Punithan, D., & Zhang, B. (2022) · doi:10.18653/v1/2022.dlg4nlp-1.4 · Cited by 17
Complex Video Action Reasoning via Learnable Markov Logic Network
Jin, Y., Zhu, L., & Mu, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00324 · Cited by 17
Task-Driven Graph Attention for Hierarchical Relational Object Navigation
Lingelbach, M., Li, C., Hwang, M., Kurenkov, A., Lou, A., Martín-Martín, R., Zhang, R., Fei-Fei, L., & Wu, J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161157 · Cited by 17
Self-citationSSGVS: Semantic Scene Graph-to-Video Synthesis
Cong, Y., Yi, J., Rosenhahn, B., & Yang, M. Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00254 · Cited by 17
Deep Learning—A New Era in Bridging the Semantic Gap
Markowska–Kaczmar, U., & Kwaśnicka, H. (2018) · Intelligent systems reference library · doi:10.1007/978-3-319-73891-8_7 · Cited by 17
Compact Scene Graphs for Layout Composition and Patch Retrieval
Tripathi, S., Sridhar, S. N., Sundaresan, S., & Tang, H. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00094 · Cited by 17
Explaining the semantics capturing capability of scene graph generation models
Luo, J., Zhao, J., Wen, B., & Zhang, Y. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107427 · Cited by 17
Relation Regularized Scene Graph Generation
Guo, Y., Gao, L., Song, J., Wang, P., Sebe, N., Shen, H. T., & Li, X. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3052522 · Cited by 17
Wang, X., Lü, L., Shin, H.-C., Kim, L., Nogues, I., Yao, J., & Summers, R. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.07965 · Cited by 17
RICE: Refining Instance Masks in Cluttered Environments with Graph Neural NetworksPreprint
Xie, C., Mousavian, A., Yu, X., & Fox, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15711 · Cited by 17
Open-Architecture End-to-End System for Real-World Autonomous Robot NavigationPreprint
Devarakonda, V. N., Kaypak, A. U., Goswami, R. G., Patel, N., Khorrambakht, R., Krishnamurthy, P., & Khorrami, F. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.06239 · Cited by 17
Social Relation Analysis from Videos via Multi-entity Reasoning
Yan, C., Liu, Z., Li, F., Cao, C., Wang, Z., & Wu, B. (2021) · International Conference on Multimedia Retrieval · doi:10.1145/3460426.3463634 · Cited by 16
3D Scene Graph Generation From Point Clouds
Wei, W., Wei, P., Qin, J., Liao, Z., Wang, S., Cheng, X., Liu, M., & Zheng, N. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3331583 · Cited by 16
Zero-Shot Character Identification and Speaker Prediction in Comics via Iterative Multimodal Fusion
Li, Y., Hinami, R., Aizawa, K., & Matsui, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681659 · Cited by 16
Fime, A. A., Mahmud, S., Das, A., Islam, M. K., & Kim, J.-H. (2025) · IEEE Access · doi:10.1109/access.2025.3574298 · Cited by 16
Zhang, J., Zhu, G., Li, S., Liu, X., Song, H., Tang, X., & Feng, C. (2024) · neural information processing systems · doi:10.52202/079017-0565 · Cited by 16
MIGS: Meta Image Generation from Scene Graphs
Farshad, A., Musatian, S., Dhamo, H., & Navab, N. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.393 · Cited by 16
Unsupervised Traffic Scene Generation with Synthetic 3D Scene Graphs
Savkin, A., Ellouze, R., Navab, N., & Tombari, F. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636318 · Cited by 16
Faster Zero-shot Multi-modal Entity Linking via Visual-Linguistic Representation
Zheng, Q., Wen, H., Wang, M., Qi, G., & Bai, C. (2022) · Data Intelligence · doi:10.1162/dint_a_00146 · Cited by 16
Zero-Shot Predicate Prediction for Scene Graph Parsing
Li, Y., Yang, X., Huang, X., Ma, Z., & Xu, C. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3155928 · Cited by 16
Zhang, C., Huang, C., Li, Y., Zhang, X., Ye, Y., & Zhang, C. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557382 · Cited by 16
RSG-GCN: Predicting Semantic Relationships in Urban Traffic Scene With Map Geometric Prior
Tian, Y., Carballo, A., Li, R., & Takeda, K. (2023) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2023.3260624 · Cited by 16
Learning Audio-Visual Dynamics Using Scene Graphs for Audio Source Separation
Chatterjee, M., Ahuja, N., & Cherian, A. (2022) · neural information processing systems · doi:10.52202/068431-1235 · Cited by 16
Learning visual features for relational CBIR
Messina, N., Amato, G. M., Carrara, F., Falchi, F., & Gennaro, C. (2019) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-019-00178-7 · Cited by 16
Self-Supervised Learning of Scene-Graph Representations for Robotic Sequential Manipulation Planning
Nguyen, S., Oguz, O. S., Hartmann, V. N., & Toussaint, M. (2020) · Conference on Robot Learning · Cited by 16
Scene Graph based Image Retrieval -- A case study on the CLEVR DatasetPreprint
Ramnath, S., Saha, A., Chakrabarti, S., & Khapra, M. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00850 · Cited by 16
Deep Reinforcement Learning for Producing Furniture Layout in Indoor ScenesPreprint
Di, X., & Yu, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07462 · Cited by 16
Memory-Based Network for Scene Graph with Unbalanced Relations
Wang, W., Liu, R., Wang, M., Wang, S., Chang, X., & Chen, Y. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413507 · Cited by 15
SEMScene: Semantic-Consistency Enhanced Multi-Level Scene Graph Matching for Image-Text Retrieval
Liu, Y., Yuan, X., Li, H., Tan, Z., Huang, J.-B., Xiao, J., Li, W., & Mo, T. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3664816 · Cited by 15
Informative Scene Graph Generation via Debiasing
Gao, L., Lyu, X., Guo, Y., Hu, Y., Li, Y.-F., Xu, L. T., Shen, H. T., & Song, J. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02365-y · Cited by 16
CrimeScene2Graph: Generating Scene Graphs from Crime Scene Descriptions Using BERT NER
Ashfaq, F., Jhanjhi, N. Z., Khan, N. A., Muzafar, S., & Das, S. R. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-97-8090-7_14 · Cited by 15
Supervoxel Attention Graphs for Long-Range Video Modeling
Wang, Y., Bertasius, G., Oh, T.-H., Gupta, A. K., Hoai, M., & Torresani, L. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00020 · Cited by 15
Qing, L., Li, L., Wang, Y., Cheng, Y., & Peng, Y. (2021) · Remote Sensing · doi:10.3390/rs13112038 · Cited by 15
Self-citationWang, W., Luo, Y., Chen, Z., Jiang, T., Yang, Y., & Xiao, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3338078 · Cited by 15
Adaptive Feature Learning for Unbiased Scene Graph Generation
Yang, J., Wang, C., Yang, L., Jiang, Y., & Cao, A. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3374644 · Cited by 15
Image Graph Production by Dense Captioning
Sahba, A., Das, A., Rad, P., & Jamshidi, M. M. (2018) · World Automation Congress (WAC) · doi:10.23919/wac.2018.8430485 · Cited by 15
Yadav, P., Salwala, D., Das, D. P., & Curry, E. (2020) · International Journal of Semantic Computing · doi:10.1142/s1793351x20500051 · Cited by 15
CARETS: A Consistency And Robustness Evaluative Test Suite for VQA
Jimenez, C. E., Russakovsky, O., & Narasimhan, K. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.443 · Cited by 15
Learning to Infer Unseen Single-/ Multi-Attribute-Object Compositions With Graph Networks
Chen, H., Jiang, J., & Zheng, N. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3273712 · Cited by 15
Kefa: A Knowledge Enhanced and Fine-grained Aligned Speaker for Navigation Instruction GenerationPreprint
Zeng, H., Wang, X., Wang, W., & Yang, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.13368 · Cited by 15
Align R-CNN: A Pairwise Head Network for Visual Relationship Detection
Tajrobehkar, M., Tang, K., Zhang, H., & Lim, J. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3062543 · Cited by 14
Text-Image Scene Graph Fusion for Multimodal Named Entity Recognition
Cheng, J., Long, K., Zhang, S., Zhang, T., Ma, L., Cheng, S., & Guo, Y. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3326416 · Cited by 14
GNN-LoFI: A novel graph neural network through localized feature-based histogram intersection
Bicciato, A., Cosmo, L., Minello, G., Rossi, L., & Torsello, A. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110210 · Cited by 14
Scene Graph-Aware Hierarchical Fusion Network for Remote Sensing Image Retrieval With Text Feedback
Wang, F., Zhu, X., Liu, X., Zhang, Y., & Li, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3404605 · Cited by 14
Scene-Graph ViT: End-to-End Open-Vocabulary Visual Relationship Detection
Salzmann, T., Ryll, M., Bewley, A., & Minderer, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72907-2_12 · Cited by 14
SnapSeek 3.0: Interactive Lifelog Search System with Enhanced Scene Understanding
Ho-Le, M.-Q., Ho, D.-K., Ninh, V.-T., Nguyen, T.-T., Gurrin, C. G., & Tran, M.-T. (2025) · ACM Workshop on the Lifelog Search Challenge (LSC) · doi:10.1145/3729459.3748697 · Cited by 14
Learning Relationship-Aware Visual Features
Messina, N., Amato, G. M., Carrara, F., Falchi, F., & Gennaro, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11018-5_40 · Cited by 14
PDDL Planning with Natural Language-Based Scene Understanding for UAV-UGV Cooperation
Moon, J., & Lee, B.-H. (2019) · Applied Sciences · doi:10.3390/app9183789 · Cited by 14
Improving Zero-Shot Phrase Grounding via Reasoning on External Knowledge and Spatial Relations
Shi, Z., Shen, Y., Jin, H., & Zhu, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20123 · Cited by 14
Lou, C., Han, W., Lin, Y., & Zheng, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01516 · Cited by 14
Hypercomplex context guided interaction modeling for scene graph generation
Wang, Z., Xu, X., Luo, Y., Wang, G., & Yang, Y. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109634 · Cited by 14
Multi-modal spatial relational attention networks for visual question answering
Yao, H., Wang, L., Cai, C., Sun, Y., Zhang, Z., & Luo, Y. (2023) · Image and Vision Computing · doi:10.1016/j.imavis.2023.104840 · Cited by 14
Semantic Image Retrieval via Active Grounding of Visual Situations
Quinn, M. H., Conser, E., Witte, J. M., & Mitchell, M. (2018) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc.2018.00032 · Cited by 14
Classifying Collisions with Spatio-Temporal Action Graph Networks.
Herzig, R., Levi, E., Xu, H., Brosh, E., Globerson, A., & Darrell, T. (2018) · Cited by 14
Part-Aware Interactive Learning for Scene Graph Generation
Tian, H., Xu, N., Liu, A.-A., & Zhang, Y. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413501 · Cited by 14
A new image segmentation approach using community detection algorithms
Mourchid, Y., Hassouni, M. E., & Cherifi, H. (2015) · International Conference on Intelligent Systems Design and Applications (ISDA) · doi:10.1109/isda.2015.7489194 · Cited by 14
Visual Relationship Detection with Language prior and Softmax
Jung, J., & Park, J. (2018) · IEEE International Conference on Image Processing, Applications and Systems (IPAS) · doi:10.1109/ipas.2018.8708855 · Cited by 14
Machine Learning with World Knowledge: The Position and SurveyPreprint
Song, Y., & Roth, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.02908 · Cited by 14
Detecting rare visual relations using analogiesPreprint
Peyre, J., Laptev, I., Schmid, C., & Šivic, J. (2018) · arXiv (Cornell University) · Cited by 14
Target driven visual navigation exploiting object relationshipsPreprint
Qiu, Y., Pal, A., & Christensen, H. I. (2020) · arXiv (Cornell University) · Cited by 14
A Study of Compositional Generalization in Neural ModelsPreprint
Klinger, T., Adjodah, D., Marois, V., Joseph, J., Riemer, M., Pentland, A., & Campbell, M. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09437 · Cited by 14
Rethinking the Evaluation of Unbiased Scene Graph GenerationPreprint
Li, X., Chen, L., Jian, S., Xiao, S., Zhang, S., & Xiao, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.01909 · Cited by 14
Open-Vocabulary Video Scene Graph Generation via Union-aware Semantic Alignment
Wu, Z., Gao, J., & Xu, C. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681061 · Cited by 13
StoryWeaver: A Unified World Model for Knowledge-Enhanced Story Character Customization
Zhang, J., Tang, J., Zhang, R., Lv, T., & Sun, X. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i9.33079 · Cited by 13
Adaptive Visual Scene Understanding: Incremental Scene Graph Generation
Khandelwal, N., Liu, X., & Zhang, M. (2024) · neural information processing systems · doi:10.52202/079017-4335 · Cited by 13
What's in the Bottle? A Survey and Roadmap of Concept Bottleneck Models
Knab, P., Steinmann, D., Bartelt, C., Kersting, K., Schiele, B., Seidl, T., Schlegel, U., & Stammer, W. (2026) · Transactions on machine learning research · doi:10.13140/rg.2.2.19222.41285 · Cited by 13
Yang, Y., Gu, B., Alazab, M., Kumar, N., & Yu, H. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3089689 · Cited by 13
Mask and Predict: Multi-step Reasoning for Scene Graph Generation
Tian, H., Xu, N., Liu, A.-A., Yan, C. C., Mao, Z., Zhang, Q., & Zhang, Y. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475545 · Cited by 13
Knowledge driven indoor object‐goal navigation aid for visually impaired people
Hou, X., Zhao, H., Wang, C., & Liu, H. (2022) · Cognitive Computation and Systems · doi:10.1049/ccs2.12061 · Cited by 13
MLMG-SGG: Multilabel Scene Graph Generation With Multigrained Features
Li, X., Miao, P., Li, S., & Li, X. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3199089 · Cited by 13
Neuro-Symbolic AI: Bringing a new era of Machine Learning
Kishor, R. (2022) · International Journal of Research Publication and Reviews · doi:10.55248/gengpi.2022.31271 · Cited by 13
Probabilistic Programming with Stochastic Probabilities
Lew, A. K., Ghavami, M., Rinard, M., & Mansinghka, V. K. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3591290 · Cited by 13
Dark Knowledge Balance Learning for Unbiased Scene Graph Generation
Chen, Z., Luo, Y., Shao, J., Yang, Y., Wang, C., Chen, L., & Xiao, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612031 · Cited by 13
Hi-SIGIR: Hierachical Semantic-Guided Image-to-image Retrieval via Scene Graph
Wang, Y., Dai, P., Jia, X., Zeng, Z., Li, R., & Cao, X. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612283 · Cited by 13
Hypericons for interpretability: decoding abstract concepts in visual data
Pandiani, D. S. M., Lazzari, N., van Erp, M., & Presutti, V. (2023) · International Journal of Digital Humanities · doi:10.1007/s42803-023-00077-8 · Cited by 13
Maximum Common Subgraph Guided Graph Retrieval: Late and Early Interaction Networks
Roy, I., Chakrabarti, S., & De, A. (2022) · neural information processing systems · doi:10.52202/068431-2327 · Cited by 13
Semantic Image Retrieval by Uniting Deep Neural Networks and Cognitive Architectures
Potapov, A. S., Zhdanov, I., Scherbakov, O., Skorobogatko, N., Latapie, H. M., & Fenoglio, E. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-97676-1_19 · Cited by 13
Mi, J., Lyu, J., Tang, S. Y., Li, Q., & Zhang, J. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00043 · Cited by 13
Generative Modeling of Environments with Scene Grammars and Variational Inference
Izatt, G., & Tedrake, R. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196910 · Cited by 13
Conditional Embedding Pre-Training Language Model for Image Captioning
Li, P., Zhang, M., Lin, P., Wan, J., & Jiang, M. (2022) · Neural Processing Letters · doi:10.1007/s11063-022-10844-3 · Cited by 13
Semantic image retrieval for complex queries using a knowledge parser
Chen, H., Trouvé, A., Murakami, K. J., & Fukuda, A. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4932-2 · Cited by 13
Image2song: Song Retrieval via Bridging Image Content and Lyric Words
Li, X., Hu, D., & Lu, X. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.602 · Cited by 13
Pârcălăbescu, L., & Frank, A. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00489 · Cited by 13
Metadata
- Authors
- Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L.
- Affiliations
- Stanford University (US)
- Max Planck Institute for Informatics (DE)
- Yahoo (United States) (US)
- ORCID
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 3668-3678
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2077069816
- Cited by
- 1,101
- References
- 68
- Citations by year
- 2026: 59 · 2025: 84 · 2024: 133 · 2023: 134 · 2022: 130 · 2021: 139 · 2020: 145 · 2019: 117 · 2018: 66 · 2017: 47 · 2016: 33 · 2015: 13
- FWCI
- 21.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- semantic image retrieval, scene graph, conditional random fields, object relations, image ranking, object localization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.