Image retrieval using scene graphs
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph. Our scene graphs represent objects (“man”, “boat”), attributes of objects (“boat is white”) and relationships between objects (“man standing on boat”). We use these scene graphs as queries to retrieve semantically related images. To this end, we design a conditional random field model that reasons about possible groundings of scene graphs to test images. The likelihoods of these groundings are used as ranking scores for retrieval. We introduce a novel dataset of 5,000 human-generated scene graphs grounded to images and use this dataset to evaluate our method for image retrieval. In particular, we evaluate retrieval using full scene graphs and small scene subgraphs, and show that our method outperforms retrieval methods that use only objects or low-level image features. In addition, we show that our full model can be used to improve object localization compared to baseline methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Datasets have been a driving force of computer vision algorithms, ranging from classi-fication [64] to object recognition and segmentation [18, 12, 55, 15].”
MethodAre we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 1×
“Their sys-tem is constrained to the six object classes from KITTI [23] while our system uses an open-world vocabulary; our scene graphs also tend to be more complex than their semantic graphs.”
MethodConditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Research works printed but not linked: 5
- jurafsky, 2000, Speech & language processing
- lampert, 2013, Attribute-based classification for zero-shot learning of object categories, PAMI
- yao, 2011, Classifying actions and measuring action similarity by modeling the mutual context of objects and human poses, a) A 1(D2) D3
- 0, OpenSceneGraph
- 10.1145/1964921.1964929 · DOI · Paper page
Cited by
Items 301–400 of 1,001
Unambiguous Scene Text Segmentation With Referring Expression Comprehension
Rong, X., Yi, C., & Tian, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2930176 · Cited by 46
He, T., Gao, L., Song, J., Cai, J., & Li, Y.-F. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/82 · Cited by 46
Whodunnit? Crime Drama as a Case for Natural Language Understanding
Frermann, L., Cohen, S. B., & Lapata, M. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00001 · Cited by 45
Visual-Semantic Matching by Exploring High-Order Attention and Distraction
Li, Y., Zhang, D., & Mu, Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01280 · Cited by 45
Dynamic Scene Graph Generation via Temporal Prior Inference
Wang, S., Gao, L., Lyu, X., Guo, Y., Zeng, P., & Song, J. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548324 · Cited by 44
History-Enhanced 3D Scene Graph Reasoning From RGB-D Sequences
Feng, M., Yan, C. K., Wu, Z., Dong, W., Wang, Y., & Mian, A. S. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3548308 · Cited by 44
Knowledge-Based Video Question Answering with Unsupervised Scene Descriptions
García, N., & Nakashima, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58523-5_34 · Cited by 44
Visual Scene Graphs for Audio Source Separation
Chatterjee, M., Roux, J. L., Ahuja, N., & Cherian, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00124 · Cited by 44
KERMIT: Knowledge-EmpoweRed Model In harmful meme deTection
Grasso, B., Gatta, V. L., Moscato, V., & Sperlí, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102269 · Cited by 43
What Object Should I Use? - Task Driven Object Detection
Sawatzky, J., Souri, Y., Grund, C., & Gall, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00779 · Cited by 43
Visual Question Answering over Scene Graph
Lee, S., Kim, J.-W., Oh, Y., & Jeon, J. H. (2019) · IEEE International Conference on Graph Computing (GC) · doi:10.1109/gc46384.2019.00015 · Cited by 43
Scene Graph Generation With Hierarchical Context
Ren, G., Ren, L., Liao, Y., Liu, S., Li, B. H., Han, J., & Yan, S. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979270 · Cited by 43
Swinv2-Imagen: hierarchical vision transformer diffusion models for text-to-image generation
Li, R., Li, W., Yang, Y., Wei, H., Jiang, J., & Bai, Q. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-09021-x · Cited by 42
Unsupervised Textual Grounding: Linking Words to Image Concepts
Yeh, R. A., Do, M. N., & Schwing, A. G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00641 · Cited by 42
Towards Unique and Informative Captioning of Images
Wang, Z., Feng, B. T., Narasimhan, K., & Russakovsky, O. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58571-6_37 · Cited by 42
Wasserstein Coupled Graph Learning for Cross-Modal Retrieval
Wang, Y., Zhang, T., Zhang, X., Cui, Z., Huang, Y., Shen, P., Li, S., & Yang, J. J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00183 · Cited by 42
Learning 3D Semantic Scene Graphs with Instance Embeddings
Wald, J., Navab, N., & Tombari, F. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-021-01546-9 · Cited by 42
Lee, K.-H., Palangi, H., Chen, X., Hu, H., & Gao, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09953 · Cited by 42
Online Cross-Modal Scene Retrieval by Binary Representation and Semantic Graph
Qi, M., Wang, Y., & Li, A. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123311 · Cited by 41
Divergent-convergent attention for image captioning
Ji, J., Du, Z., & Zhang, X. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107928 · Cited by 41
Quaternion Relation Embedding for Scene Graph Generation
Wang, Z., Xu, X., Wang, G., Yang, Y., & Shen, H. T. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3239229 · Cited by 41
Image Scene Graph Generation (SGG) BenchmarkPreprint
Han, X., Yang, J., Hu, H., Zhang, L., Gao, J., & Zhang, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.12604 · Cited by 41
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning
Johnson, J., Hariharan, B., van der Maaten, L., Fei-Fei, L., Zitnick, C. L., & Girshick, R. (2016) · arXiv · doi:10.48550/arxiv.1612.06890 · Cited by 40
Self-citation3D Spatial Multimodal Knowledge Accumulation for Scene Graph Prediction in Point Cloud
Feng, M., Hou, H., Zhang, L., Wu, Z., Guo, Y., & Mian, A. S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00886 · Cited by 40
Linking the Characters: Video-oriented Social Graph Generation via Hierarchical-cumulative GCN
Wu, S., Chen, J., Xu, T., Chen, L., Wu, L., Hu, Y. G., & Chen, E. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475684 · Cited by 40
Visual Entity Linking via Multi-modal Learning
Zheng, Q., Wen, H., Wang, M., & Qi, G. (2021) · Data Intelligence · doi:10.1162/dint_a_00114 · Cited by 40
Singh, H., Zhang, P., Wang, Q., Wang, M., Xiong, W., Du, J., & Chen, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.56 · Cited by 40
Sentence Meaning Representations Across Languages: What Can We Learn from Existing Frameworks?
Žabokrtský, Z., Zeman, D., & Ševčíková, M. (2020) · Computational Linguistics · doi:10.1162/coli_a_00385 · Cited by 39
Visual-Semantic Graph Matching for Visual Grounding
Jing, C., Wu, Y., Pei, M., Hu, Y. G., Jia, Y., & Wu, Q. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413902 · Cited by 39
HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generation
Zhou, Z., Shi, M., & Caesar, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01978 · Cited by 39
Scene Graph Inference via Multi-Scale Context Modeling
Xu, N., Liu, A.-A., Wong, Y., Nie, W., Su, Y., & Kankanhalli, M. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2990989 · Cited by 39
The Limited Multi-Label Projection LayerPreprint
Amos, B., Koltun, V., & Kolter, J. Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08707 · Cited by 39
Dynamic Graph Representation Learning for Video Dialog via Multi-Modal Shuffled Transformers
Geng, S., Gao, P., Chatterjee, M., Hori, C., Le Roux, J., Zhang, Y., Li, H., & Cherian, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16231 · Cited by 38
Puig, X., Shu, T., Tenenbaum, J. B., & Torralba, A. B. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161352 · Cited by 38
Biased-Predicate Annotation Identification via Unbiased Visual Predicate Representation
Li, L., Wang, C., Qin, Y., Ji, W., & Liang, R. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611847 · Cited by 38
Self-citationAttribute Prototype-Guided Iterative Scene Graph for Explainable Radiology Report Generation
Zhang, K., Yang, Y. Q., Yu, J., Fan, J., Jiang, H., Huang, Q., & Han, W. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3424505 · Cited by 38
Attention-Translation-Relation Network for Scalable Scene Graph Generation
Gkanatsios, N., Pitsikalis, V., Koutras, P., & Maragos, P. A. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00218 · Cited by 38
A unified deep sparse graph attention network for scene graph generation
Zhou, H., Yang, Y., Luo, T., Zhang, J., & Li, S. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108367 · Cited by 38
Hierarchical Context-Based Emotion Recognition With Scene Graphs
Wu, S., Zhou, L., Hu, Z., & Liu, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3196831 · Cited by 38
The Promise of Premise: Harnessing Question Premises in Visual Question Answering
Mahendru, A., Prabhu, V., Mohapatra, A., Batra, D., & Lee, S. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1097 · Cited by 38
A Thorough Review on Recent Deep Learning Methodologies for Image CaptioningPreprint
Elhagry, A., & Kadaoui, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.13114 · Cited by 38
Zhang, Y., Trinh, L., Cao, D., Cui, Z., & Liu, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.07633 · Cited by 38
Liu, Y., He, Z., & Han, K. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00924 · Cited by 37
Multimodal deep fusion for image question answering
Zhang, W., Yu, J., Wang, Y., & Wang, W. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106639 · Cited by 37
Generative Compositional Augmentations for Scene Graph Prediction
Knyazev, B. A., de Vries, H., Cangea, C., Taylor, G. W., Courville, A. C., & Belilovsky, E. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01553 · Cited by 37
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval
Nguyen, M.-D., Nguyen, B. T., & Gurrin, C. G. (2021) · Frontiers in artificial intelligence and applications · doi:10.3233/faia210049 · Cited by 37
Unconditional Scene Graph Generation
Garg, S., Dhamo, H., Farshad, A., Musatian, S., Navab, N., & Tombari, F. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01605 · Cited by 37
Deformable Graph Convolutional Networks
Park, J., Yoo, S., Park, J., & Kim, H. J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20765 · Cited by 37
REX: Reasoning-aware and Grounded Explanation
Chen, S., & Zhao, Q. G. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01514 · Cited by 37
Representation Learning for Scene Graph Completion via Jointly Structural and Visual Embedding
Wan, H., Luo, Y., Peng, B., & Zheng, W. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/132 · Cited by 37
Relation Transformer NetworkPreprint
Koner, R., Shit, S., & Tresp, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.06193 · Cited by 37
Wong, L., Grand, G., Lew, A. K., Goodman, N. D., Mansinghka, V. K., Andreas, J., & Tenenbaum, J. B. (2023) · arXiv · doi:10.48550/arxiv.2306.12672 · Cited by 36
Are Scene Graphs Good Enough to Improve Image Captioning?
Milewski, V., Moens, M., & Calixto, I. (2020) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2020.aacl-main.50 · Cited by 36
Li, X., Chen, L., Ma, W., Yang, Y., & Xiao, J. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548164 · Cited by 36
Describing Common Human Visual Actions in ImagesPreprint
Ronchi, M. R., & Perona, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02203 · Cited by 36
Lang3DSG: Language-based contrastive pre-training for 3D Scene Graph prediction
Koch, S., Hermosilla, P., Vaškevičius, N., Colosi, M., & Ropinski, T. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00076 · Cited by 35
Watch, Think and Attend: End-to-End Video Classification via Dynamic Knowledge Evolution Modeling
Gao, J., Zhang, T., & Xu, C. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240566 · Cited by 35
Deep Image Captioning: An Overview
Hrga, I., & Ivašić-Kos, M. (2019) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro.2019.8756821 · Cited by 35
Predicate Correlation Learning for Scene Graph Generation
Tao, L., Li, M., Li, N., Cheng, X., Hu, Y., & Chen, Z. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3181511 · Cited by 35
Automatic Creativity Measurement in Scratch Programs Across Modalities
Kovalkov, A., Paaßen, B., Segal, A., Pinkwart, N., & Gal, K. (2021) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3144442 · Cited by 35
Learning Graph-Structured Sum-Product Networks for Probabilistic Semantic Maps
Zheng, K., Pronobis, A., & Rao, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11743 · Cited by 35
Attention-Based Context Aware Reasoning for Situation Recognition
Cooray, T., Cheung, N. M., & Lu, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00479 · Cited by 35
Compositional Video Synthesis with Action GraphsPreprint
Bar, A., Herzig, R., Wang, X., Rohrbach, A., Chechik, G., Darrell, T., & Globerson, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15327 · Cited by 35
Kil, J., Zhang, C., Xuan, D., & Chao, W. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.512 · Cited by 35
Visual Relationship Detection: A Survey
Cheng, J., Wang, L., Wu, J., Hu, X., Jeon, G., Tao, D., & Zhou, M. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3142013 · Cited by 34
Boosting Scene Graph Generation with Visual Relation Saliency
Zhang, Y., Pan, Y., Yao, T., Huang, R., Mei, T., & Chen, C. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3514041 · Cited by 34
Meta Spatio-Temporal Debiasing for Video Scene Graph Generation
Li, X., Qu, H., Kuen, J., Gu, J., & Liu, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19812-0_22 · Cited by 34
A Survey on Knowledge Graph-Based Methods for Automated Driving
Luettin, J., Monka, S., Henson, C. A., & Halilaj, L. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-21422-6_2 · Cited by 34
Using Scene Graph Context to Improve Image GenerationPreprint
Tripathi, S., Bhiwandiwalla, A., Bastidas, A., & Tang, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03762 · Cited by 34
Answering Visual-Relational Queries in Web-Extracted Knowledge GraphsPreprint
Oñoro-Rubio, D., Niepert, M., García-Durán, A., González, R., & López-Sastre, R. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02314 · Cited by 34
End-to-End Video Scene Graph Generation With Temporal Propagation Transformer
Zhang, Y., Pan, Y., Yao, T., Huang, R., Mei, T., & Chen, C. W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3283879 · Cited by 33
Disentangled Pre-Training for Human-Object Interaction Detection
Li, Z., Li, X., Ding, C., & Xu, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02663 · Cited by 33
PANet: A Context Based Predicate Association Network for Scene Graph Generation
Chen, Y., Wang, Y., Zhang, Y., & Guo, Y. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00094 · Cited by 33
Explore Contextual Information for 3D Scene Graph Generation
Liu, Y., Long, C., Zhang, Z., Liu, B., Zhang, Q., Yin, B., & Yang, X. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3219451 · Cited by 33
Automatic Generation of 3D Scene Animation Based on Dynamic Knowledge Graphs and Contextual Encoding
Song, W., Zhang, X., Guo, Y., Li, S., Hao, A., & Qin, H. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01839-1 · Cited by 33
Manga109Dialog: A Large-Scale Dialogue Dataset for Comics Speaker Detection
Li, Y., Aizawa, K., & Matsui, Y. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687709 · Cited by 33
Postevent Reconnaissance Image Documentation Using Automated Classification
Yeum, C. M., Dyke, S. J., Beneš, B., Hacker, T. J., Ramirez, J., Lund, A., & Pujol, S. (2018) · Journal of Performance of Constructed Facilities · doi:10.1061/(asce)cf.1943-5509.0001253 · Cited by 33
MMRel: Benchmarking Relation Understanding in Multi-Modal Large Language ModelsPreprint
Nie, J., Zhang, G., An, W., Xing, Y., Tan, Y., Kot, A. C., & Lu, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.09121 · Cited by 33
Describing Common Human Visual Actions in Images
Ronchi, M. R., & Perona, P. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.52 · Cited by 32
Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?
Li, O., Wang, Y., Hu, X., Huang, H., Chen, R., Ou, J., Tao, X., Wan, P., Qi, X., & Feng, F. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2509.03516 · Cited by 33
Modeling Dynamic Environments with Scene Graph Memory
Kurenkov, A., Lingelbach, M., Agarwal, T., Li, C., Jin, E., Zhang, R., Fei-Fei, L., Wu, J., Savarese, S., & Martín-Martín, R. (2023) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/oycd5403 · Cited by 32
Self-citationRaboh, M., Herzig, R., Berant, J., Chechik, G., & Globerson, A. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093297 · Cited by 32
Reasoning in Computer Vision: Taxonomy, Models, Tasks, and MethodologiesPreprint
Sarkar, A., Yu, Z., & Idris, M. Y. I. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.10523 · Cited by 32
Advancements in Radiology Report Generation: A Comprehensive Analysis
Mamdouh, D., Attia, M., Mohamed, O., Mohamed, N., Lotfy, A., Arafa, T., Rashed, E. A., & Khoriba, G. A. (2025) · Bioengineering · doi:10.3390/bioengineering12070693 · Cited by 31
More Knowledge, Less Bias: Unbiasing Scene Graph Generation with Explicit Ontological Adjustment
Chen, Z., Rezayi, S., & Li, S. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00401 · Cited by 31
FreestyleRet: Retrieving Images from Style-Diversified Queries
Li, H., Jia, Y., Jin, P., Cheng, Z., Li, K., Sui, J., Liu, C., & Yuan, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73337-6_15 · Cited by 31
Visual relationship detection with object spatial distribution
Zhu, Y., Jiang, S., & Li, X. (2017) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019448 · Cited by 31
3D-Aware Scene Change Captioning From Multiview Images
Qiu, Y., Satoh, Y., Suzuki, R., Iwata, K., & Kataoka, H. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3003290 · Cited by 31
Prior Visual Relationship Reasoning For Visual Question Answering
Yang, Z., Qin, Z., Yu, J., & Wan, T. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190771 · Cited by 30
Hierarchical Scene Graph Encoder-Decoder for Image Paragraph Captioning
Yang, X., Gao, C., Zhang, H., & Cai, J. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413859 · Cited by 30
Holistic OR domain modeling: a semantic scene graph approach
Özsoy, E., Czempiel, T., Örnek, E. P., Eck, U., Tombari, F., & Navab, N. (2023) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-023-03022-w · Cited by 30
Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioning
Xie, Y., Zhou, L., Dai, X., Yuan, L., Bach, N., Liu, C., & Zeng, M. (2022) · neural information processing systems · doi:10.52202/068431-1257 · Cited by 30
From Volcano to Toyshop: Adaptive Discriminative Region Discovery for Scene Recognition
Zhao, Z., & Larson, M. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240698 · Cited by 30
Visual Relationship Detection With Visual-Linguistic Knowledge From Multimodal Representations
Chiou, M.-J., Zimmermann, R., & Feng, J. (2021) · IEEE Access · doi:10.1109/access.2021.3069041 · Cited by 29
Debiased Scene Graph Generation for Dual Imbalance Learning
Zhou, H., Zhang, J., Luo, T., Yang, Y., & Lei, J. W. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3198965 · Cited by 29
Cross-Modality Time-Variant Relation Learning for Generating Dynamic Scene Graphs
Wang, J., Huang, J., Zhang, C., & Deng, Z. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161478 · Cited by 29
Dynamic Graph Generation Network: Generating Relational Knowledge from Diagrams
Kim, D., Yoo, Y., Kim, J., Lee, S., & Kwak, N. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00438 · Cited by 29
Enhancing Scene Graph Generation with Hierarchical Relationships and Commonsense Knowledge
Jiang, B., Zhuang, Z., Shivakumar, S. S., & Taylor, C. J. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00861 · Cited by 28
What and where: A context-based recommendation system for object insertion
Zhang, S.-H., Zhou, Z.-P., Liu, B., Dong, X., & Hall, P. M. (2020) · Computational Visual Media · doi:10.1007/s41095-020-0158-8 · Cited by 28
One-shot Scene Graph Generation
Guo, Y., Song, J., Gao, L., & Shen, H. T. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3414025 · Cited by 28
Metadata
- Authors
- Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L.
- Affiliations
- Stanford University (US)
- Max Planck Institute for Informatics (DE)
- Yahoo (United States) (US)
- ORCID
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 3668-3678
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2077069816
- Cited by
- 1,101
- References
- 68
- Citations by year
- 2026: 59 · 2025: 84 · 2024: 133 · 2023: 134 · 2022: 130 · 2021: 139 · 2020: 145 · 2019: 117 · 2018: 66 · 2017: 47 · 2016: 33 · 2015: 13
- FWCI
- 21.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- semantic image retrieval, scene graph, conditional random fields, object relations, image ranking, object localization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.