Image retrieval using scene graphs
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph. Our scene graphs represent objects (“man”, “boat”), attributes of objects (“boat is white”) and relationships between objects (“man standing on boat”). We use these scene graphs as queries to retrieve semantically related images. To this end, we design a conditional random field model that reasons about possible groundings of scene graphs to test images. The likelihoods of these groundings are used as ranking scores for retrieval. We introduce a novel dataset of 5,000 human-generated scene graphs grounded to images and use this dataset to evaluate our method for image retrieval. In particular, we evaluate retrieval using full scene graphs and small scene subgraphs, and show that our method outperforms retrieval methods that use only objects or low-level image features. In addition, we show that our full model can be used to improve object localization compared to baseline methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Datasets have been a driving force of computer vision algorithms, ranging from classi-fication [64] to object recognition and segmentation [18, 12, 55, 15].”
MethodAre we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 1×
“Their sys-tem is constrained to the six object classes from KITTI [23] while our system uses an open-world vocabulary; our scene graphs also tend to be more complex than their semantic graphs.”
MethodConditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Research works printed but not linked: 5
- jurafsky, 2000, Speech & language processing
- lampert, 2013, Attribute-based classification for zero-shot learning of object categories, PAMI
- yao, 2011, Classifying actions and measuring action similarity by modeling the mutual context of objects and human poses, a) A 1(D2) D3
- 0, OpenSceneGraph
- 10.1145/1964921.1964929 · DOI · Paper page
Cited by
Items 901–1,000 of 1,001
OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
Liu, S., Lin, K., Wang, L., Yuan, J., & Liu, Z. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20070 · Cited by 4
UUCT - HyMP: Towards Tracking Dispersed Crowd Groups from UAVs
Deb, T., Rahmun, M., Bijoy, S. A., Raha, M. H., & Khan, M. A. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533600 · Cited by 4
Heterogeneous Learning for Scene Graph Generation
He, Y., Ren, T., Tang, J., & Wu, G. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548356 · Cited by 4
Improving Predicate Representation in Scene Graph Generation by Self-Supervised Learning
Hasegawa, S., Hiromoto, M., Nakagawa, A., & Umeda, Y. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00276 · Cited by 4
Grounding Scene Graphs on Natural Images via Visio-Lingual Message Passing
Tripathi, A., Mishra, A., & Chakraborty, A. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00437 · Cited by 4
GEMS: Scene Expansion using Generative Models of Graphs
Agarwal, R., Chandra, T. S., Patil, V., Mahapatra, A., Kulkarni, K., & Vinay, V. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00024 · Cited by 4
Image captioning: from structural tetrad to translated sentences
Guo, R., Ma, S., & Han, Y. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-7118-7 · Cited by 4
Lifted Semantic Graph Embedding for Omnidirectional Place Recognition
Zhang, C., Budvytis, I., Liwicki, S., & Cipolla, R. (2021) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv53792.2021.00147 · Cited by 4
Ego-Downward and Ambient Video based Person Location AssociationPreprint
Yang, L., Jiang, H., Xiao, J., & Huo, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00477 · Cited by 4
Assisting Scene Graph Generation with Self-SupervisionPreprint
Inuganti, S., & Balasubramanian, V. N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.03555 · Cited by 4
Fantastic Data and How to Query ThemPreprint
Tran, T.-K., Le-Tuan, A., Nguyen-Duc, M., Yuan, J., & Le-Phuoc, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.05026 · Cited by 4
Hierarchical Relationships: A New Perspective to Enhance Scene Graph GenerationPreprint
Jiang, B., & Taylor, C. J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.06842 · Cited by 4
Imagine, Verify, Execute: Memory-guided Agentic Exploration with Vision-Language ModelsPreprint
Lee, S. J., Ekpo, D., Liu, H., Huang, F., Shrivastava, A., & Huang, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.07815 · Cited by 4
FDSG: Forecasting Dynamic Scene GraphsPreprint
Yang, Y., Cong, Y., Cheng, H., Rosenhahn, B., & Yang, M. Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.01487 · Cited by 4
Semantic Diversity-aware Prototype-based Learning for Unbiased Scene Graph GenerationPreprint
Jeon, J., Kim, K., Yoon, K., & Park, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.15396 · Cited by 4
Effective Scene Graph Generation by Statistical Relation Distillation
Nguyen, T.-S., Yang, H. W., & Fernando, B. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00816 · Cited by 3
Generic Scene Graph Generation Model with Hierarchical Prompt Learning
Zhu, X., Xing, Y., Wang, R., Wang, Y., & Lan, X. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02499-z · Cited by 3
Cross-modality-enhanced visual Scene Graph Generation
Yu, F., Ji, H., & Li, Y. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103430 · Cited by 3
Frequency-adaptive prototype learning for long-tail scene graph generation
Xie, F., Wu, Y., & Liu, F. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00546-4 · Cited by 3
Co-VisiON: Co-Visibility ReasONing on Sparse Image Sets of Indoor Scenes
Chen, C., Dang, N., Zhang, J., Sun, W., Zheng, P., He, X., Ye, Y., Zhang, J., Srinivas, T., & Feng, C. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00504 · Cited by 3
CinemaTraj: Composing Atomic Camera Trajectories for 3D Scenes with LLM Agents
Li, Q., Chen, X., Türköz, E., Liu, L., Wang, X., Meng, L., (16763), T. W., & Zhang, Y. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835366 · Cited by 3
Hierarchical Scene-Graph Consistency Learning for Remote Sensing Image-Text Retrieval
Chen, S., Ma, W., Zhou, T., Liu, Y., Tu, W., Zhang, X., Zhao, S., Gu, L., & Liu, X. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3724759 · Cited by 3
Medical Scene Graphs and Reasoning
Cao, C., He, Y., Chen, Y., Song, C., Ling, H., Guan, R., & Feng, X. (2021) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm52615.2021.9669882 · Cited by 3
Exploiting Edge Features in Graphs with Fused Network Gromov-Wasserstein Distance
Yang, J., Labeau, M., & d’Alché–Buc, F. (2023) · Transactions on machine learning research · doi:10.48550/arxiv.2309.16604 · Cited by 3
Shen, Q., Lin, H., Liu, H., Lin, Z., & Wang, W. (2024) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd61410.2024.10580454 · Cited by 3
Structural Relation Modeling of 3D Point Clouds
Zheng, Y., Lu, J., Duan, Y., & Zhou, J. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3451940 · Cited by 3
Rethinking Image Generation From Scene Graphs With Attention Mechanism
Chikwendu, I. A., Zhang, X., Ukwuoma, C. C., Adjei-Mensah, I., Abdou, A. A., & Onyedikachi, C. C. (2024) · International Conference on Computer Communication and Information Systems (CCCIS) · doi:10.1109/cccis63483.2024.00021 · Cited by 3
UniQ: Unified Decoder with Task-specific Queries for Efficient Scene Graph Generation
Liao, X., Wei, W., Chen, D., & Fu, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681542 · Cited by 3
Towards Formalisation of 3D User Interaction: Making Spatial Interaction Verifiable
Turner, J., & Weyers, B. (2025) · ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS) · doi:10.1145/3731406.3734976 · Cited by 3
Enhancing heterogeneous similarity estimation via neighborhood reversibility
Wei, S., Zhao, Y., Yang, T., Zhou, Z., & Ge, S. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4347-0 · Cited by 3
Deep Salient Object Detection via Hierarchical Network Learning
Zhu, D., Luo, Y., Dai, L., Shao, X., Itti, L., & Lu, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70090-8_33 · Cited by 3
A Multimodal Fusion Scene Graph Generation Method Based on Semantic Description
Ma, L., Liu, W., & Wang, Y. (2022) · IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS) · doi:10.1109/ccis57298.2022.10016416 · Cited by 3
DeformSg2im: Scene graph based multi-instance image generation with a deformable geometric layout
Wang, Z., Li, Y., Huang, D., Wang, J., Ge, N., & Lü, J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126684 · Cited by 3
Iterative Learning with Extra and Inner Knowledge for Long-tail Dynamic Scene Graph Generation
Li, Y., Yang, X., & Xu, C. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612430 · Cited by 3
Cross-modal Prominent Fragments Enhancement Aligning Network for Image-text Retrieval
Zhang, Y., Zhou, Y., Yang, Z., & Chen, A. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687706 · Cited by 3
Enhanced Motion Forecasting with Visual Relation Reasoning
Kim, S., Baek, H., Lee, S., Chi, H., Lim, H., Kim, J., & Kim, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72992-8_18 · Cited by 3
VLSG-net: Vision-Language Scene Graphs network for Paragraph Video Captioning
Hou, Y., Zhou, Q., Lv, H., Guo, L., Li, Y., Duo, L., & He, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129976 · Cited by 3
Bouchakwa, M., Ayadi, Y., & Amous, I. (2016) · International Conference on Advances in Mobile Computing and Multimedia (MoMM) · doi:10.1145/3007120.3007160 · Cited by 3
Pre-gen Metrics: Predicting Caption Quality Metrics Without Generating Captions
Tanti, M., Gatt, A., & Muscat, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11018-5_10 · Cited by 3
Learning to Relate from Captions and Bounding Boxes
Garg, S., Moniz, J. R. A., Aviral, A., & Bollimpalli, P. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1660 · Cited by 3
On Class Imbalance and Background Filtering in Visual Relationship Detection
Sarullo, A., & Mu, T. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851814 · Cited by 3
DynGraph: Visual Question Answering via Dynamic Scene Graphs
Haurilet, M., Al-Halah, Z., & Stiefelhagen, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33676-9_30 · Cited by 3
Graph-Based Image Retrieval: State of the Art
Belahyane, I., Mammass, M., Abioui, H., & Idarrou, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-51935-3_32 · Cited by 3
Visual Experience-Based Question Answering with Complex Multimodal Environments
Kim, I. (2020) · Mathematical Problems in Engineering · doi:10.1155/2020/8567271 · Cited by 3
A Novel Approach to Scene Graph Vectorization
Kumar, V., Aggarwal, D., Bathwal, V., & Singh, S. K. (2021) · International Conference on Computing, Communication, and Intelligent Systems (ICCCIS) · doi:10.1109/icccis51004.2021.9397230 · Cited by 3
FashionGraph: Understanding fashion data using scene graph generation
Sadegharmaki, S., Kastner, M. A., & Satoh, S. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412662 · Cited by 3
Relating Blindsight and AI: A Review
Bensemann, J., Bao, Q., Gendron, G., Hartill, T., & Witbrock, M. (2021) · Journal of Artificial Intelligence and Consciousness · doi:10.1142/s2705078521500156 · Cited by 3
Understanding social relationships with person-pair relations
Zhao, H., Chen, H., Li, L., & Wan, H. (2022) · Big Data Mining and Analytics · doi:10.26599/bdma.2021.9020022 · Cited by 3
Self-citationSelf-Supervised Road Layout Parsing with Graph Auto-Encoding
Lu, C., & Dubbelman, G. (2022) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv51971.2022.9827287 · Cited by 3
Multi-View Visual Relationship Detection with Estimated Depth Map
Liu, X., Gan, M.-G., & He, Y. (2022) · Applied Sciences · doi:10.3390/app12094674 · Cited by 3
EdgeNet for efficient scene graph classification
Vivek, B. S., Gubbi, J., Rajan, M., Balamuralidhar, P., & Pal, A. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892703 · Cited by 3
Generating comprehensive scene graphs with integrated multiple attribute detection
Patil, C., & Abhyankar, A. (2022) · Machine Vision and Applications · doi:10.1007/s00138-022-01361-3 · Cited by 3
Image Generation from a Hyper Scene Graph with Trinomial Hyperedges
Miyake, R., Matsukawa, T., & Suzuki, E. (2023) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0011699300003417 · Cited by 3
Scene representation using a new two-branch neural network model
Parseh, M. J., Rahmanimanesh, M., Keshavarzi, P., & Azimifar, Z. (2023) · The Visual Computer · doi:10.1007/s00371-023-03162-9 · Cited by 3
RealGraph: A Multiview Dataset for 4D Real-world Context Graph Generation
Lin, H., Chen, Z., Zhang, J., Bai, B., Wang, Y., Huang, R., & Fang, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00348 · Cited by 3
Unbiased Scene Graph Generation Using Predicate Similarities
Matsui, Y., & Ohashi, M. (2024) · IEEE Access · doi:10.1109/access.2024.3424230 · Cited by 3
The review of visual knowledge: a new pivot for cross-media intelligence evolution
Yang, Y., Zhuang, Y., & Yunhe, P. (2022) · Journal of Image and Graphics · doi:10.11834/jig.211264 · Cited by 3
ArtVLM: Attribute Recognition Through Vision-Based Prefix Language Modeling
Zhu, W. Y., Ye, K., Ke, J., Yu, J., Guibas, L. J., Milanfar, P., & Yang, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73383-3_8 · Cited by 3
Scene Graph Generation Based on Node-Relation Context Module
Lin, X., Li, Y., Liu, C., Ji, Y., & Yang, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-04179-3_12 · Cited by 3
A Denoising Framework for Image Caption
Zhang, Y., Ding, Y., Wu, R., & Xue, F. (2019) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/dasc/picom/cbdcom/cyberscitech.2019.00151 · Cited by 3
Iterative Visual Relationship Detection via Commonsense Knowledge Graph
Wan, H., Ou, J., Wang, B., Du, J., Pan, J. Z., & Zeng, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-41407-8_14 · Cited by 3
Interpretable Neural Computation for Real-World Compositional Visual Question Answering
Tang, R., & Ma, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60636-7_8 · Cited by 3
Boosting Relationship Detection in Images with Multi-Granular Self-Supervised Learning
Ding, X., Pan, Y., Li, Y., Yao, T., Zeng, D., & Mei, T. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3556978 · Cited by 3
Deep learning for image captioning: an encoder-decoder architecture with soft attention
Gómez, M. (2019) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 3
Learning Predicates as Functions to Enable Few-shot Scene Graph PredictionPreprint
Dornadula, A., Narcomey, A., Krishna, R., Bernstein, M. S., & Fei-Fei, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04876 · Cited by 3
Self-citationLearning Compact Reward for Image CaptioningPreprint
Li, N., & Chen, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.10925 · Cited by 3
ORD: Object Relationship Discovery for Visual Dialogue GenerationPreprint
Wang, Z., Huang, Z. H., Luo, Y., & Lu, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08322 · Cited by 3
Image-Graph-Image Translation via Auto-EncodingPreprint
Lu, C., & Dubbelman, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.05975 · Cited by 3
Deep learning techniques for image captioning
Hossain, M. Z. (2020) · Murdoch University Research Portal · Cited by 3
Generative Compositional Augmentations for Scene Graph PredictionPreprint
Knyazev, B. A., de Vries, H., Cangea, C., Taylor, G. W., Courville, A. C., & Belilovsky, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05756 · Cited by 3
Towards Unseen Triples: Effective Text-Image-joint Learning for Scene Graph GenerationPreprint
Di, Q., Ma, W., Qi, Z., Hou, T., Shan, Y., & Wang, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.13420 · Cited by 3
A New Fine-grained Alignment Method for Image-text MatchingPreprint
Zhang, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.02183 · Cited by 3
Towards Zero-shot Human-Object Interaction Detection via Vision-Language IntegrationPreprint
Xue, W., Liu, Q., Xiong, Q., Wang, Y., Wei, Z., Xing, X., & Xu, X. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.07246 · Cited by 3
ComAlign: Compositional Alignment in Vision-Language ModelsPreprint
Abdollah, A., Izadi, A., Saghafian, A., Vahidimajd, R., Mozafari, M., Mirzaei, A., Samiei, M. M., & Baghshah, M. S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.08206 · Cited by 3
Temporally Consistent Dynamic Scene Graphs: An End-to-End Approach for Action Tracklet GenerationPreprint
Ruschel, R., Rahman, M. A., Prajapati, H., You, S. O., & Manjuanth, B. S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.02808 · Cited by 3
SceneLLM: Implicit Language Reasoning in LLM for Dynamic Scene Graph GenerationPreprint
Zhang, H., Li, Z., & Liu, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.11026 · Cited by 3
Generative Visual Commonsense Answering and Explaining with Generative Scene Graph ConstructingPreprint
Fan, Y. C., Fang, X., Quan, R., Li, J., Bi, W., Xu, X., & Li, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.09041 · Cited by 3
Assured Autonomy with Neuro-Symbolic PerceptionPreprint
Hallyburton, R. S., & Pajić, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.21322 · Cited by 3
FORESCENE: FOREcasting human activity via latent SCENE graphs diffusionPreprint
Alliegro, A., Pistilli, F., Tommasi, T., & Averta, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.06182 · Cited by 3
Conformal Prediction and MLLM aided Uncertainty Quantification in Scene Graph GenerationPreprint
Nag, S., Ghosh, U., Ta, C.-K., Bose, S., Li, J., & Chowdhury, A. K. R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.13947 · Cited by 3
On the Convergence of Structure and Geometry in Graph Neural Networks
Gasteiger, J., Günnemann, S., & München, T. U. (2022) · mediaTUM (Technical University of Munich) · Cited by 3
From Perception to Action: Spatial AI Agents and World ModelsPreprint
Felicia, G., Bryant, N., Putra, H., Gazali, A., Lobo, E., & Rojas, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.01644 · Cited by 3
Method for Generating Indoor 3D Scene Graphs Based on Instance Features and Relationship Encoding
Du, H., Cai, B., Li, X., Wang, W., & Tang, S. (2024) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlviii-1-2024-135-2024 · Cited by 2
Visual Relationship Transformation
Xu, X., Qiu, J., Yu, B., & Wang, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73650-6_15 · Cited by 2
Nguyen, T.-T., & Tran, M. (2025) · doi:10.1145/3709020.3734830 · Cited by 2
Hierarchical Scene Graph Generation and Vectorization of Aerial Images
Knyaz, V. A., Kniaz, V. V., Zheltov, S. Y., Emelyanov, A. V., & Smirnov, E. R. (2025) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlviii-2-w9-2025-161-2025 · Cited by 2
MSGFusion: Multimodal Scene Graph-Guided Infrared and Visible Image Fusion
Li, G., Dong, B., Dong, K., Li, J., & Zheng, H. (2026) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2026.3695365 · Cited by 2
Recognition of Bee Organizational Behavior with Scene Graphs Generation
Martínez, A. V., Rodríguez, G. G., & Cabral, J. C. E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09044-7_16 · Cited by 2
Refer and Grasp: Vision-Language Guided Continuous Dexterous Grasping
Huang, Y., Fan, D., Wen, Q., Li, D., Yang, Y., Luo, Y., Sun, J., Liu, Q. B., & Wang, P. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247415 · Cited by 2
Holm, F., Ghazaei, G., & Navab, N. (2026) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-026-03697-x · Cited by 2
Personalized privacy in OSNs: Evaluating deep learning models for context-aware image editing
Mehri, G. H., Kostov, G., Breve, B., Jalba, A. C., & Zannone, N. (2025) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2025.200581 · Cited by 2
ExPrIS: Knowledge-Level Expectations as Priors for Object Interpretation from Sensor Data
Renz, M., Günther, M., Igelbrink, F., Lima, O., & Atzmueller, M. (2026) · Künstliche Intell. · doi:10.1007/s13218-026-00901-7 · Cited by 2
A Survey for Scene Graph Generation Based on Pre-Trained Model
Fang, Z., Huang, Z., Wei, J., & Hua, Y. (2025) · International Conference on Robotics, Automation and Artificial Intelligence (RAAI) · doi:10.1109/raai67517.2025.11423155 · Cited by 2
DATR: Depth-aware transformer for hierarchical and fine-grained scene graph generation
Meng, Q., (49484), X. Z., Yang, J., Fu, Y., Duan, X., Li, S., Lei, J. W., & Zhang, J. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116399 · Cited by 2
Question Answering Mediated by Visual Clues and Knowledge Graphs
de Faria, F. F., Usbeck, R., Sarullo, A., Mu, T., & Freitas, A. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3184558.3192318 · Cited by 2
Learning Latent Scene-Graph Representations for Referring Relationships.
Raboh, M., Herzig, R., Chechik, G., Berant, J., & Globerson, A. (2019) · Cited by 2
Subgraph and object context‐masked network for scene graph generation
Zheng, Z., Li, Z., An, G., & Feng, S. (2020) · IET Computer Vision · doi:10.1049/iet-cvi.2019.0896 · Cited by 2
Visual Analysis of Scene-Graph-Based Visual Question Answering
Schäfer, N., Künzel, S., Munz, T., Tilli, P., Vidyapu, S., Vu, N. T., & Weiskopf, D. (2023) · International Symposium on Visual Information Communication and Interaction (VINCI) · doi:10.1145/3615522.3615547 · Cited by 2
STDG: Semi-Teacher-Student Training Paradigm for Depth-guided One-stage Scene Graph Generation
Zhou, X., Song, Z., He, J., Liu, H., & Fan, Z. (2024) · International Conference on Multimedia Retrieval · doi:10.1145/3652583.3658024 · Cited by 2
Across Images and Graphs for Question Answering
Wen, Z., Qian, J., Qian, B., Qin, Y., Qin, J., Xuan, Q., & Yuan, Y. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00112 · Cited by 2
Metadata
- Authors
- Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L.
- Affiliations
- Stanford University (US)
- Max Planck Institute for Informatics (DE)
- Yahoo (United States) (US)
- ORCID
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 3668-3678
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2077069816
- Cited by
- 1,101
- References
- 68
- Citations by year
- 2026: 59 · 2025: 84 · 2024: 133 · 2023: 134 · 2022: 130 · 2021: 139 · 2020: 145 · 2019: 117 · 2018: 66 · 2017: 47 · 2016: 33 · 2015: 13
- FWCI
- 21.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- semantic image retrieval, scene graph, conditional random fields, object relations, image ranking, object localization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.