The DOI matches its Crossref record; 185 of the 185 references it cites were found in a registry or an index.
A Comprehensive Survey of Scene Graphs: Generation and Application
Open accessAbstract
Scene graph is a structured representation of a scene that can clearly express the objects, attributes, and relationships between objects in the scene. As computer vision technology continues to develop, people are no longer satisfied with simply detecting and recognizing objects in images; instead, people look forward to a higher level of understanding and reasoning about visual scenes. For example, given an image, we want to not only detect and recognize objects in the image, but also understand the relationship between objects (visual relationship detection), and generate a text description (image captioning) based on the image content. Alternatively, we might want the machine to tell us what the little girl in the image is doing (Visual Question Answering (VQA)), or even remove the dog from the image and find similar images (image editing and retrieval), etc. These tasks require a higher level of understanding and reasoning for image vision tasks. The scene graph is just such a powerful tool for scene understanding. Therefore, scene graphs have attracted the attention of a large number of researchers, and related research is often cross-modal, complex, and rapidly developing. However, no relatively systematic survey of scene graphs exists at present. To this end, this survey conducts a comprehensive investigation of the current scene graph research. More specifically, we first summarize the general definition of the scene graph, then conducte a comprehensive and systematic discussion on the generation method of the scene graph (SGG) and the SGG with the aid of prior knowledge. We then investigate the main applications of scene graphs and summarize the most commonly used datasets. Finally, we provide some insights into the future development of scene graphs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
(2016) · Cited by 31,590
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Inductive Representation Learning on Large Graphs
Hamilton, W. L., Ying, R., & Leskovec, J. (2017) · arXiv · doi:10.48550/arxiv.1706.02216 · Cited by 10,639
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
(2013) · Cited by 5,726
Targeted Branching for the Maximum Independent Set Problem Using Graph Neural Networks
Silva, G., Rodrigues, M., Teixeira, A., & Amorim, M. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.sea.2024.20 · Cited by 5,183
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107
Advances In Deep Learning On Graphs (Gsp'18 Workshop)
Defferrard, M. (2016) · Figshare · doi:10.5281/zenodo.1286817 · Cited by 4,613
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y., Liu, Z., Sun, M., Liu, Y., & Zhu, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9491 · Cited by 3,749
Neural Message Passing for Quantum Chemistry
Gilmer, J., Schoenholz, S. S., Riley, P. F., Vinyals, O., & Dahl, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01212 · Cited by 3,440
Holistically-Nested Edge Detection
Xie, S., & Tu, Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.164 · Cited by 3,096
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Recurrent Models of Visual Attention
Mnih, V., Heess, N., Graves, A., & Kavukcuoglu, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6247 · Cited by 2,568
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386 · cited 2×
“Similar CRFs are widely utilized in computer vision tasks [37], [40] and have been demonstrated effective in capturing statistical correlations in visual relationships.”
MethodConceptNet 5.5: An Open Multilingual Graph of General Knowledge
Speer, R., Chin, J., & Havasi, C. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11164 · Cited by 2,312
A new model for learning in graph domains
Gori, M., Monfardini, G., & Scarselli, F. (2006) · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · doi:10.1109/ijcnn.2005.1555942 · Cited by 2,075
A Tutorial on Energy-Based Learning
LeCun, Y., Chopra, S., Hadsell, R. T., Ranzato, A., & Huang, F. J. (2006) · Cited by 1,931
Knowledge Graph Embedding via Dynamic Mapping Matrix
Ji, G., He, S., Xu, L., Liu, K., & Zhao, J. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1067 · Cited by 1,816
Invariant Scattering Convolution Networks
Bruna, J., & Mallat, S. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.230 · Cited by 1,633
A simple neural network module for relational reasoning
Santoro, A., Raposo, D., Barrett, D. G. T., Malinowski, M., Pascanu, R., Battaglia, P., & Lillicrap, T. (2017) · arXiv · doi:10.48550/arxiv.1706.01427 · Cited by 1,281 · cited 1×
“GCN has been proven to be highly effective in tasks such as relational reasoning [91], graph classification [92], [93], [94], [95], node”
MethodScene Graph Generation by Iterative Message Passing
Xu, D., Zhu, Y., Choy, C. B., & Fei-Fei, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.330 · Cited by 1,271 · cited 13×
“The main highlight of this approach is its novel primal-dual graph, which enables the bi-directional flow of node information and edge information, and updates the two GRUs [73] of node and edge in an iterative manner.”
BackgroundMethodInfluentialA Survey of Deep Active Learning
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Gupta, B. B., Chen, X., & Wang, X. (2022) · ACM Computing Surveys · doi:10.1145/3472291 · Cited by 1,169
Self-citationMcCallum, A., & Li, W. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119206 · Cited by 1,160
Image retrieval using scene graphs
Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298990 · Cited by 1,101
Visual Relationship Detection with Language Priors
Lu, C., Krishna, R., Bernstein, M., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_51 · Cited by 1,069
Neural Motifs: Scene Graph Parsing with Global Context
Zellers, R., Yatskar, M., Thomson, S., & Choi, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00611 · Cited by 1,052
Graph R-CNN for Scene Graph Generation
Yang, J., Lu, J., Lee, S., Batra, D., & Parikh, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_41 · Cited by 851
Image Generation from Scene Graphs
Johnson, J., Gupta, A., & Fei-Fei, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00133 · Cited by 836
Auto-Encoding Scene Graphs for Image Captioning
Yang, X., Tang, K., Zhang, H., & Cai, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01094 · Cited by 827
Videos as Space-Time Region Graphs
Wang, X., & Gupta, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_25 · Cited by 765
Unbiased Scene Graph Generation From Biased Training
Tang, K., Niu, Y., Huang, J., Shi, J., & Zhang, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00377 · Cited by 755
Zero-Shot Recognition via Semantic Embeddings and Knowledge Graphs
Wang, X., Ye, Y., & Gupta, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00717 · Cited by 648
Detecting and Recognizing Human-Object Interactions
Gkioxari, G., Girshick, R., Dollar, P., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00872 · Cited by 602
Visual Translation Embedding Network for Visual Relation Detection
Zhang, H., Kyaw, Z., Chang, S.-F., & Chua, T.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.331 · Cited by 586
Learning task-dependent distributed representations by backpropagation through structure
Goller, C., & Kuchler, A. (2002) · Proceedings of International Conference on Neural Networks (ICNN'96) · doi:10.1109/icnn.1996.548916 · Cited by 581
Learning Human-Object Interactions by Graph Parsing Neural Networks
Qi, S., Wang, W., Jia, B., Shen, J., & Zhu, S.-C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_25 · Cited by 572
T-CNN: Tubelets With Convolutional Neural Networks for Object Detection From Videos
Kang, K., Li, H., Yan, J., Zeng, X., Yang, B., Xiao, T., Zhang, C., Wang, Z., Wang, R., Wang, X., et al. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2736553 · Cited by 554
Harnessing Deep Neural Networks with Logic Rules
Hu, Z., Ma, X., Liu, Z., Hovy, E., & Xing, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1228 · Cited by 545
Learning to Compose Dynamic Tree Structures for Visual Contexts
Tang, K., Zhang, H., Wu, B., Luo, W., & Liu, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00678 · Cited by 543
Learning to Detect Human-Object Interactions
Chao, Y.-W., Liu, Y., Liu, X., Zeng, H., & Deng, J. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00048 · Cited by 520
Detecting Visual Relationships with Deep Relational Networks
Dai, B., Zhang, Y., & Lin, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.352 · Cited by 502
Scene Graph Generation from Objects, Phrases and Region Captions
Li, Y., Ouyang, W., Zhou, B., Wang, K., & Wang, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.142 · Cited by 500
A Hierarchical Neural Autoencoder for Paragraphs and Documents
Li, J., Luong, T., & Jurafsky, D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1107 · Cited by 490
Discriminative Embeddings of Latent Variable Models for Structured Data
Dai, H., Dai, B., & Song, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.05629 · Cited by 454
Knowledge-Embedded Routing Network for Scene Graph Generation
Chen, T., Yu, W., Chen, R., & Lin, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00632 · Cited by 432
Recognition using visual phrases
Sadeghi, M. A., & Farhadi, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995711 · Cited by 417
Object Detection from Video Tubelets with Convolutional Neural Networks
Kang, K., Ouyang, W., Li, H., & Wang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.95 · Cited by 386
Jetley, S., Lord, N. A., Lee, N., & Torr, P. H. S. (2018) · arXiv · doi:10.48550/arxiv.1804.02391 · Cited by 383 · cited 1×
“mechanism [56] and deep supervision [57], to propose a multimodal attention translation embedding method.”
BackgroundSemantic Object Parsing with Graph LSTM
Liang, X., Shen, X., Feng, J., Lin, L., & Yan, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_8 · Cited by 352
3D Scene Graph: A Structure for Unified Semantics, 3D Space, and Camera
Armeni, I., He, Z.-Y., Zamir, A., Gwak, J., Malik, J., Fischer, M., & Savarese, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00576 · Cited by 350
Conditional random fields for object recognition
Quattoni, A., Collins, M., & Darrell, T. (2004) · Cited by 342
Generating Semantically Precise Scene Graphs from Textual Descriptions for Improved Image Retrieval
Schuster, S., Krishna, R., Chang, A., Fei-Fei, L., & Manning, C. D. (2015) · Proceedings of the Fourth Workshop on Vision and Language · doi:10.18653/v1/w15-2812 · Cited by 332
Visual Relationship Detection with Internal and External Linguistic Knowledge Distillation
Yu, R., Li, A., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.121 · Cited by 310
Scene Graph Generation With External Knowledge and Image Reconstruction
Gu, J., Zhao, H., Lin, Z., Li, S., Cai, J., & Ling, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00207 · Cited by 308
Multi-label Zero-Shot Learning with Structured Knowledge Graphs
Lee, C.-W., Fang, W., Yeh, C.-K., & Wang, Y.-C. F. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00170 · Cited by 305
Action Genome: Actions As Compositions of Spatio-Temporal Scene Graphs
Ji, J., Krishna, R., Fei-Fei, L., & Niebles, J. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01025 · Cited by 303
HICO: A Benchmark for Recognizing Human-Object Interactions in Images
Chao, Y.-W., Wang, Z., He, Y., Wang, J., & Deng, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.122 · Cited by 290
GPS-Net: Graph Property Sensing Network for Scene Graph Generation
Lin, X., Ding, C., Zeng, J., & Tao, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00380 · Cited by 287
Factorizable Net: An Efficient Subgraph-Based Framework for Scene Graph Generation
Li, Y., Ouyang, W., Zhou, B., Shi, J., Zhang, C., & Wang, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_21 · Cited by 283
Kimera: From SLAM to spatial perception with 3D dynamic scene graphs
Rosinol, A., Violette, A., Abate, M., Hughes, N., Chang, Y., Shi, J., Gupta, A., & Carlone, L. (2021) · The International Journal of Robotics Research · doi:10.1177/02783649211056674 · Cited by 271
Say As You Wish: Fine-Grained Control of Image Caption Generation With Abstract Scene Graphs
Chen, S., Jin, Q., Wang, P., & Wu, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00998 · Cited by 262
The New Data and New Challenges in Multimedia Research.Preprint
Thomée, B., Shamma, D. A., Friedland, G. H., Elizalde, B., Ni, K. S., Poland, D., Borth, D., & Li, L.-J. (2015) · arXiv (Cornell University) · Cited by 247
Cross-modal Scene Graph Matching for Relationship-aware Image-Text Retrieval
Wang, S., Wang, R., Yao, Z., Shan, S., & Chen, X. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093614 · Cited by 244
Self-citationLearning 3D Semantic Scene Graphs From 3D Indoor Reconstructions
Wald, J., Dhamo, H., Navab, N., & Tombari, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00402 · Cited by 244
Deep Variation-Structured Reinforcement Learning for Visual Relationship and Attribute Detection
Liang, X., Lee, L., & Xing, E. P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.469 · Cited by 243
Iterative Visual Reasoning Beyond Convolutions
Chen, X., Li, L.-J., Fei-Fei, L., & Gupta, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00756 · Cited by 236
Self-citationViP-CNN: Visual Phrase Guided Convolutional Neural Network
Li, Y., Ouyang, W., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.766 · Cited by 229
ConceptNet 5: A Large Semantic Network for Relational Knowledge
Speer, R., & Havasi, C. (2013) · Theory and Applications of Natural Language Processing · doi:10.1007/978-3-642-35085-6_6 · Cited by 223
Explainable and Explicit Visual Reasoning Over Scene Graphs
Shi, J., Zhang, H., & Li, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00857 · Cited by 223
Zhao, B., Meng, L., Yin, W., & Sigal, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00878 · Cited by 203
Seeing through the Human Reporting Bias: Visual Classifiers from Noisy Human-Centric Labels
Misra, I., Zitnick, C. L., Mitchell, M., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.320 · Cited by 199
Bridging Knowledge Graphs to Generate Scene Graphs
Zareian, A., Karaman, S., & Chang, S.-F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58592-1_36 · Cited by 196
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Chen, X., & Wang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02903 · Cited by 193
Self-citationUnpaired Image Captioning via Scene Graph Alignments
Gu, J., Joty, S., Cai, J., Zhao, H., Yang, X., & Wang, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01042 · Cited by 188
Know More Say Less: Image Captioning Based on Scene Graphs
Li, X., & Jiang, S. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2896516 · Cited by 187
Pixels to Graphs by Associative Embedding
Newell, A., & Deng, J. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.07365 · Cited by 178
Weakly-Supervised Learning of Visual Relations
Peyre, J., Laptev, I., Schmid, C., & Sivic, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.554 · Cited by 172
ZeroNAS: Differentiable Generative Adversarial Networks Search for Zero-Shot Learning
Yan, C., Chang, X., Li, Z., Guan, W., Ge, Z., Zhu, L., & Zheng, Q. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3127346 · Cited by 172
Self-citationPCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generation
Yan, S., Shen, C., Jin, Z., Huang, J., Jiang, R., Chen, Y., & Hua, X.-S. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413722 · Cited by 170
Kim, U.-H., Park, J.-M., Song, T.-J., & Kim, J.-H. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2931042 · Cited by 166
Counterfactual Critic Multi-Agent Training for Scene Graph Generation
Chen, L., Zhang, H., Xiao, J., He, X., Pu, S., & Chang, S.-F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00471 · Cited by 166
Attentive Relational Networks for Mapping Images to Scene Graphs
Qi, M., Li, W., Yang, Z., Wang, Y., & Luo, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00408 · Cited by 165
Energy-Based Learning for Scene Graph Generation
Suhail, M., Mittal, A., Siddiquie, B., Broaddus, C., Eledath, J., Medioni, G. G., & Sigal, L. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01372 · Cited by 165
Towards Context-Aware Interaction Recognition for Visual Relationship Detection
Zhuang, B., Liu, L., Shen, C., & Reid, I. D. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.71 · Cited by 162
Object Detection in Videos with Tubelet Proposal Networks
Kang, K., Li, H., Xiao, T., Ouyang, W., Yan, J., Liu, X., & Wang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.101 · Cited by 161
Phrase Localization and Visual Relationship Detection with Comprehensive Image-Language Cues
Plummer, B. A., Mallya, A., Cervantes, C. M., Hockenmaier, J., & Lazebnik, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.213 · Cited by 161
Large-Scale Visual Relationship Understanding
Zhang, J., Kalantidis, Y., Rohrbach, M., Paluri, M., Elgammal, A., & Elhoseiny, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019185 · Cited by 161
Learning to Detect Human-Object Interactions With Knowledge
Xu, B., Wong, Y., Li, J., Zhao, Q., & Kankanhalli, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00212 · Cited by 160
Zoom-Net: Mining Deep Feature Interactions for Visual Relationship Recognition
Yin, G., Sheng, L., Liu, B., Yu, N., Wang, X., Shao, J., & Loy, C. C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_20 · Cited by 158
Hierarchical Recurrent Neural Network for Document Modeling
Lin, R., Liu, S., Yang, M., Li, M., Zhou, M., & Li, S. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1106 · Cited by 156
Semantic Image Manipulation Using Scene Graphs
Dhamo, H., Farshad, A., Laina, I., Navab, N., Hager, G. D., Tombari, F., & Rupprecht, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00526 · Cited by 154
Video Visual Relation Detection
Shang, X., Ren, T., Guo, J., Zhang, H., & Chua, T. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123380 · Cited by 152
Scaling Human-Object Interaction Recognition Through Zero-Shot Learning
Shen, L., Yeung, S. Y., Hoffman, J., Mori, G., & Fei-Fei, L. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00181 · Cited by 149
Fully Convolutional Scene Graph Generation
Liu, H., Yan, N., Mortazavi, M., & Bhanu, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01138 · Cited by 149
Comprehensive Image Captioning via Scene Graph Decomposition
Zhong, Y., Wang, L., Chen, J., Yu, D., & Li, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58568-6_13 · Cited by 140
Relationship Proposal Networks
Zhang, J., Elhoseiny, M., Cohen, S. D., Chang, W. H., & Elgammal, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.555 · Cited by 130
Detecting Unseen Visual Relations Using Analogies
Peyre, J., Šivic, J., Laptev, I., & Schmid, C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00207 · Cited by 126
Image Understanding using vision and reasoning through Scene Description Graph
Aditya, S., Yang, Y., Baral, C. R., Aloimonos, Y., & Fermuller, C. M. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.12.004 · Cited by 123
Exploring Context and Visual Pattern of Relationship for Scene Graph Generation
Wang, W., Wang, R., Shan, S., & Chen, X. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00838 · Cited by 111
Self-citationLearning semantic relationships for better action retrieval in images
Ramanathan, V., Li, C., Deng, J., Han, W., Li, Z., Gu, K., Song, Y., Samy Bengio, A., Rosenberg, C., & Fei-Fei, L. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298713 · Cited by 109
Self-citationKrishna, R., Chami, I., Bernstein, M. S., & Fei-Fei, L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00718 · Cited by 108
Scene graph captioner: Image captioning based on structural visual representation
Xu, N., Liu, A.-A., Liu, J., Nie, W., & Su, Y. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.12.027 · Cited by 104
Mapping Images to Scene Graphs with Permutation-Invariant Structured PredictionPreprint
Herzig, R., Raboh, M., Chechik, G., Berant, J., & Globerson, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05451 · Cited by 103
Contextual Translation Embedding for Visual Relationship Detection and Scene Graph Generation
Hung, Z.-S., Mallya, A., & Lazebnik, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992222 · Cited by 92
Learning Canonical Representations for Scene Graph to Image Generation
Herzig, R., Bar, A., Xu, H., Chechik, G., Darrell, T., & Globerson, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_13 · Cited by 92
From Images to Sentences through Scene Description Graphs using Commonsense Reasoning and KnowledgePreprint
Aditya, S., Yang, Y., Baral, C. R., Fermuller, C. M., & Aloimonos, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03292 · Cited by 87
Learning Visual Commonsense for Robust Scene Graph Generation
Zareian, A., Wang, Z., You, H., & Chang, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_38 · Cited by 87
Detecting Visual Relationships Using Box Attention
Kolesnikov, A., Kuznetsova, A., Lampert, C. H., & Ferrari, V. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00217 · Cited by 83
VrR-VG: Refocusing Visually-Relevant Relationships
Liang, Y., Bai, Y., Zhang, W., Qian, X., Zhu, L., & Mei, T. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01050 · Cited by 83
Explainable Video Action Reasoning via Prior Knowledge and State Transitions
Zhuo, T., Cheng, Z., Zhang, P., Wong, Y., & Kankanhalli, M. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3351040 · Cited by 82
Storytelling from an Image Stream Using Scene Graphs
Wang, R., Wei, Z., Li, P., Zhang, Q., & Huang, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6455 · Cited by 82
Learning Visual Knowledge Memory Networks for Visual Question Answering
Zhou, S., Zhu, C., Dong, Y., Cai, D., Chen, Y., & Li, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00807 · Cited by 81
Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generation
Yang, G., Zhang, J., Zhang, Y., Wu, B., & Yang, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01234 · Cited by 81
Categorizing object-action relations from semantic scene graphs
Aksoy, E. E., Abramov, A., Wörgötter, F., & Dellen, B. K. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509319 · Cited by 80
Natural Language Guided Visual Relationship Detection
Liao, W., Rosenhahn, B., Ling, S., & Yang, M. Y. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00058 · Cited by 79
Shuffle-Then-Assemble: Learning Object-Agnostic Visual Relationship Features
Yang, X., Zhang, H., & Cai, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_3 · Cited by 77
Structured Query-Based Image Retrieval Using Scene Graphs
Schroeder, B., & Tripathi, S. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00097 · Cited by 72
YFCC100M: The New Data in Multimedia Research
Thomee, B., Shamma, D. A., Friedland, G., Elizalde, B., Ni, K., Poland, D., Borth, D., & Li, L.-J. (2015) · arXiv · doi:10.48550/arxiv.1503.01817 · Cited by 69
Classification by Attention: Scene Graph Classification with Prior Knowledge
Sharifzadeh, S., Baharlou, S. M., & Volker Tresp, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16636 · Cited by 68
PasteGAN: A Semi-Parametric Method to Generate Image from Scene GraphPreprint
Li, Y., Ma, T., Bai, Y., Duan, N., Wei, S., & Wang, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01608 · Cited by 67
Tensorize, Factorize and Regularize: Robust Visual Relationship Learning
Hwang, S. J., Kim, H. J., Ravi, S. N., Collins, M. D., Tao, Z., & Singh, V. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00112 · Cited by 66
Image Captioning with Scene-graph Based Semantic Concepts
Gao, L., Wang, B., & Wang, W. (2018) · International Conference on Machine Learning and Computing (ICMLC) · doi:10.1145/3195106.3195114 · Cited by 61
Deep Generative Probabilistic Graph Neural Networks for Scene Graph Generation
Khademi, M., & Schulte, O. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6783 · Cited by 60
Context-Dependent Diffusion Network for Visual Relationship Detection
Cui, Z., Xu, C., Zheng, W., & Yang, J. J. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240668 · Cited by 59
On support relations and semantic scene graphs
Yang, M. Y., Liao, W., Ackermann, H., & Rosenhahn, B. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.07.010 · Cited by 58
Interactive Image Generation Using Scene GraphsPreprint
Mittal, G., Agrawal, S., Agarwal, A., Mehta, S., & Marwah, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03743 · Cited by 57
An Empirical Study on Leveraging Scene Graphs for Visual Question AnsweringPreprint
Zhang, C., Chao, W., & Xuan, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.12133 · Cited by 57
Sketching Image Gist: Human-Mimetic Hierarchical Scene Graph Generation
Wang, W., Wang, R., Shan, S., & Chen, X. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58601-0_14 · Cited by 56
Self-citationMulti-Granularity Reasoning for Social Relation Recognition From Images
Zhang, M., Liu, X., Liu, W., Zhou, A., Ma, H., & Mei, T. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00279 · Cited by 55
BGT-Net: Bidirectional GRU Transformer Network for Scene Graph Generation
Dhingra, N., Ritter, F., & Kunz, A. M. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00244 · Cited by 55
Graph Density-Aware Losses for Novel Compositions in Scene Graph Generation
Knyazev, B. A., de Vries, H., Cangea, C., Taylor, G. W., Courville, A. C., & Belilovsky, E. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.99 · Cited by 54
Visual Relationships as Functions:Enabling Few-Shot Scene Graph Prediction
Dornadula, A., Narcomey, A., Krishna, R., Bernstein, M. S., & Fei-Fei, L. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00214 · Cited by 52
Linguistic Structures as Weak Supervision for Visual Scene Graph Generation
Ye, K., & Kovashka, A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00819 · Cited by 50
Learning to generalize to new compositions in image understandingPreprint
Atzmon, Y., Berant, J., Kezami, V., Globerson, A., & Chechik, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.07639 · Cited by 49
HCVRD: A Benchmark for Large-Scale Human-Centered Visual Relationship Detection
Zhuang, B., Wu, Q., Shen, C., Reid, I. D., & van den Hengel, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12260 · Cited by 47
Nguyen, T., Ni, B., Liu, H., Xia, W., Luo, J., Kankanhalli, M., & Yan, S. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2272919 · Cited by 45
Scene Graph Reasoning with Prior Visual Relationship for Visual Question AnsweringPreprint
Yang, Z., Qin, Z., Yu, J., & Hu, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.09681 · Cited by 44
Scene Graph Generation With Hierarchical Context
Ren, G., Ren, L., Liao, Y., Liu, S., Li, B. H., Han, J., & Yan, S. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979270 · Cited by 43
Online Cross-Modal Scene Retrieval by Binary Representation and Semantic Graph
Qi, M., Wang, Y., & Li, A. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123311 · Cited by 41
Toward Region-Aware Attention Learning for Scene Graph Generation
Liu, A.-A., Tian, H., Xu, N., Nie, W., Zhang, Y., & Kankanhalli, M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3086066 · Cited by 40
Lee, K.-H., Palangi, H., Chen, X., Hu, H., & Gao, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09953 · Cited by 37
Self-citationRepresentation Learning for Scene Graph Completion via Jointly Structural and Visual Embedding
Wan, H., Luo, Y., Peng, B., & Zheng, W. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/132 · Cited by 35
Tackling the Unannotated: Scene Graph Generation with Bias-Reduced Models
Wang, T.-J. J., Pehlivan, S., & Laaksonen, J. T. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.133 · Cited by 33
Raboh, M., Herzig, R., Berant, J., Chechik, G., & Globerson, A. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093297 · Cited by 32
He, T., Gao, L., Song, J., Cai, J., & Li, Y.-F. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/82 · Cited by 32
Using Scene Graph Context to Improve Image GenerationPreprint
Tripathi, S., Bhiwandiwalla, A., Bastidas, A., & Tang, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03762 · Cited by 31
Weakly Supervised Multimodal Kernel for Categorizing Aerial Photographs
Xia, Y., Zhang, L., Liu, Z., Nie, L., & Li, X. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2639438 · Cited by 30
PANet: A Context Based Predicate Association Network for Scene Graph Generation
Chen, Y., Wang, Y., Zhang, Y., & Guo, Y. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00094 · Cited by 30
Visual Social Relationship Recognition
Li, J., Wong, Y., Zhao, Q., & Kankanhalli, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01295-1 · Cited by 30
Scene Graph Generation via Conditional Random FieldsPreprint
Cong, W., Wang, W. Y., & Lee, W.-C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.08075 · Cited by 29
Transferable Interactiveness Prior for Human-Object Interaction Detection.Preprint
Li, Y., Zhou, S., Huang, X., Xu, L., Ma, Z., Fang, H.-S., Wang, Y., & Lu, C. (2018) · arXiv (Cornell University) · Cited by 29
One-shot Scene Graph Generation
Guo, Y., Song, J., Gao, L., & Shen, H. T. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3414025 · Cited by 28
Learning to transfer focus of graph neural network for scene graph parsing
Jiang, J., He, Z., Zhang, S., Zhao, X., & Tan, J. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107707 · Cited by 26
Graph Edit Distance Reward: Learning to Edit Scene Graph
Chen, L., Lin, G., Wang, S., & Wu, Q. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_32 · Cited by 24
Graphical Contrastive Losses for Scene Graph Generation.Preprint
Zhang, J., Shih, K. J., Elgammal, A., Tao, A., & Catanzaro, B. (2019) · arXiv (Cornell University) · Cited by 22
Gao, W.-J., Zhu, Y., Zhang, W., Zhang, K., & Gao, H. (2019) · Computational Intelligence · doi:10.1111/coin.12202 · Cited by 21
Triplet-Aware Scene Graph Embeddings
Schroeder, B., Tripathi, S., & Tang, H. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00221 · Cited by 20
HOSE-Net: Higher Order Structure Embedded Network for Scene Graph Generation
Wei, M., Yuan, C., Yue, X., & Zhong, K. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413575 · Cited by 20
Narrative Collage of Image Collections by Scene Graph Recombination
Fang, F., Yi, M., Feng, H., Hu, S., & Xiao, C. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2759265 · Cited by 16
Deeply Supervised Multimodal Attentional Translation Embeddings for Visual Relationship Detection
Gkanatsios, N., Pitsikalis, V., Koutras, P., Zlatintsi, A., & Maragos, P. A. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803106 · Cited by 15
Scene-Centric Joint Parsing of Cross-View Videos
Qi, H., Xu, Y., Yuan, T., Wu, T., & Zhu, S. C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12256 · Cited by 14
Classifying Collisions with Spatio-Temporal Action Graph Networks.
Herzig, R., Levi, E., Xu, H., Brosh, E., Globerson, A., & Darrell, T. (2018) · Cited by 13
Compact Scene Graphs for Layout Composition and Patch Retrieval
Tripathi, S., Sridhar, S. N., Sundaresan, S., & Tang, H. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00094 · Cited by 13
Adversarial Adaptation of Scene Graph Models for Understanding Civic Issues
Kumar, S., Atreja, S., Singh, A., & Jain, M. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313681 · Cited by 12
Scene Graph based Image Retrieval -- A case study on the CLEVR DatasetPreprint
Ramnath, S., Saha, A., Chakrabarti, S., & Khapra, M. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00850 · Cited by 12
Scene Dynamics: Counterfactual Critic Multi-Agent Training for Scene Graph Generation.Preprint
Chen, L., Zhang, H., Xiao, J., He, X., Pu, S., & Chang, S. (2018) · arXiv (Cornell University) · Cited by 10
TPsgtR: Neural-Symbolic Tensor Product Scene-Graph-Triplet Representation for Image CaptioningPreprint
Sur, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10115 · Cited by 10
Dual ResGCN for Balanced Scene GraphGenerationPreprint
Zhang, J., Zhang, Y., Wu, B., Fan, Y., Shen, F., & Shen, H. T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.04234 · Cited by 8
From Saturation to Zero-Shot Visual Relationship Detection Using Local Context
Gkanatsios, N., Pitsikalis, V., & Maragos, P. A. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.166 · Cited by 7
Recurrent Visual Relationship Recognition with Triplet Unit
Masui, K., Ochiai, A., Yoshizawa, S., & Nakayama, H. (2017) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2017.20 · Cited by 3
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Self-citation
Cited by
Han (2023) · doi:10.1109/tpami.2022.3152247 · Cited by 4,682
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Gunduz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K. K., & Chae, C.-B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 776
Planetarium: A Rigorous Benchmark for Translating Text to Structured Planning Languages
Zuo, M., Velez, F. P., Li, X., Littman, M., & Bach, S. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.560 · Cited by 5
“A scene graph is a data structure commonly used in fields such as computer vision and graphics (Johnson et al., 2015; Chang et al., 2023), rearrangement (Ramachandruni et al., 2023), and planning to represent objects, their attributes, and the relationships among them.”
Metadata
- Authors
- Chang, X., Ren, P., Xu, P., Li, Z., Chen, X., & Hauptmann, A.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-01-01
- Volume
- 45
- Issue
- 1
- Pages
- 1-26
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4200498145
- Cited by
- 324
- References
- 185
- FWCI
- 17.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.