Multimodal Convolutional Neural Networks for Matching Image and Sentence

Ma, Lin, Lu, Zhengdong, Shang, Lifeng, Li, Hang·2015·2015 IEEE International Conference on Computer Vision (ICCV)
DOI 10.1109/iccv.2015.301

Cited by (334)

Items 101–200 of 334

  1. SMAN: Stacked Multimodal Attention Network for Cross-Modal Image–Text Retrieval
    Zhong Ji, Haoran Wang, Jungong Han, Yanwei Pang · 2020 · IEEE Transactions on Cybernetics
  2. Multimodal deep learning for solar radio burst classification
    Lin Ma, Zhuo Chen, Long Xu, Yihua Yan · 2016 · Pattern Recognition
  3. PFAN++: Bi-Directional Image-Text Retrieval With Position Focused Attention Network
    Yaxiong Wang, Hao Yang, Xiuxiu Bai, Xueming Qian, Lin Ma, Jing Juan Lu, Biao Li, Xin Nan Fan · 2020 · IEEE Transactions on Multimedia
  4. Deep Binaries: Encoding Semantic-Rich Cues for Efficient Textual-Visual Cross Retrieval
    Yuming Shen, Li Liu, Ling Shao, Jingkuan Song · 2017 · IEEE/CVF International Conference on Computer Vision (ICCV)
  5. A comprehensive survey on deep learning-based approaches for multimodal sentiment analysis
    Alireza Ghorbanali, Mohammad Karim Sohrabi · 2023 · Artificial Intelligence Review
  6. Deep Relation Embedding for Cross-Modal Retrieval
    Yifan Zhang, Wengang Zhou, Min Wang, Qi Tian, Houqiang Li · 2020 · IEEE Transactions on Image Processing
  7. Bimodal learning via trilogy of skip-connection deep networks for diabetic retinopathy risk progression identification
    Cam-Hao Hua, Thien Huynh‐The, Kiyoung Kim, Seung‐Young Yu, Thuong Le-Tien, Gwang Hoon Park, Jaehun Bang, Wajahat Ali Khan, Sung‐Ho Bae, Sungyoung Lee · 2019 · International Journal of Medical Informatics
  8. Cross-Modal Discrete Hashing
    Venice Erin Liong, Jiwen Lu, Yap‐Peng Tan · 2018 · Pattern Recognition
  9. Improving Cross-Modal Image-Text Retrieval With Teacher-Student Learning
    Junhao Liu, Min Yang, Chengming Li, Ruifeng Xu · 2020 · IEEE Transactions on Circuits and Systems for Video Technology
  10. Multi-Scale Fine-Grained Alignments for Image and Sentence Matching
    Wenhui Li, Yan Wang, Yuting Su, Xuanya Li, An-An Liu, Yongdong Zhang · 2021 · IEEE Transactions on Multimedia
  11. Learning Attribute-Specific Representations for Visual Tracking
    Yuankai Qi, Shengping Zhang, Weigang Zhang, Li Su, Qingming Huang, Ming–Hsuan Yang · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
  12. CycleMatch: A cycle-consistent embedding network for image-text matching
    Yu Liu, Yanming Guo, Li Liu, Erwin M. Bakker, Michael S. Lew · 2019 · Pattern Recognition
  13. Dual-Path Convolutional Image-Text Embedding.
    Zhedong Zheng, Liang Zheng, Michael J. Garrett, Yi Yang, Yi-Dong Shen · 2017 · arXiv (Cornell University)
  14. Social network search based on semantic analysis and learning
    Feifei Kou, Junping Du, Yijiang He, Lingfei Ye · 2016 · CAAI Transactions on Intelligence Technology
  15. Image and Sentence Matching via Semantic Concepts and Order Learning
    Yan Huang, Qi Wu, Wei Wang, Liang Wang · 2018 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  16. End-to-End Convolutional Semantic Embeddings
    Quanzeng You, Jiebo Luo, Zhengyou Zhang · 2018 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  17. Flower classification with modified multimodal convolutional neural networks
    Kang Il Bae, Junghoon Park, Jongga Lee, Yung-Seop Lee, Changwon Lim · 2020 · Expert Systems with Applications
  18. Action-Aware Embedding Enhancement for Image-Text Retrieval
    Jiangtong Li, Li Niu, Liqing Zhang · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  19. Hypergraph-Enhanced Textual-Visual Matching Network for Cross-Modal Remote Sensing Image Retrieval via Dynamic Hypergraph Learning
    Fanglong Yao, Xian Sun, Nayu Liu, Changyuan Tian, Liangyu Xu, Leiyi Hu, Chibiao Ding · 2022 · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  20. Combining sequence and network information to enhance protein–protein interaction prediction
    Leilei Liu, Xianglei Zhu, Yi Ma, Haiyin Piao, Yaodong Yang, Xiaotian Hao, Yue Fu, Li Wang, Jiajie Peng · 2020 · BMC Bioinformatics
  21. Learning visual and textual representations for multimodal matching and classification
    Yu Liu, Li Liu, Yanming Guo, Michael S. Lew · 2018 · Pattern Recognition
  22. Modality-Invariant Image-Text Embedding for Image-Sentence Matching
    Ruoyu Liu, Yao Zhao, Shikui Wei, Liang Zheng, Yi Yang · 2019 · ACM Transactions on Multimedia Computing Communications and Applications
  23. Bridging multimedia heterogeneity gap via Graph Representation Learning for cross-modal retrieval
    Qingrong Cheng, Xiaodong Gu · 2020 · Neural Networks
  24. CODER: Coupled Diversity-Sensitive Momentum Contrastive Learning for Image-Text Retrieval
    Haoran Wang, Dongliang He, Wenhao Wu, Boyang Xia, Min Yang, Fu Li, Yunlong Yu, Zhong Ji, Errui Ding, Jingdong Wang · 2022 · Lecture notes in computer science
  25. AMC: Attention Guided Multi-modal Correlation Learning for Image Search
    Kan Chen, Trung Bui, Fang Chen, Zhaowen Wang, Ram Nevatia · 2017 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  26. Learning Disentangled Representation for Cross-Modal Retrieval with Deep Mutual Information Estimation
    Guo, Weikuo, Huang, Huaibo, Kong, Xiangwei, He, Ran · 2019 · Proceedings of the 27th ACM International Conference on Multimedia
  27. Enhanced Semantic Similarity Learning Framework for Image-Text Matching
    Kun Zhang, Bo Hu, Huatian Zhang, Zhe Li, Zhendong Mao · 2023 · IEEE Transactions on Circuits and Systems for Video Technology
  28. Bidirectional Retrieval Made Simple
    Jônatas Wehrmann, Rodrigo Coelho Barros · 2018 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  29. Deep Top-$k$ Ranking for Image–Sentence Matching
    Lingling Zhang, Minnan Luo, Jun Liu, Xiaojun Chang, Yi Yang, Alexander G. Hauptmann · 2019 · IEEE Transactions on Multimedia
  30. Single-trial EEG RSVP classification using convolutional neural networks
    Shamwell, Jared, Lee, Hyungtae, Kwon, Heesung, Marathe, Amar R., Lawhern, Vernon, Nothwang, William · 2016 · SPIE Proceedings
  31. Sentiment and Emotion Analysis for Social Multimedia
    Quanzeng You · 2016 · ACM International Conference on Multimedia (ACM MM)
  32. Multi-modal gated recurrent units for image description
    Xuelong Li, Aihong Yuan, Xiaoqiang Lu · 2018 · Multimedia Tools and Applications
  33. Bidirectional image-sentence retrieval by local and global deep matching
    Lin Ma, Wenhao Jiang, Zequn Jie, Xu Wang · 2019 · Neurocomputing
  34. Adversarial cross-modal retrieval based on dictionary learning
    Fei Shang, Huaxiang Zhang, Lei Zhu, Jiande Sun · 2019 · Neurocomputing
  35. Scene Graph Semantic Inference for Image and Text Matching
    Jiaming Pei, Kaiyang Zhong, Zhi Hong Yu, Lukun Wang, Kuruva Lakshmanna · 2022 · ACM Transactions on Asian and Low-Resource Language Information Processing
  36. Harmonized Multimodal Learning with Gaussian Process Latent Variable Models
    Guoli Song, Shuhui Wang, Qingming Huang, Qi Tian · 2019 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  37. A canonical polyadic deep convolutional computation model for big data feature learning in Internet of Things
    Jing Gao, Peng Li, Zhikui Chen · 2019 · Future Generation Computer Systems
  38. CMPD: Using Cross Memory Network With Pair Discrimination for Image-Text Retrieval
    Xin Wen, Zhizhong Han, Yu-Shen Liu · 2020 · IEEE Transactions on Circuits and Systems for Video Technology
  39. Combo-Attention Network for Baidu Video Advertising
    Tan Yu, Yi Yang, Yi Li, Xiaodong Chen, Mingming Sun, Ping Li · 2020 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
  40. TediGAN: Text-Guided Diverse Face Image Generation and Manipulation
    Weihao Xia, Yujiu Yang, Jing‐Hao Xue, Baoyuan Wu · 2020 · arXiv (Cornell University)
  41. Picture it in your mind: generating high level visual representations from textual descriptions
    Fabio Carrara, Andrea Esuli, Tiziano Fagni, Fabrizio Falchi, Alejandro Moreo · 2017 · Information Retrieval
  42. Few-Shot Image and Sentence Matching via Gated Visual-Semantic Embedding
    Yan Huang, Yang Long, Liang Wang · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
  43. Matching Image and Sentence with Multi-faceted Representations
    Lin Ma, Wenhao Jiang, Zequn Jie, Yu–Gang Jiang, Wei Liu · 2019 · IEEE Transactions on Circuits and Systems for Video Technology
  44. Enhance understanding and reasoning ability for image captioning
    Jiahui Wei, Zhixin Li, Jianwei Zhu, Huifang Ma · 2022 · Applied Intelligence
  45. Learning Relationship-Enhanced Semantic Graph for Fine-Grained Image–Text Matching
    Xin Liu, Yi He, Yiu‐ming Cheung, Xing Xu, Nannan Wang · 2022 · IEEE Transactions on Cybernetics
  46. Hierarchical Photo-Scene Encoder for Album Storytelling
    Bairui Wang, Lin Ma, Wei Zhang, Wenhao Jiang, Feng Zhang · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
  47. Adversarial Learning With Multi-Modal Attention for Visual Question Answering
    Yun Liu, Xiaoming Zhang, Feiran Huang, Lei Cheng, Zhoujun Li · 2020 · IEEE Transactions on Neural Networks and Learning Systems
  48. StacMR: Scene-Text Aware Cross-Modal Retrieval
    Andrés Mafla, Rafael Sampaio de Rezende, Lluís Gómez, Diane Larlus, Dìmosthenis Karatzas · 2021 · IEEE Winter Conference on Applications of Computer Vision
  49. Task-generic semantic convolutional neural network for web text-aided image classification
    Dongzhe Wang, Kezhi Mao · 2018 · Neurocomputing
  50. Multimodal machine learning for predicting heat transfer characteristics in micro-pin fin heat sinks
    Haeun Lee, Geonhee Lee, Kiwan Kim, Daeyoung Kong, Hyoungsoon Lee · 2024 · Case Studies in Thermal Engineering
  51. Channel Compression: Rethinking Information Redundancy Among Channels in CNN Architecture
    Jinhua Liang, Tao Zhang, Guoqing Feng · 2020 · IEEE Access
  52. Unsupervised text-to-image synthesis
    Yanlong Dong, Ying Zhang, Lin Ma, Zhi Wang, Jiebo Luo · 2020 · Pattern Recognition
  53. Visual-Textual Sentiment Analysis Enhanced by Hierarchical Cross-Modality Interaction
    Tao Zhou, Jiuxin Cao, Xuelin Zhu, Bo Liu, Shancang Li · 2020 · IEEE Systems Journal
  54. Combining Global and Local Similarity for Cross-Media Retrieval
    Zhixin Li, Feng Ling, Canlong Zhang, Huifang Ma · 2020 · IEEE Access
  55. Telling the What while Pointing to the Where: Multimodal Queries for Image Retrieval
    Soravit Changpinyo, Jordi Pont-Tuset, Vittorio Ferrari, Radu Soricut · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  56. Cross-Modality Retrieval by Joint Correlation Learning
    Shuo Wang, Dan Guo, Xin Xu, Zhuo Li, Meng Wang · 2019 · ACM Transactions on Multimedia Computing Communications and Applications
  57. Multimodal Classification of Onion Services for Proactive Cyber Threat Intelligence Using Explainable Deep Learning
    Harsha Moraliyage, Vidura Sumanasena, Daswin De Silva, Rashmika Nawaratne, Lina Sun, Damminda Alahakoon · 2022 · IEEE Access
  58. Attribute-Guided Attention for Referring Expression Generation and Comprehension
    Jingyu Liu, Wei Wang, Liang Wang, Ming–Hsuan Yang · 2020 · IEEE Transactions on Image Processing
  59. RICH: A rapid method for image-text cross-modal hash retrieval
    Bo Li, Dan Yao, Zhixin Li · 2023 · Displays
  60. Rich Features Embedding for Cross-Modal Retrieval: A Simple Baseline
    Xin Fu, Yao Zhao, Yunchao Wei, Yufeng Zhao, Shikui Wei · 2019 · IEEE Transactions on Multimedia
  61. Cross-Domain Deep Feature Combination for Bird Species Classification with Audio-Visual Data
    Naranchimeg Bold, Chao Zhang, Takuya Akashi · 2019 · IEICE Transactions on Information and Systems
  62. Text-to-Clip Video Retrieval with Early Fusion and Re-Captioning.
    Huijuan Xu, Kun He, Leonid Sigal, Stan Sclaroff, Kate Saenko · 2018 · arXiv (Cornell University)
  63. A multimodal approach for regional GDP prediction using social media activity and historical information
    Javier Ortega Bastida, Antonio‐Javier Gallego, Juan Ramón Rico-Juan, Pedro Albarrán · 2021 · Applied Soft Computing
  64. Multiview adaptive attention pooling for image–text retrieval
    Yunlai Ding, Jiaao Yu, Qingxuan Lv, Haoran Zhao, Junyu Dong, Yuezun Li · 2024 · Knowledge-Based Systems
  65. Order embeddings and character-level convolutions for multimodal alignment
    Jônatas Wehrmann, Anderson Mattjie, Rodrigo Coelho Barros · 2017 · Pattern Recognition Letters
  66. Rare-aware attention network for image–text matching
    Yan Wang, Yuting Su, Wenhui Li, Zhengya Sun, Zhiqiang Wei, Jie Nie, Xuanya Li, An-An Liu · 2023 · Information Processing & Management
  67. Improving What Cross-Modal Retrieval Models Learn through Object-Oriented Inter- and Intra-Modal Attention Networks
    Po-Yao Huang, Vaibhav, Xiaojun Chang, Alexander G. Hauptmann · 2019 · International Conference on Multimedia Retrieval
  68. Query is GAN: Scene Retrieval With Attentional Text-to-Image Generative Adversarial Network
    Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama · 2019 · IEEE Access
  69. Development of ensemble smoother–neural network and its application to history matching of channelized reservoirs
    Sungil Kim, Kyungbook Lee, Jung-Tek Lim, Hoonyoung Jeong, Baehyun Min · 2020 · Journal of Petroleum Science and Engineering
  70. Multi-source Semantic Graph-based Multimodal Sarcasm Explanation Generation
    Liqiang Jing, Xuemeng Song, Kun Ouyang, Mengzhao Jia, Liqiang Nie · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  71. Gated Hierarchical Attention for Image Captioning
    Qingzhong Wang, Antoni B. Chan · 2019 · Lecture notes in computer science
  72. Visual Relations Augmented Cross-modal Retrieval
    Yutian Guo, Jingjing Chen, Hao Zhang, Yu–Gang Jiang · 2020 · International Conference on Multimedia Retrieval
  73. VLGrammar: Grounded Grammar Induction of Vision and Language
    Yining Hong, Qing Li, Song Chun Zhu, Siyuan Huang · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  74. Focus your attention: A focal attention for multimodal learning
    Liu, Chunxiao, Mao, Zhendong, Zhang, Tianzhu, Liu, An-An, Wang, Bin, Zhang, Yongdong · 2022 · IEEE Transactions on Multimedia
  75. Learning DALTS for cross‐modal retrieval
    Yu Zheng, Wenmin Wang · 2019 · CAAI Transactions on Intelligence Technology
  76. Multi-modal online review driven product improvement design based on scientific effects knowledge graph
    Ruiwen Wang, Jihong Liu, Mingrui Li, Chao Fu, Yongzhu Hou · 2024 · Journal of Engineering Design
  77. Multi-Modal Knowledge Representation Learning via Webly-Supervised Relationships Mining
    Fudong Nian, Bing‐Kun Bao, Teng Li, Changsheng Xu · 2017 · ACM International Conference on Multimedia (ACM MM)
  78. Deep multi-view representation learning for social images
    Feiran Huang, Xiaoming Zhang, Zhonghua Zhao, Zhoujun Li, Yueying He · 2018 · Applied Soft Computing
  79. Multi-Modal Memory Enhancement Attention Network for Image-Text Matching
    Zhong Ji, Zhigang Lin, Haoran Wang, Yuqing He · 2020 · IEEE Access
  80. Re-ranking image-text matching by adaptive metric fusion
    Kai Niu, Yan Huang, Liang Wang · 2020 · Pattern Recognition
  81. Deep Neural Architecture for Multi-Modal Retrieval based on Joint Embedding Space for Text and Images
    Saeid Balaneshin-kordan, Alexander Kotov · 2018 · ACM International Conference on Web Search and Data Mining (WSDM)
  82. Holistic Multi-Modal Memory Network for Movie Question Answering
    Anran Wang, Anh Tuan Luu, Chuan-Sheng Foo, Hongyuan Zhu, Yi Tay, Vijay Chandrasekhar · 2019 · IEEE Transactions on Image Processing
  83. Multi-task framework based on feature separation and reconstruction for cross-modal retrieval
    Li Zhang, Xiangqian Wu · 2021 · Pattern Recognition
  84. Neural Segmentation of Seeding ROIs (sROIs) for Pre-Surgical Brain Tractography
    Itzik Avital, Ilya Nelkenbaum, Galia Tsarfaty, Eli Konen, Nahum Kiryati, Arnaldo Mayer · 2019 · IEEE Transactions on Medical Imaging
  85. Semantic Completion and Filtration for Image–Text Retrieval
    Song Soo Yang, Qiang Li, Wenhui Li, Xuanya Li, Ran Jin, Bo Lv, Rui Wang, An-An Liu · 2022 · ACM Transactions on Multimedia Computing Communications and Applications
  86. Bi-Attention enhanced representation learning for image-text matching
    Yumin Tian, Aqiang Ding, Di Wang, Xuemei Luo, Bo Wan, Yifeng Wang · 2023 · Pattern Recognition
  87. Cross-media Retrieval by Learning Rich Semantic Embeddings of Multimedia
    Mengdi Fan, Wenmin Wang, Peilei Dong, Liang Han, Ronggang Wang, Ge Li · 2017 · ACM International Conference on Multimedia (ACM MM)
  88. Contextually Customized Video Summaries Via Natural Language
    Jinsoo Choi, Tae-Hyun Oh, In So Kweon · 2018 · IEEE Winter Conference on Applications of Computer Vision
  89. Attention Alignment Multimodal LSTM for Fine-Gained Common Space Learning
    Sijia Chen, Bin Song, Jie Guo · 2018 · IEEE Access
  90. Learning semantic sentence representations from visually grounded language without lexical knowledge
    Danny Merkx, S. Frank · 2019 · Natural Language Engineering
  91. Stacked squeeze-and-excitation recurrent residual network for visual-semantic matching
    Haoran Wang, Zhong Ji, Zhigang Lin, Yanwei Pang, Xuelong Li · 2020 · Pattern Recognition
  92. Heterogeneous memory enhanced graph reasoning network for cross-modal retrieval
    Zhong Ji, Kexin Chen, Yuqing He, Yanwei Pang, Xuelong Li · 2022 · Science China Information Sciences
  93. Joint Visual-Textual Sentiment Analysis Based on Cross-Modality Attention Mechanism
    Xuelin Zhu, Biwei Cao, Shuai Xu, Bo Liu, Jiuxin Cao · 2018 · Lecture notes in computer science
  94. A Neighbor-aware Approach for Image-text Matching
    Chunxiao Liu, Zhendong Mao, Wenyu Zang, Bin Wang · 2019 · IEEE International Conference on Acoustics Speech and Signal Processing
  95. Neural information retrieval: introduction to the special issue
    Nick Craswell, W. Bruce Croft, Maarten de Rijke, Jiafeng Guo, Bhaskar Mitra · 2017 · Information Retrieval
  96. MiC: Image-text Matching in Circles with cross-modal generative knowledge enhancement
    Xiao Pu, Yu‐Wen Chen, Lin Yuan, Yan Zhang, Hongbo Li, Liping Jing, Xinbo Gao · 2024 · Knowledge-Based Systems
  97. Few-Shot Image and Sentence Matching via Aligned Cross-Modal Memory
    Yan Huang, Jingdong Wang, Liang Wang · 2021 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  98. Multi-scale image–text matching network for scene and spatio-temporal images
    Runde Yu, Fusheng Jin, Zhuang Qiao, Ye Yuan, Guoren Wang · 2023 · Future Generation Computer Systems
  99. Cross-modal knowledge guided model for abstractive summarization
    Hong Wang, Jin Liu, Mingyang Duan, Peizhu Gong, Zhongdai Wu, Junxiang Wang, Bing Han · 2023 · Complex & Intelligent Systems
  100. Global-aware Fragment Representation Aggregation Network for image–text retrieval
    Di Wang, Jiabo Tian, Liang Xiao, Yumin Tian, Lihuo He · 2024 · Pattern Recognition