Multimodal Convolutional Neural Networks for Matching Image and Sentence

Ma, Lin, Lu, Zhengdong, Shang, Lifeng, Li, Hang·2015·2015 IEEE International Conference on Computer Vision (ICCV)
DOI 10.1109/iccv.2015.301

Cited by (334)

Items 201–300 of 334

  1. Fs-DSM: Few-Shot Diagram-Sentence Matching via Cross-Modal Attention Graph Model
    Xin Hu, Lingling Zhang, Jun Liu, Qinghua Zheng, Jianlong J. Zhou · 2021 · IEEE Transactions on Image Processing
  2. Semantic guidance network for video captioning
    Lan Guo, Hong Ping Zhao, Zhiwen Chen, Zeyu Han · 2023 · Scientific Reports
  3. Visual Sentiment Prediction with Attribute Augmentation and Multi-attention Mechanism
    Zhuanghui Wu, Min Meng, Jigang Wu · 2020 · Neural Processing Letters
  4. Adversarial Attentive Multi-Modal Embedding Learning for Image-Text Matching
    Kaimin Wei, Zhibo Zhou · 2020 · IEEE Access
  5. Large-Scale Traffic Congestion Prediction based on Multimodal Fusion and Representation Mapping
    Bodong Zhou, Jiahui Liu, Songyi Cui, Yaping Zhao · 2022 · IEEE International Conference on Data Science and Advanced Analytics (DSAA)
  6. Deep Learning—A New Era in Bridging the Semantic Gap
    Urszula Markowska–Kaczmar, Halina Kwaśnicka · 2018 · Intelligent systems reference library
  7. Cross-modal Semantic Interference Suppression for image-text matching
    Tao Yao, Shouyong Peng, Yujuan Sun, Guorui Sheng, Haiyan Fu, Xiangwei Kong · 2024 · Engineering Applications of Artificial Intelligence
  8. Multimodal Learning for Classification of Solar Radio Spectrum
    Zhuo Chen, Lin Ma, Long Xu, Ying Weng, Yihua Yan · 2015 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
  9. Enhancing Cross-Modal Retrieval Based on Modality-Specific and Embedding Spaces
    Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama · 2020 · IEEE Access
  10. Cross-modal multi-relationship aware reasoning for image-text matching
    Jin Zhang, Xiaohai He, Linbo Qing, Luping Liu, Xiaodong Luo · 2021 · Multimedia Tools and Applications
  11. NAPReg: Nouns As Proxies Regularization for Semantically Aware Cross-Modal Embeddings
    Bhavin Jawade, Deen Dayal Mohan, Naji Mohamed Ali, Srirangaraj Setlur, Venu Govindaraju · 2023 · IEEE Winter Conference on Applications of Computer Vision
  12. What we see in a photograph: content selection for image captioning
    Georgios Barlas, Christos N. Veinidis, Avi Arampatzis · 2020 · The Visual Computer
  13. Mining core information by evaluating semantic importance for unpaired image captioning
    Jiahui Wei, Zhixin Li, Canlong Zhang, Huifang Ma · 2024 · Neural Networks
  14. Vision-language pre-training via modal interaction
    Hang Cheng, Hehui Ye, Xiaofei Zhou, Ximeng Liu, Fei Chen, Meiqing Wang · 2024 · Pattern Recognition
  15. Camera-LiDAR Fusion Method with Feature Switch Layer for Object Detection Networks
    Taek-Lim Kim, Tae-Hyoung Park · 2022 · Sensors
  16. Fusion layer attention for image-text matching
    Depeng Wang, Liejun Wang, Shiji Song, Gao Ming Huang, Yuchen Guo, Shuli Cheng, Naixiang Ao, Anyu Du · 2021 · Neurocomputing
  17. Adversarial Pre-Optimized Graph Representation Learning with Double-Order Sampling for Cross-Modal Retrieval
    Qingrong Cheng, Qi Guo, Xiaodong Gu · 2022 · Expert Systems with Applications
  18. Multi-task hierarchical convolutional network for visual-semantic cross-modal retrieval
    Zhong Ji, Zhigang Lin, Haoran Wang, Yanwei Pang, Xuelong Li · 2024 · Pattern Recognition
  19. RETRACTED ARTICLE: Multimodal deep learning for cephalometric landmark detection and treatment prediction
    Fei Gao, Yulong Tang · 2025 · Scientific Reports · Retracted
  20. News Image-Text Matching With News Knowledge Graph
    Yumeng Zhao, Jing Yun, Shuo Gao, Limin Liu · 2021 · IEEE Access
  21. Modelling Human Word Learning and Recognition Using Visually Grounded Speech
    Danny Merkx, Sebastiaan Scholten, Stefan L. Frank, Mirjam Ernestus, Odette Scharenborg · 2022 · Cognitive Computation
  22. Multimodality for improved CNN photometric redshifts
    R. Ait Ouahmed, Stéphane Arnouts, Jérôme Pasquet, Marie A. Treyer, E. Bertin · 2023 · Astronomy and Astrophysics
  23. Upgrading the Newsroom
    Fangyu Liu, Rémi Lebret, Didier Orel, Philippe Sordet, Karl Aberer · 2020 · ACM Transactions on Multimedia Computing Communications and Applications
  24. A New Evaluation Protocol and Benchmarking Results for Extendable Cross-media Retrieval
    Ruoyu Liu, Yao Zhao, Liang Zheng, Shikui Wei, Yi Yang · 2017 · arXiv (Cornell University)
  25. Multimodal video-text matching using a deep bifurcation network and joint embedding of visual and textual features
    Masoomeh Nabati, Alireza Behrad · 2021 · Expert Systems with Applications
  26. Cross-modal Relational Reasoning Network for Visual Question Answering
    Hongyu Chen, Ruifang Liu, Bo Peng · 2021 · IEEE International Conference on Computer Vision Workshops
  27. Do Cross Modal Systems Leverage Semantic Relationships?
    Shah Nawaz, Muhammad Kamran Janjua, Ignazio Gallo, Arif Mahmood, Alessandro Calefati, Faisal Shafait B · 2019 · IEEE International Conference on Computer Vision Workshops
  28. Towards Context-aware Interaction Recognition
    Bohan Zhuang, Lingqiao Liu, Chunhua Shen, Ian D. Reid · 2017 · arXiv (Cornell University)
  29. Boosting Cross-Modal Retrieval With MVSE++ and Reciprocal Neighbors
    Wei Wei, Mengmeng Jiang, Xiangnan Zhang, Heng Liu, Chunna Tian · 2020 · IEEE Access
  30. Optimizing Features Quality: A Normalized Covariance Fusion Framework for Skeleton Action Recognition
    Guan Huang, Qiuyan Yan · 2020 · IEEE Access
  31. Cross‐modal semantic correlation learning by Bi‐CNN network
    Chaoyi Wang, Liang Li, Chenggang Clarence Yan, Zhan Wang, Yaoqi Sun, Jiyong Zhang · 2021 · IET Image Processing
  32. Target-Oriented Deformation of Visual-Semantic Embedding Space
    Takashi Matsubara · 2020 · IEICE Transactions on Information and Systems
  33. Joint Intra & Inter-Grained Reasoning: A New Look Into Semantic Consistency of Image-Text Retrieval
    Renjie Pan, Hua Yang, C. Li, Jinhai Yang · 2023 · IEEE Transactions on Multimedia
  34. Sentiment-Enhanced Graph-Based Sarcasm Explanation in Dialogue
    Kun Ouyang, Liqiang Jing, Xuemeng Song, Meng Liu, Yupeng Hu, Liqiang Nie · 2025 · IEEE Transactions on Multimedia
  35. Enhanced flower image classification: A multimodal approach leveraging Persian texts and deep learning
    Zohre Karimi, Mohammad Karamad, Sajjad Rahmany · 2025 · Engineering Applications of Artificial Intelligence
  36. Bi-directional Image–Text Matching Deep Learning-Based Approaches: Concepts, Methodologies, Benchmarks and Challenges
    Doaa B. Ebaid, Magda Mohamed Madbouly, Adel A. El-Zoghabi · 2023 · International Journal of Computational Intelligence Systems
  37. Cross‐modal retrieval with dual multi‐angle self‐attention
    Wenjie Li, Yi Zheng, Yuejie Zhang, Rui Feng, Tao Zhang, Weiguo Fan · 2020 · Journal of the Association for Information Science and Technology
  38. Research on Image Tibetan Caption Generation Method Fusion Attention Mechanism
    Jianjun Xia, Xin She Yang, Qiong Ni, Dingguo Gao · 2023 · IEEE International Conference on Pattern Recognition and Machine Learning (PRML)
  39. Context-Aware Dual-Attention Network for Natural Language Inference
    Kun Zhang, Guangyi Lv, Enhong Chen, Le Wu, Qi Liu, C. L. Philip Chen · 2019 · Lecture notes in computer science
  40. Fast Self-Attentive Multimodal Retrieval
    Jônatas Wehrmann, Mauricio A. Lopes, Martin D. Móre, Rodrigo Coelho Barros · 2018 · IEEE Winter Conference on Applications of Computer Vision
  41. Cross-View Image Retrieval - Ground to Aerial Image Retrieval Through Deep Learning
    Numan Khurshid, Talha Hanif, Mohbat Tharani, Murtaza Taj · 2019 · Lecture notes in computer science
  42. Fusing grid and adaptive region features for image captioning
    Jiahui Wei, Zhixin Li, Canlong Zhang, Huifang Ma · 2025 · Image and Vision Computing
  43. COREN: Multi-Modal Co-Occurrence Transformer Reasoning Network for Image-Text Retrieval
    Yaodong Wang, Zhong Ji, Kexin Chen, Yanwei Pang, Zhongfei Mark Zhang · 2022 · Neural Processing Letters
  44. A Lightweight Multi-Grained Image-Text Retrieval Paradigm via Cascaded Representation Learning and Parameter-Free Feature Aggregation
    Chenyu Lu, Nan Zhang, Shiliang Sun · 2024 · IEEE Transactions on Circuits and Systems for Video Technology
  45. Multi-digit image synthesis using recurrent conditional variational autoencoder
    Haoze Sun, Weidi Xu, Chao Deng, Ying Tan · 2016 · International Joint Conference on Neural Networks (IJCNN)
  46. Studying the impact of the Full-Network embedding on multimodal pipelines
    Armand Vilalta, Dario García-Gasulla, Ferran Parés, Eduard Ayguadé, Jesús Labarta, Eduardo Ulises Moya-Sánchez, Ulises Cortés · 2018 · Semantic Web
  47. Listening While Speaking and Visualizing: Improving ASR Through Multimodal Chain
    Johanes Effendi, Andros Tjandra, Sakriani Sakti, Satoshi Nakamura · 2019 · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
  48. A Spiking Neural Network Model of Rodent Head Direction Calibrated With Landmark Free Learning
    Rachael Stentiford, Thomas C. Knowles, Martin J. Pearson · 2022 · Frontiers in Neurorobotics
  49. Generating commentaries for tennis videos
    Fei Yan, Krystian Mikolajczyk, Josef Kittler · 2016 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  50. Comparative assessment of text-image fusion models for medical diagnostics
    Natalia Gusarova, Artem Lobantsev, Aleksandra S. Vatian, Andrey Kapitonov, Anatoly Abramovich Shalyto · 2020 · Информационно-управляющие системы
  51. Distinctive Image Captioning via CLIP Guided Group Optimization
    Youyuan Zhang, Jiuniu Wang, Hao Wu, Wenjia Xu · 2023 · Lecture notes in computer science
  52. Multi-scale motivated neural network for image-text matching
    Xueyang Qin, Lishuang Li, Guangyao Pang · 2023 · Multimedia Tools and Applications
  53. AI-Generated Image Quality Assessment Based on Task-Specific Prompt and Multi-Granularity Similarity
    Jili Xia, Lihuo He, Cheng Dan Deng, Leida Li, Xinbo Gao · 2025 · IEEE Transactions on Image Processing
  54. Learning a Limited Text Space for Cross-Media Retrieval
    Yu Zheng, Wenmin Wang, Mengdi Fan · 2017 · Lecture notes in computer science
  55. Two-Stream Convolutional Neural Network for Multimodal Matching
    Youcai Zhang, Yiwei Gu, Xiaodong Gu · 2018 · Lecture notes in computer science
  56. Data Fusion for Deep Learning on Transport Mode Detection: A Case Study
    Hugues Moreau, Andréa Vassilev, Liming Chen · 2021 · Proceedings of the international neural networks society
  57. Multi-level network based on transformer encoder for fine-grained image–text matching
    Lei Yang, Yong Feng, Mingliang Zhou, Xiancai Xiong, Yongheng Wang, Baohua Qiang · 2023 · Multimedia Systems
  58. Instance-level 3D shape retrieval from a single image by hybrid-representation-assisted joint embedding
    Qian-Fang Zou, Ligang Liu, Yang Liu · 2020 · The Visual Computer
  59. Recommendations for Different Tasks Based on the Uniform Multimodal Joint Representation
    Haiying Liu, Sinuo Deng, Lifang Wu, Meng Jian, Bowen Yang, Dai Zhang · 2020 · Applied Sciences
  60. Multimodal Object Recognition Using Deep Learning Representations Extracted from Images and Smartphone Sensors
    Javier Ortega Bastida, Antonio‐Javier Gallego, Antonio Pertusa · 2019 · Lecture notes in computer science
  61. Revisiting Cross Modal Retrieval
    Shah Nawaz, Muhammad Kamran Janjua, Alessandro Calefati, Ignazio Gallo · 2018 · arXiv (Cornell University)
  62. Full-Network Embedding in a Multimodal Embedding Pipeline
    Armand Vilalta, Dario García-Gasulla, Ferran Parés, Ayguadé Eduard, Jesus Labarta, Ulises Cortés, Toyotaro Suzumura · 2017 · arXiv (Cornell University)
  63. Learning Cross-Modal Aligned Representation With Graph Embedding
    Youcai Zhang, Jiayan Cao, Xiaodong Gu · 2018 · IEEE Access
  64. Cross-Media Image-Text Retrieval Combined with Global Similarity and Local Similarity
    Zhixin Li, Feng Ling, Canlong Zhang · 2019 · IEEE International Conference on Data Science and Advanced Analytics (DSAA)
  65. Cross-language multimodal scene semantic guidance and leap sampling for video captioning
    Bo Sun, Yong Wu, Yijia Zhao, Zhuo Hao, Lejun Yu, Jun Yi Derek He · 2022 · The Visual Computer
  66. Associating Images with Sentences Using Recurrent Canonical Correlation Analysis
    Yawen Guo, Hui Lin Yuan, Kun Zhang · 2020 · Applied Sciences
  67. Proceedings of the 22nd Engineering Applications of Neural Networks Conference
    Symeonidis Charalampos, Paraskevi Nousi, Pavlos Tosidis, Konstantinos Tsampazis, Nikolaos Passalis, Anastasios Tefas, Nikos Nikolaidis · 2021 · Proceedings of the international neural networks society
  68. Luandri
    Bhaskar Mitra, Fernando Díaz, Nick Craswell · 2017 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
  69. Neural methods for effective, efficient, and exposure-aware information retrieval
    Bhaskar Mitra · 2021 · ACM SIGIR Forum
  70. Attentive Feature Focusing for Person Search by Natural Language
    Renjie Pan, Hua Yang, Xinxin Yang, Mao Xiaodong, Long Ye, Da Pan · 2022 · Communications in computer and information science
  71. Detecting Off-topic Responses to Visual Prompts
    Marek Rei · 2017 · Workshop on Innovative Use of NLP for Building Educational Applications
  72. Performance Enhancement for CNN-Based Classification of Low Probability of Intercept Radar Signals With Pulse Integration
    Jijun Hwang, Yeonwoong Kim, Minhyeok Yang, Sunghwan Cho, Haejoon Jung, Dusit Tao Niyato · 2025 · IEEE Transactions on Vehicular Technology
  73. Exploring Hierarchical Cross-Modal Correlation Consistency for Partial Mismatching
    Xiaoqing Liu, Zhiwen Yu, Jun Yu, Huanqiang Zeng, Zhuoyao Wang, C L Philip Chen · 2026 · IEEE Transactions on Image Processing
  74. A comprehensive review of recent advancements in vision-and-language navigation
    Jahanzeb Tariq Khan, Nayyer Aafaq, Qasim Ali, Mujahid Mohsin · 2026 · Discover Computing
  75. Deep Match between Geology Reports and Well Logs Using Spatial Information
    Bin Tong, Martin Klinkigt, Makoto Iwayama, Yoshiyuki Kobayashi, Anshuman Sahu, Ravigopal Vennelakanti · 2016 · ACM International Conference on Information and Knowledge Management (CIKM)
  76. CroMIC-QA: The Cross-Modal Information Complementation Based Question Answering
    順時 湯浅, Bingquan Liu, Chengjie Sun, Zhen Xing Xu, Lin Ma, Baoxun Wang · 2023 · IEEE Transactions on Multimedia
  77. Syntactic-guided optimization of image–text matching for intra-modal modeling
    Di Wu, Le Zhang, Yao Chen · 2025 · The Journal of Supercomputing
  78. Hyperbolic vision language representation learning on chest radiology images
    Zuojing Zhang, Zhi Qiao, Linbin Han, Hong Bing Yang, Zhen Qian, Jingxiang Wu · 2025 · Health Information Science and Systems
  79. Cross-media Relevance Computation for Multimedia Retrieval
    Jianfeng Dong · 2017 · ACM International Conference on Multimedia (ACM MM)
  80. Irrelevance reduction with locality-sensitive hash learning for efficient cross-media retrieval
    Yuhua Jia, Liang Bai, Peng Wang, Jinlin Guo, Yuxiang Xie, Tianyuan Yu · 2018 · Multimedia Tools and Applications
  81. Multi-scale Relational Reasoning with Regional Attention for Visual Question Answering
    Yuntao Ma, Tong Lü, Yirui Wu · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  82. MTDE: Multi-typed data embedding in heterogeneous networks
    Haifeng Sun, Jianxin Liao, Jingyu Wang, Qi Qi · 2017 · Neurocomputing
  83. FEIDEGGER: A Multi-modal Corpus of Fashion Images and Descriptions in German
    Leonidas Lefakis, Alan Akbik, Roland Vollgraf · 2018 · Language Resources and Evaluation Conference (LREC)
  84. Deep Convolutional Neural Network for Correlating Images and Sentences
    Yuhua Jia, Liang Bai, Peng Wang, Jinlin Guo, Yuxiang Xie · 2018 · Lecture notes in computer science
  85. UniVSE: Robust Visual Semantic Embeddings via Structured Semantic Representations
    Hao Wu, Jiayuan Mao, Yufeng Zhang, Yuning Jiang, Lei Li, Weiwei Sun, Wei‐Ying Ma · 2019 · arXiv (Cornell University)
  86. Semantic Text-to-Face GAN -ST^2FG
    Manan Oza, Sukalpa Chanda, David Doermann · 2021 · arXiv (Cornell University)
  87. Deep learning for natural language understanding: A review of recent advances
    Sandeep Singh, Naseem Zaidi, Anand Mohan Singh · 2018 · International journal of applied research
  88. Collaborative Analysis of Learners’ Emotional States Based on Cross-Modal Higher-Order Reasoning
    Wenyan Wu, Jingtao Zhao, Xingbo Shen, Guang Feng · 2024 · Applied Sciences
  89. Physics-guided genetic algorithm for optimization of multi-jet impingement cooling
    Yonghun Kim, Haeun Lee, Seokwon Jeong, Nana Kang, Changwoo Han, Dongmin Shin, Hyoungsoon Lee · 2026 · Applied Thermal Engineering
  90. Enhancing bidirectional association between deep image representations and loosely correlated texts
    Qiuwen Chen, Qinru Qiu · 2016 · International Joint Conference on Neural Networks (IJCNN)
  91. Multi-modal Sentiment Feature Learning Based on Sentiment Signal
    Dazhen Lin, Lingxiao Li, Donglin Cao, Shaozi Li · 2017 · Chinese Conference on Computer Supported Cooperative Work and Social Computing (ChineseCSCW)
  92. (Artificial) Mind over Matter
    Roee Shraga · 2018 · ACM SIGMOD International Conference on Management of Data (SIGMOD)
  93. Multimodal Joint Representation for User Interest Analysis on Content Curation Social Networks
    Lifang Wu, Dai Zhang, Meng Jian, Bowen Yang, Haiying Liu · 2018 · Lecture notes in computer science
  94. Image Retrieval With Lingual And Visual Paraphrasing Via Generative Models
    Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama · 2020 · Proceedings - International Conference on Image Processing
  95. Dense Captioning of Videos using Feature Context Integrated Deep LSTM with Local Attention
    Jaimon Jacob, V.P. Devassia · 2022 · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC)
  96. Enhanced Video BERT for Fast Video Advertisement Retrieval
    Yi Yang, Tan Yu, Jie Liu, Zhipeng Jin, Xuewu Jiao, Yi Li, Shuanglong Li, Ping Li · 2022 · IEEE International Conference on Big Data (BigData)
  97. Emotionally-Bridged Cross-Lingual Meta-Learning for Chinese Sexism Detection
    Guanlin Li, Praboda Rajapaksha, Reza Farahbakhsh, Noël Crespi · 2023 · Lecture notes in computer science
  98. Protein coding regions prediction by fusing DNA shape features
    Miao Chen, Yangyang Li, Kun Zhang, Hao Liu · 2024 · New Biotechnology
  99. Improving Off-Line Handwritten Chinese Character Recognition with Semantic Information
    Hongjian Zhan, Shujing Lyu, Yue Lu · 2018 · Lecture notes in computer science
  100. Variable length deep cross-modal hashing based on Cauchy probability function
    Chen Li, Zhuotong Liu, Sijie Li, Ziniu Lin, Lihua Tian · 2020 · Wireless Networks