A Comprehensive Survey of Deep Learning for Image Captioning

Hossain, MD. Zakir, Sohel, Ferdous, Shiratuddin, Mohd Fairuz, Laga, Hamid·2019·ACM Computing Surveys
DOI 10.1145/3295748

Cited by (878)

Items 101–200 of 878

  1. New Ideas and Trends in Deep Multimodal Content Understanding: A Review
    Wei Chen, Weiping Wang, Li Liu, Michael S. Lew · 2020 · Neurocomputing
  2. Optimal dynamic pricing for an electricity retailer in the price-responsive environment of smart grid
    Hossein Taherian, Mohammad Reza Aghaebrahimi, Luis Baringo, Saeed Reza Goldani · 2021 · International Journal of Electrical Power & Energy Systems
  3. DocPedia: unleashing the power of large multimodal model in the frequency domain for versatile document understanding
    Hao Feng, Qi Liu, Hao Liu, Jingqun Tang, Wengang Zhou, Houqiang Li, Can Huang · 2024 · Science China Information Sciences
  4. On Automating Hyperparameter Optimization for Deep Learning Applications
    Nabila Shawki, R. Rodriguez Nunez, Iyad Obeid, Joseph Picone · 2021 · IEEE Signal Processing in Medicine and Biology Symposium
  5. A survey on multimodal bidirectional machine learning translation of image and natural language processing
    W.K. Nam, Beakcheol Jang · 2023 · Expert Systems with Applications
  6. Transfer Learning in Sensor-Based Human Activity Recognition: A Survey
    Dhekane, Sourish Gunesh, Ploetz, Thomas · 2025 · ACM Computing Surveys
  7. Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques and Tools
    Ruben Mayer, Hans‐Arno Jacobsen · 2019 · arXiv (Cornell University)
  8. On Diversity in Image Captioning: Metrics and Methods
    Qingzhong Wang, Jia Wan, Antoni B. Chan · 2020 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  9. A Multimodal Memes Classification: A Survey and Open Research Issues
    Tariq Habib Afridi, Aftab Alam, Muhammad Numan Khan, Jawad Khan, Young-Koo Lee · 2021 · Lecture notes in networks and systems
  10. AI-assisted automated scoring of picture-cued writing tasks for language assessment
    Zhao, Ruibin, Zhuang, Yipeng, Zou, Di, Xie, Qin, Yu, Philip L. H. · 2023 · Education and Information Technologies
  11. Prediction of Gas Concentration Based on LSTM-LightGBM Variable Weight Combination Model
    Xiangqian Wang, Ningke Xu, Xiangrui Meng, Haoqian Chang · 2022 · Energies
  12. Context-Aware Group Captioning via Self-Attention and Contrastive Features
    Zhuowan Li, Quan Tran, Long Mai, Zhe Lin, Alan Yuille · 2020 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  13. Interactive Robotic Grasping with Attribute-Guided Disambiguation
    Yang Yang, Xibai Lou, Changhyun Choi · 2022 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  14. End-to-end deep learning for directly estimating grape yield from ground-based imagery
    Alexander G. Olenskyj, B. Sams, Zhenghao Fei, Vishal Singh, Pranav V. Raja, Gail Michelle Bornhorst, J. Mason Earles · 2022 · Computers and Electronics in Agriculture
  15. Evolution of visual data captioning Methods, Datasets, and evaluation Metrics: A comprehensive survey
    Dhruv Sharma, Chhavi Dhiman, Dinesh Kumar · 2023 · Expert Systems with Applications
  16. AesExpert: Towards Multi-modality Foundation Model for Image Aesthetics Perception
    Yipo Huang, Xiangfei Sheng, Zhichao Yang, Quan Yuan, Zhichao Duan, Pengfei Chen, Leida Li, Weisi Lin, Guangming Shi · 2024 · ACM International Conference on Multimedia (ACM MM)
  17. Graph neural networks in vision-language image understanding: a survey
    Henry Senior, Greg Slabaugh, Shanxin Yuan, Luca Rossi · 2024 · The Visual Computer
  18. Comparative Evaluation of CNN Architectures for Image Caption Generation
    Sulabh Katiyar, Samir Kumar · 2020 · International Journal of Advanced Computer Science and Applications
  19. Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images
    Özgür Özdemir, Elena Battini Sönmez · 2021 · Journal of King Saud University - Computer and Information Sciences
  20. An accurate generation of image captions for blind people using extended convolutional atom neural network
    Tejal Tiwary, Rajendra Prasad Mahapatra · 2022 · Multimedia Tools and Applications
  21. Small object detection in diverse application landscapes: a survey
    Iqra, Kaiser Javeed Giri, Mohammed Javed · 2024 · Multimedia Tools and Applications
  22. Storyboarding of Recipes: Grounded Contextual Generation
    Khyathi Raghavi Chandu, Eric Nyberg, Alan W. Black · 2019 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  23. Boost image captioning with knowledge reasoning
    Feicheng Huang, Zhixin Li, Haiyang Wei, Canlong Zhang, Huifang Ma · 2020 · Machine Learning
  24. Joint Task and Data-Oriented Semantic Communications: A Deep Separate Source-Channel Coding Scheme
    Jianhao Huang, Dongxu Li, Chuan Zhen Huang, Xiaoqi Qin, Wei Zhang · 2023 · IEEE Internet of Things Journal
  25. Diagnostic captioning: a survey
    John Pavlopoulos, Vasiliki Kougia, Ion Androutsopoulos, Dimitris Papamichail · 2022 · Knowledge and Information Systems
  26. AOMD: An analogy-aware approach to offensive meme detection on social media
    Lanyu Shang, Yang Zhang, Yuheng Zha, Yingxi Chen, Christina Youn, Dong Wang · 2021 · Information Processing & Management
  27. A Systematic Survey of Remote Sensing Image Captioning
    Beigeng Zhao · 2021 · IEEE Access
  28. Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understanding
    Ding, Runyu, Yang, Jihan, Xue, Chuhui, Zhang, Wenqing, Bai, Song, Qi, Xiaojuan · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  29. TypeFormer: Multiscale Transformer With Type Controller for Remote Sensing Image Caption
    Zihang Chen, Junjue Wang, Ailong Ma, Yanfei Zhong · 2022 · IEEE Geoscience and Remote Sensing Letters
  30. A Review of Transformer-Based Approaches for Image Captioning
    Oscar Ondeng, Heywood Ouma Absaloms, Peter O. Akuon · 2023 · Applied Sciences
  31. Noise-Resilient Training Method for Face Landmark Generation From Speech
    Şefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan · 2019 · IEEE/ACM Transactions on Audio Speech and Language Processing
  32. Modeling feature interactions for context-aware QoS prediction of IoT services
    Yuanyi Chen, Peng Fei Yu, Zengwei Zheng, Jiaxing Shen, Minyi Guo · 2022 · Future Generation Computer Systems
  33. Improving Remote Sensing Image Captioning by Combining Grid Features and Transformer
    Shuo Zhuang, Ping Wang, Gang Wang, Di Wang, Jinyong Chen, Feng Gao · 2021 · IEEE Geoscience and Remote Sensing Letters
  34. Generate adversarial examples by adaptive moment iterative fast gradient sign method
    Jiebao Zhang, Wenhua Qian, Rencan Nie, Jinde Cao, Dan Xu · 2022 · Applied Intelligence
  35. Deep learning and knowledge graph for image/video captioning: A review of datasets, evaluation metrics, and methods
    Mohammad Saif Wajid, Hugo Terashima‐Marín, Peyman Najafirad, Mohd Anas Wajid · 2023 · Engineering Reports
  36. A systematic literature review on incomplete multimodal learning: techniques and challenges
    Yifan Zhan, Rui Yang, Junxian You, Mengjie Huang, Weibo Liu, Xiaohui Liu · 2025 · Systems Science & Control Engineering
  37. Structure-Aware Generation Network for Recipe Generation from Images
    Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao · 2020 · Lecture notes in computer science
  38. Learning Structural Representations for Recipe Generation and Food Retrieval
    Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao · 2022 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  39. From compressive sampling to compressive tasking: retrieving semantics in compressed domain with low bandwidth
    Zhihong Zhang, Bo Zhang, Xin Yuan, Siming Zheng, Xiongfei Su, Jinli Suo, David J. Brady, Qionghai Dai · 2022 · PhotoniX
  40. Deep Learning Image Captioning in Construction Management: A Feasibility Study
    Bo Xiao, Yiheng Wang, Shih-Chung Kang · 2022 · Journal of Construction Engineering and Management
  41. Controllable Data Generation by Deep Learning: A Review
    Shi-Yu Wang, Yuanqi Du, Xiaojie Guo, Bo Pan, Zhaohui Steve Qin, Liang Zhao · 2024 · ACM Computing Surveys
  42. Visual-Textual Attentive Semantic Consistency for Medical Report Generation
    Yi Zhou, Lei Huang, Tao Zhou, Huazhu Fu, Ling Shao · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  43. Emotion-Prior Awareness Network for Emotional Video Captioning
    Peipei Song, Dan Guo, Xun Yang, Shengeng Tang, Erkun Yang, Meng Wang · 2023 · ACM International Conference on Multimedia (ACM MM)
  44. Radiology report generation with medical knowledge and multilevel image-report alignment: A new method and its verification
    Guosheng Zhao, Zijian Zhao, Wuxian Gong, Feng Li · 2023 · Artificial Intelligence in Medicine
  45. Deep Representation Learning: Fundamentals, Technologies, Applications, and Open Challenges
    Amirreza Payandeh, Kourosh T. Baghaei, Pooya Fayyazsanavi, Somayeh Bakhtiari Ramezani, Zhiqian Chen, Shahram Rahimi · 2023 · IEEE Access
  46. Capformer: Pure Transformer for Remote Sensing Image Caption
    Junjue Wang, Zihang Chen, Ailong Ma, Yanfei Zhong · 2022 · IEEE International Geoscience and Remote Sensing Symposium (IGARSS)
  47. Generating Captions for Images of Ancient Artworks
    Shurong Sheng, Marie‐Francine Moens · 2019 · ACM International Conference on Multimedia (ACM MM)
  48. Image Caption Generator
    Megha J Panicker, Vikas Upadhayay, Gunjan Sethi, Vrinda Mathur · 2021 · International Journal of Innovative Technology and Exploring Engineering
  49. An encoder-decoder based framework for hindi image caption generation
    Alok Singh, Thoudam Doren Singh, Sivaji Bandyopadhyay · 2021 · Multimedia Tools and Applications
  50. Beyond Greedy Search: Tracking by Multi-Agent Reinforcement Learning-Based Beam Search
    Xiao Wang, Zhe Chen, Bo Jiang, Jin Tang, Bin Luo, Dacheng Tao · 2022 · IEEE Transactions on Image Processing
  51. Procedural Telementoring in Rural, Underdeveloped, and Austere Settings: Origins, Present Challenges, and Future Perspectives
    Juan Pablo Wachs, Andrew W. Kirkpatrick, Samuel A. Tisherman · 2021 · Annual Review of Biomedical Engineering
  52. “My Way of Telling a Story”: Persona based Grounded Story Generation
    Khyathi Raghavi Chandu, Shrimai Prabhumoye, Ruslan Salakhutdinov, Alan W. Black · 2019 · Workshop on Storytelling (StoryNLP)
  53. A review on visual content-based and users’ tags-based image annotation: methods and techniques
    Mariam Bouchakwa, Yassine Ayadi, Ikram Amous · 2020 · Multimedia Tools and Applications
  54. Multilevel attention and relation network based image captioning model
    Himanshu Sharma, Swati Srivastava · 2022 · Multimedia Tools and Applications
  55. RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning
    Riccardo Del Chiaro, Bartłomiej Twardowski, Andrew D. Bagdanov, Joost van de Weijer · 2020 · arXiv (Cornell University)
  56. Point cloud registration considering safety nets during scaffold installation using sensor fusion and deep learning
    Kim, Juhyeon, Kim, Jeehoon, Paik, Sunwoong, Kim, Hyoungkwan · 2024 · Automation in Construction
  57. Vision Relation Transformer for Unbiased Scene Graph Generation
    Gopika Sudhakaran, Devendra Singh Dhami, Kristian Kersting B, Stefan Roth · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  58. Utilizing Deep improved ResNet50 for Brain Tumor Classification Based MRI
    Karrar Neamah, Farhan Mohamed, Safa Riyadh Waheed, Waleed Hadi Madhloom Kurdi, Adil Yaseen Taha, Karrar Abdulameer Kadhim · 2024 · IEEE Open Journal of the Computer Society
  59. An ensemble model with attention based mechanism for image captioning
    Israa Albadarneh, BASSAM H. HAMMO, Omar S. Al-Kadi · 2025 · Computers & Electrical Engineering
  60. ACORT: A compact object relation transformer for parameter efficient image captioning
    Jia Huei Tan, Ying Hua Tan, Chee Seng Chan, Joon Huang Chuah · 2022 · Neurocomputing
  61. Attention-based global and local spatial-temporal graph convolutional network for vehicle emission prediction
    Xihong Fei, Qiang Ling · 2022 · Neurocomputing
  62. CheXReport: A transformer-based architecture to generate chest X-ray reports suggestions
    Felipe André Zeiser, Cristiano André da Costa, Gabriel de Oliveira Ramos, Andreas Maier, Rodrigo da Rosa Righi · 2024 · Expert Systems with Applications
  63. IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-Training
    Che Liu, Sibo Lucas Cheng, Miaojing Shi, Anand Shah, Wenjia Bai, Rossella Arcucci · 2024 · IEEE Transactions on Medical Imaging
  64. CILP-FGDI: Exploiting Vision-Language Model for Generalizable Person Re-Identification
    Huazhong Zhao, Lei Qi, Xin Geng · 2025 · IEEE Transactions on Information Forensics and Security
  65. Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation
    Israa Albadarneh, BASSAM H. HAMMO, Omar S. Al-Kadi · 2025 · Computer Science Review
  66. Cross Modal Compression
    Jiguo Li, Chuanmin Jia, Xinfeng Zhang, Siwei Ma, Wen Gao · 2021 · ACM International Conference on Multimedia (ACM MM)
  67. Automated Image Captioning Using Sparrow Search Algorithm With Improved Deep Learning Model
    Munya A. Arasi, Haya Mesfer Alshahrani, Nuha Mohammed Alruwais, Abdelwahed Motwakel, Noura Abdelaziz Ahmed, Abdullah Mohamed · 2023 · IEEE Access
  68. A System for a Real-Time Electronic Component Detection and Classification on a Conveyor Belt
    Dainius Varna, Vytautas Abromavičius · 2022 · Applied Sciences
  69. A review of emerging research directions in Abstract Visual Reasoning
    Mikołaj Małkiński, Jacek Mańdziuk · 2022 · Information Fusion
  70. Attention Mechanism Architecture for Arabic Sentiment Analysis
    Mohamed Berrimi, Mourad Oussalah, Abdelouahab Moussaouı, Mohamed Saidi · 2022 · ACM Transactions on Asian and Low-Resource Language Information Processing
  71. Gender Artifacts in Visual Datasets
    Nicole Meister, Dora Zhao, Angelina Wang, V. Ramaswamy, Ruth Fong, Olga Russakovsky · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  72. Neural Language Generation: Formulation, Methods, and Evaluation
    Cristina Gârbacea, Qiaozhu Mei · 2020 · arXiv (Cornell University)
  73. VGG Models in Image Captioning: Which Architecture Delivers Better Descriptions?
    Ahmad Maaz, Shaheer Abbas, Raja Hashim Ali, Iftikhar Ahmed, Talha Ali Khan · 2024 · International Conference on Open Source Systems and Technologies (ICOSST)
  74. Photonic Switched Optically Connected Memory: An Approach to Address Memory Challenges in Deep Learning
    Ziyi Zhu, Giuseppe Di Guglielmo, Qixiang Cheng, Madeleine Strom Glick, Jihye Kwon, Hang Guan, Luca P. Carloni, K. Bergman · 2020 · Journal of Lightwave Technology
  75. End-to-End Supermask Pruning: Learning to Prune Image Captioning Models
    Jia Huei Tan, Chee Seng Chan, Joon Huang Chuah · 2021 · Pattern Recognition
  76. “So What? What's That to Do With Me?” Expectations of People With Visual Impairments for Image Descriptions in Their Personal Photo Activities
    Ju Yeon Jung, Tom Steinberger, Junbeom Kim, Mark Steven Ackerman · 2022 · Designing Interactive Systems Conference
  77. Function Call Graph Context Encoding for Neural Source Code Summarization
    Aakash Bansal, Zachary Eberhart, Zachary Karas, Yu Huang, Collin McMillan · 2023 · IEEE Transactions on Software Engineering
  78. An Investigation of Applying Large Language Models to Spoken Language Learning
    Yingming Gao, Baorian Nuchged, Ya Li, Linkai Peng · 2023 · Applied Sciences
  79. Evolution of automatic visual description techniques-a methodological survey
    Arka Bhowmik, Sanjay Kumar, Neeraj Bhat · 2021 · Multimedia Tools and Applications
  80. Similar Scenes Arouse Similar Emotions
    Guodun Li, Yuchen Zhai, Zehao Lin, Yin Zhang⋆ · 2021 · ACM International Conference on Multimedia (ACM MM)
  81. Dimensionality Reduction of Human Gait for Prosthetic Control
    David A. Boe, Alexandra A. Portnova-Fahreeva, Abhishek Sharma, Vijeth Rai, Astrini Sie, Pornthep Preechayasomboon, Eric Rombokas · 2021 · Frontiers in Bioengineering and Biotechnology
  82. TFUN: Trilinear Fusion Network for Ternary Image-Text Retrieval
    Xing Xu, Jialiang Sun, Zuo Cao, Yin Zhang, Xiaofeng Zhu, Heng Tao Shen · 2022 · Information Fusion
  83. Bi-LS-AttM: A Bidirectional LSTM and Attention Mechanism Model for Improving Image Captioning
    Tian Xie, Weiping Ding, Jinbao Zhang, Xusen Wan, Jiehua Wang · 2023 · Applied Sciences
  84. Zero-Shot Referring Expression Comprehension via Structural Similarity Between Images and Captions
    Zeyu Han, Fangrui Zhu, Qianru Lao, Huaizu Jiang · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  85. VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models
    Jiawei Liang, Siyuan Liang, Aishan Liu, Xiaochun Cao · 2025 · International Journal of Computer Vision
  86. Deep generative cross-modal on-body accelerometer data synthesis from videos
    Shibo Zhang, Nabil I. Alshurafa · 2020 · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)
  87. MICER: a pre-trained encoder–decoder architecture for molecular image captioning
    Jiacai Yi, Chengkun Wu, Xiaochen Zhang, Xinyi Xiao, Yanlong Qiu, Wentao Zhao, Tingjun Hou, Dongsheng Cao · 2022 · Bioinformatics
  88. Understanding image-text relations and news values for multimodal news analysis
    Gullal S. Cheema, Sherzod Hakimov, Eric Müller-Budack, Christian Otto, John A. Bateman, Ralph Ewerth · 2023 · Frontiers in Artificial Intelligence
  89. Image captioning using transformer-based double attention network
    Hashem Parvin, Ahmad Reza Naghsh‐Nilchi, Hossein Mahvash Mohammadi · 2023 · Engineering Applications of Artificial Intelligence
  90. A Comprehensive Survey of 3D Dense Captioning: Localizing and Describing Objects in 3D Scenes
    Ting Yu, Xiaojun Lin, Shuhui Wang, Weiguo Sheng, Qingming Huang, Jun Yu · 2023 · IEEE Transactions on Circuits and Systems for Video Technology
  91. A Black-Box Attack on Neural Networks Based on Swarm Evolutionary Algorithm
    Xiaolei Liu, Teng Hu, Kangyi Ding, Yang Bai, Weina Niu, Jiazhong Lu · 2020 · Lecture notes in computer science
  92. What Makes Disinformation Ads Engaging? A Case Study of Facebook Ads from the Russian Active Measures Campaign
    Mirela Silva, Luiz Giovanini, Juliana Fernandes, Daniela Seabra Oliveira, Catia S. Silva · 2023 · Journal of Interactive Advertising
  93. Adaptive Attention-based High-level Semantic Introduction for Image Caption
    Xiaoxiao Liu, Qingyang Xu · 2020 · ACM Transactions on Multimedia Computing Communications and Applications
  94. Show, tell and summarise: learning to generate and summarise radiology findings from medical images
    Sonit Singh, Sarvnaz Karimi, Kevin Ho‐Shon, Len Hamey · 2021 · Neural Computing and Applications
  95. AraCap: A hybrid deep learning architecture for Arabic Image Captioning
    Imad Afyouni, Imtinan Azhar, Ashraf Elnagar · 2021 · Procedia Computer Science
  96. ABC-Net: a divide-and-conquer based deep learning architecture for SMILES recognition from molecular images
    Xiao-Chen Zhang, Jiacai Yi, Guoping Yang, Chengkun Wu, Tingjun Hou, Dongsheng Cao · 2022 · Briefings in Bioinformatics
  97. Modeling graph-structured contexts for image captioning
    Zhixin Li, Jiahui Wei, Feicheng Huang, Huifang Ma · 2022 · Image and Vision Computing
  98. An improved CNN model in image classification application on water turbidity
    Ying Nie, Yuqiang Chen, Jianlan Guo, Shufei Li, Yu Xiao, Wendong Gong, Ruirong Lan · 2025 · Scientific Reports
  99. UIT-ViIC: A Dataset for the First Evaluation on Vietnamese Image Captioning
    Quan Hoang Lam, Quang Duy Le, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen · 2020 · Lecture notes in computer science
  100. An Extensive Study on Deep Learning: Techniques, Applications
    Ruchi Mittal, Shefali Arora, Varsha Bansal, M. P. S. Bhatia · 2021 · Archives of Computational Methods in Engineering