MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models

UMASS_BioNLP at MEDIQA-Chat 2023: Can LLMs generate high-quality synthetic note-oriented doctor-patient conversations?

Wang, J., Yao, Z., Mitra, A., Osebe, S., Yang, Z., & Yu, H. Q. (2023) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2023.clinicalnlp-1.49 · Cited by 15

InstructPLM: Aligning Protein Language Models to Follow Protein Structure InstructionsPreprint

Qiu, J., Xu, J., Hu, J., Cao, H., Hou, L., Gao, Z.-J., Zhou, X., Li, A., Li, X., Cui, B., et al. (2024) · Research Square · doi:10.1101/2024.04.17.589642 · Cited by 10

AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model

Moon, S., Madotto, A., Lin, Z., Nagarajan, T., Smith, M., Jain, S., Yeh, C.-F., Murugesan, P., Heidari, P., Liu, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.16058 · Cited by 7

A comparative analysis of encoder only and decoder only models for challenging LLM-generated STEM MCQs using a self-evaluation approach

Soliman, G., Zaki, H., & Kilany, M. (2025) · Natural Language Processing Journal · doi:10.1016/j.nlp.2025.100131 · Cited by 13

A novel and scalable multimodal large language model architecture Tool-MMGPT for future tool wear prediction in titanium alloy high-speed milling processes

Hao, C., Wang, Z., Mao, X., He, S., Li, B., Liu, H., Peng, F., & Li, W. (2025) · Computers in Industry · doi:10.1016/j.compind.2025.104302 · Cited by 7

GeoFactory: an LLM performance enhancement framework for geoscience factual and inferential tasks

Chen, Z., Wang, X., Zhang, X., Lin, M., Liao, Y., Li, J., & Bai, Y. (2025) · Big Earth Data · doi:10.1080/20964471.2025.2506291 · Cited by 8

Distributed VLMs: Efficient Vision-Language Processing through Cloud-Edge Collaboration

Li, Y., Gumaste, D., Türkcan, M. K., Ghaderi, J., Zussman, G., & Kostić, Z. (2025) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops65533.2025.00078 · Cited by 8

Clothing Purification with Causality Meets Vision-Language Pretraining Models

Yang, Z., Zhu, H., Lei, N., Fernando, B., & Wang, Z. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02548-7 · Cited by 8

Simple Token-Level Confidence Improves Caption Correctness

Petryk, S., Whitehead, S., Gonzalez, J. E., Darrell, T., Rohrbach, A., & Rohrbach, M. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00564 · Cited by 8

Spindle: Efficient Distributed Training of Multi-Task Large Models via Wavefront Scheduling

Wang, Y. X., Zhu, S., Fu, F., Miao, X., Zhang, J., Zhu, J. F., Hong, F., Li, Y., & Cui, B. (2025) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3676641.3715992 · Cited by 13

Alignment and Generation Adapter for Efficient Video-text Understanding

Fang, H., Yang, Z., Wei, Y., Zang, X., Ban, C., Feng, Z., He, Z., Li, Y., & Sun, H. S. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00296 · Cited by 7

PathVLM-Eval: Evaluation of open vision language models in histopathology

Gilal, N. U., Zegour, R., Al-Thelaya, K., Özer, E., Agus, M., Schneider, J., & Boughorbel, S. (2025) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2025.100455 · Cited by 7

Causal-CoG: A Causal-Effect Look at Context Generation for Boosting Multi-Modal Language Models

Zhao, S., Li, Z., Lu, Y., Yuille, A., & Wang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01267 · Cited by 11

RMP-adapter: A region-based Multiple Prompt Adapter for multi-concept customization in text-to-image diffusion model

Jiang, Z., Po, L.-M., Xu, X., Wang, Y., Wu, H., Liu, Y., & Li, K. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126936 · Cited by 6

Prospects and technology of embodied intelligent humanoid robots driven by AI large models

Kai, Z. E. N. G., Wang, Y., Tan, H., Fang, Q., Wang, Y., & Yuan, L. (2025) · Scientia Sinica Informationis · doi:10.1360/ssi-2024-0350 · Cited by 6

ChatIOS: Improving automatic 3-dimensional tooth segmentation via GPT-4V and multimodal pre-training

Wu, Y., Zhang, Y., Wu, Y., Zheng, Q., Li, X., & Chen, X. (2025) · Journal of Dentistry · doi:10.1016/j.jdent.2025.105755 · Cited by 8

Cross-attention fusion of graph and MLLM for social relation recognition

Tang, W., Qing, L., Wang, P., Li, L., & Peng, Y. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103259 · Cited by 8

Multi-objective generative design of three-dimensional material structures

Zhang, Z., Fang, H., Zhao, X., Lv, J., Shen, Y., & Wang, Y. (2023) · APL Machine Learning · doi:10.1063/5.0169432 · Cited by 7

Learn How to See: Collaborative Embodied Learning for Object Detection and Camera Adjusting

Shen, L., Huo, C., Xu, N., Han, C., & Wang, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28281 · Cited by 7

LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction

Zou, B., Yang, C., Qiao, Y., Quan, C., & Zhao, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01336 · Cited by 7

See or Guess: Counterfactually Regularized Image Captioning

Cao, Q., Chen, X., Song, R., Wang, X., Huang, X., & Ren, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681458 · Cited by 6

MMInstruct: a high-quality multi-modal instruction tuning dataset with extensive diversity

Liu, Y., Cao, Y. Q., Gao, Z., Wang, W., Chen, Z., Wang, W., Tian, H., Lu, L., Zhu, X., Lu, T., et al. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4187-3 · Cited by 34

Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks

Hossain, M. Z., & Imteaj, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825099 · Cited by 18

Large Language Models for Video Surveillance Applications

Silva, U. D., Fernando, L., Lau, B. P. L., Koh, Z., Joyce, S. C., Yuen, B., & Yuen, C. (2024) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon61640.2024.10902892 · Cited by 7

KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation Without Robot Data

Tang, G., Rajkumar, S., Zhou, Y., Walke, H., Levine, S., & Fang, K. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128156 · Cited by 13

Gender Biases in Automatic Evaluation Metrics for Image Captioning

Qiu, H., Dou, Z.-Y., Wang, T., Çelikyılmaz, A., & Peng, N. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.520 · Cited by 12

Collaborative Multimodal Diagnostic: Fusion of Pathological Labels and Vision-Language Model

Chen, W., Li, Y., Ou, B., & Tan, P. (2023) · International Conference on Health Big Data and Intelligent Healthcare (ICHIH) · doi:10.1109/ichih60370.2023.10396187 · Cited by 6

ChatFFA: Interactive Visual Question Answering on Fundus Fluorescein Angiography Image Using ChatGPTPreprint

Chen, X., Xu, P., Li, Y., Zhang, W., Song, F., Zheng, Y., Shi, D., & He, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4578568 · Cited by 6

Large language model-based planning agent with generative memory strengthens performance in textualized world

Liu, J., Hao, W., Cheng, K., & Jin, D. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110319 · Cited by 5

DocRouter: Prompt guided vision transformer and Mixture of Experts connector for document understanding

Zhang, J., & Zhang, Y. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103206 · Cited by 6

Vision-Language Model-Based Local Interpretable Model-Agnostic Explanations Analysis for Explainable In-Vehicle Controller Area Network Intrusion Detection

Lee, J.-H., & Rew, J. (2025) · Sensors · doi:10.3390/s25103020 · Cited by 9

Image-point cloud embedding network for simultaneous image-based farmland instance extraction and point cloud-based semantic segmentation

Li, J., Li, Y., Zhang, S., & Chen, Y. (2025) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2025.104361 · Cited by 5

Aesthetic multi-attributes network for image captioning

Yang, H., Li, Y., Jin, X., Zhou, X., Ping, S., & Liu, Y. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110103 · Cited by 6

VCF: An effective Vision-Centric Framework for Visual Question Answering

Wang, F., Peng, L., Cao, S., Yang, Z., Zhang, R., & An, G. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129536 · Cited by 5

M2C: Towards Automatic Multimodal Manga Complement

Guo, H., Wang, B., Bai, J., Liu, J., Yang, J., & Li, Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.661 · Cited by 7

TransMI: a transfer-learning method for generalized map information evaluation

Wang, C., Chen, T., Liu, Y., Kang, M., Su, S., & Li, B. (2024) · Cartography and Geographic Information Science · doi:10.1080/15230406.2024.2306827 · Cited by 5

Visually Dehallucinative Instruction Generation

Cha, S., Lee, J., Lee, Y., & Yang, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446658 · Cited by 5

PatFig: Generating Short and Long Captions for Patent Figures

Aubakirova, D., Gerdes, K., & Liu, L. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00305 · Cited by 7

Large Language Models:Expectations for Semantics-Driven Systems EngineeringPreprint

Buchmann, R. A., Eder, J., Fill, H.-G., Frank, U., Karagiannis, D., Laurenzi, E., Mylopoulis, J., Plexousakis, D., & Santos, M. Y. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4633719 · Cited by 5

A Comprehensive Evaluation of Multimodal Large Language Models in Hydrological ApplicationsPreprint

Kadiyala, L., Mermer, O., Samuel, R. D. J., Sermet, Y., & Demir, İ. (2024) · doi:10.31223/x5tq37 · Cited by 5

Grounding-IQA: Multimodal Language Grounding Model for Image Quality AssessmentPreprint

Chen, Z., & Zhang, Y. (2024) · Qeios · doi:10.32388/074nkv · Cited by 8

Pedestrian Intention Prediction via Vision-Language Foundation Models

Azarmi, M., Rezaei, M., & Wang, H. (2025) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv64158.2025.11097349 · Cited by 4

HiProbe-VAD: Video Anomaly Detection via Hidden States Probing in Tuning-Free Multimodal LLMs

Cai, Z., Li, F., Zheng, Z., & Qin, Y. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755575 · Cited by 9

View-Based Knowledge-Augmented Multimodal Semantic Understanding for Optical Remote Sensing Images

Zhu, L., Su, X., Tang, J., Hu, Y., & Wang, Y. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3532349 · Cited by 5

Jailbreaking large language models: models, origins, and evolution of attacks and defenses

Li, X. H., Wu, J., Zheng, Q., Wang, H., Fan, M. Y., Hu, S., Guo, J., & Ting, L. I. U. (2025) · Scientia Sinica Informationis · doi:10.1360/ssi-2024-0196 · Cited by 4

Global Structure Knowledge-Guided Relation Extraction Method for Visually-Rich Document

Chen, X., Xiao, Q., Li, J., Dong, D., Lin, J., Liu, X., & Tang, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.107 · Cited by 4

Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Models

Kim, G., Lee, H., Kim, D., Jung, H., Park, S., Kim, Y., Yun, S., Kil, T., Lee, B., & Park, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.735 · Cited by 12

Keep Knowledge in Perception: Zero-Shot Image Aesthetic Assessment

Wang, G., Tan, Y., Lin, H., & Zhang, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447301 · Cited by 4

A Sound Approach: Using Large Language Models to Generate Audio Descriptions for Egocentric Text-Audio Retrieval

Oncescu, A.-M., Henriques, J. F., Zisserman, A., Albanie, S., & Koepke, A. S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448486 · Cited by 8

Tackling Vision Language Tasks through Learning Inner Monologues

Yang, D., Chen, K., Rao, J., Guo, X., Zhang, Y., Yang, J., & Zhang, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29905 · Cited by 8

Detect2Interact: Localizing Object Key Field in Visual Question Answering with LLMs

Wang, J., Zhu, M., Li, Y., Li, H., Yang, L., & Woo, W. L. (2024) · IEEE Intelligent Systems · doi:10.1109/mis.2024.3384513 · Cited by 4

Enabling action crossmodality for a pretrained large language model

Caesar, A., Özdemir, O., Weber, C., & Wermter, S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100072 · Cited by 5

LLM-SAP: Large Language Models Situational Awareness-Based Planning

Wang, L., & Zhong, H. (2024) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew63481.2024.10645429 · Cited by 7

Learning by Correction: Efficient Tuning Task for Zero-Shot Generative Vision-Language Reasoning

Li, R., Wu, Y., & He, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01275 · Cited by 5

3DToonify: Creating Your High-Fidelity 3D Stylized Avatar Easily from 2D Portrait Images

Men, Y., Liu, H., Yao, Y., Cui, M., Xie, X., & Lian, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00965 · Cited by 4

Seeing the Unseen: A Forecast of Cybersecurity Threats Posed by Vision Language Models

Taeb, M., Wang, J., Weatherspoon, M. H., Bernadin, S., & Chi, H. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825034 · Cited by 4

Multimodal understanding of human values in videos: A benchmark dataset and PLM-based method

Wang, Y., Tao, Z., He, C., Huang, N., Jin, L., & Luo, X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130170 · Cited by 4

ReSee: Responding through Seeing Fine-grained Visual Knowledge in Open-domain Dialogue

Tu, H., Li, Y., Mi, F., & Yang, Z. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.479 · Cited by 6

A multi-modal vision-language pipeline strategy for contour quality assurance and adaptive optimization

Luan, S., Ouyang, J., Yang, X., Wei, W., Xue, X., & Zhu, B. (2024) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ad2a97 · Cited by 4

SC- Tune: Unleashing Self-Consistent Referential Comprehension in Large Vision Language Models

Yue, T., Cheng, J. Z., Guo, L., Dai, X., Zhao, Z., He, X., Xiong, G., Lv, Y., & Liu, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01242 · Cited by 10

LLM-MHR: A LLM-Augmented Multimodal Hashtag Recommendation Algorithm

Tan, Z., Li, Y., Yuan, X., Meng, S., Li, W., & Mo, T. (2024) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws62655.2024.00100 · Cited by 5

A Multimodal Large Language Model for Forestry in pest and disease recognitionPreprint

Zhang, M., Li, X., Du, Y., Rao, Z., Chen, S., Wang, W., Chen, X., Huang, D., & Wang, S. (2023) · Research Square · doi:10.21203/rs.3.rs-3444472/v1 · Cited by 5

Skin disease diagnosis using deep neural network and large language model

Xia, D. (2023) · doi:10.32657/10356/172895 · Cited by 5

Large Vision-Language Model Alignment and Misalignment: A Survey Through the Lens of ExplainabilityPreprint

Shu, D., Zhao, H., Hu, J., Liu, W., Lu, C. Y., & Du, M. (2025) · Qeios · doi:10.32388/ooam1q · Cited by 4

Mitigating Hallucinations in Vision-Language Models through Image-Guided Head Suppression

Sarkar, S., Che, Y., Gavin, A., Beerel, P. A., & Kundu, S. (2025) · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2025.emnlp-main.631 · Cited by 4

Unveiling the Lack of LVLM Robustness to Fundamental Visual Variations: Why and Path Forward

Fan, Z., Wang, Y., Polisetty, S., & Fung, Y. R. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.1037 · Cited by 4

SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics

Shukor, M., Aubakirova, D., Capuano, F., Kooijmans, P., Palma, S., Zouitine, A., Aractingi, M., Pascal, C., Russi, M., Marafioti, A., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.01844 · Cited by 695

Prompting Robotic Modalities (PRM): A structured architecture for centralizing language models in complex systems

Benjdira, B., Koubâa, A., & Ali, A. M. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.107723 · Cited by 5

Fine-tune language models as multi-modal differential equation solvers

Yang, L., Liu, S., & Osher, S. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107455 · Cited by 35

VisualRWKV-HM: Enhancing linear visual-language models via hybrid mixing

Hou, H., Ma, F., Li, Z., & Yu, F. R. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103336 · Cited by 3

Large Language Models for the National Radiological Technologist Licensure Examination in Japan: Cross-Sectional Comparative Benchmarking and Evaluation of Model-Generated Items Study

Ito, T., Ishibashi, T., Hayashi, T., Kojima, S., & Sogabe, K. (2025) · JMIR Medical Education · doi:10.2196/81807 · Cited by 3

Automatic medical report generation: a comprehensive review of methodologies and applications

Yan, T., He, H. W., Chan, I. N., Qin, Y. Y., Li, Z., & Wong, P. K. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3474 · Cited by 3

Privacy-preserving cloud-based dermatological image processing for medical applications: a review

Chen, S., Zhang, X., Liu, E., Xiong, Y., Wang, L., Gu, X., Wang, Z., Guo, J., & Luo, T. (2026) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-026-00886-6 · Cited by 4

Multitask Multimodal Prompted Training for Interactive Embodied Task Completion

Πανταζόπουλος, Γ., Nikandrou, M., Parekh, A., Hemanthage, B., Eshghi, A., Konstas, I., Rieser, V., Lemon, O., & Suglia, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.50 · Cited by 7

Knowledge Generation Pipeline using LLM for Building 3D Object Knowledge Base

Lee, S., Lee, H., & Lee, K. (2023) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc58733.2023.10392933 · Cited by 3

Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant for Semiconductor Electron Micrograph Analysis

Sakhinana, S. S., Sannidhi, G., & Runkana, V. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v3i1.31205 · Cited by 3

PILL: Plug into LLM with adapter expert and attention gate

Yin, Y., Zhang, F., Wu, Z., Qiu, Q., Liang, T., & Zhang, X. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.112115 · Cited by 6

Identifying the Information Gap for Visually Impaired Students during Lecture Talks

Anderer, K., Wölfel, M., & Niehues, J. (2024) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc60511.2024.00027 · Cited by 3

SCREEN: A Benchmark for Situated Conversational Recommendation

Lin, D., Wang, J., Leong, C. T., & Li, W. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681651 · Cited by 3

Enhancing pixel-level analysis in medical imaging through visual instruction tuning: introducing PLAMi

Bai, M., Yu, X., Wang, Y., Chen, J., Zhang, X., & Lyu, P. (2024) · The Visual Computer · doi:10.1007/s00371-024-03742-3 · Cited by 3

3D-METRO: Deploy Large-Scale Transformer Model on A Chip Using Transistor-Less 3D-Metal-ROM-Based Compute-in-Memory Macro

Chen, Y., Du, X., Yin, G., Tang, W., Liu, Y., Yang, H., & Li, X. (2025) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1145/3658617.3697570 · Cited by 3

Automatic granary sweeping strategy using visual large language model

Zhang, B., Yan, J., Gao, Y., Yang, G., Zhang, K., & Li, J. (2025) · Journal of Stored Products Research · doi:10.1016/j.jspr.2025.102619 · Cited by 3

AnDR-BLIP2: enhanced semantic understanding framework for industrial image anomaly detection and report generation

Gao, Z., Guo, J., Chen, L., Wang, K., Chen, Y., Ke, Y., & Yang, S. (2025) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2025.107816 · Cited by 5

A Transformer-LSTM-SVR hybrid model for AI-driven emotional optimization in NEV embedded interior systems

Liu, Z., Chen, X., Liang, X., Sun, Z., Yang, F., Ou, W., Li, L., & Qin, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-15808-w · Cited by 3

MODE: a multimodal open-domain dialogue dataset with explanation

Yin, H., Lu, P., Li, Z., Sun, B., & Li, K. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05479-x · Cited by 3

Multi-Modal Large Language Model Enhanced Pseudo 3D Perception Framework for Visual Commonsense Reasoning

Zhu, J., Wang, H., & Shi, M. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3428487 · Cited by 3

Exploring Foundation Models in Detecting Concerning Daily Functioning in Psychotherapeutic Context Based on Images from Smart Home Devices

Fan, Y., Nie, J., Sun, X., & Jiang, X. (2024) · doi:10.1109/fmsys62467.2024.00012 · Cited by 3

Towards Unified Interactive Visual Grounding in The Wild

Xu, J., Zhang, H., Si, Q., Li, Y., Lan, X., & Kong, T. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611354 · Cited by 4

Improving Accuracy and Generalizability via Multi-Modal Large Language Models Collaboration

Zhang, S., Mu, H., & Liu, T. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651475 · Cited by 3

Multimodal Transformer for Comics Text-Cloze

Vivoli, E., Baeza, J. L., Valveny, E., & Karatzas, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70552-6_8 · Cited by 5

Knowledge Distillation in Mixture of Experts for Multi-Modal Medical LLMs

Nathani, M., Soni, R., & Mishra, R. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825733 · Cited by 3

Defeasible Visual Entailment: Benchmark, Evaluator, and Reward-Driven Optimization

Zhang, Y., Jing, L., & Gogate, V. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i24.34792 · Cited by 6

KnowComp Submission for WMT23 Sign Language Translation Task

Xu, B., Shi, H., Zheng, T., Zong, Q., Wang, W., Wang, Z., & Song, Y. (2023) · Conference on Machine Translation (WMT) · doi:10.18653/v1/2023.wmt-1.36 · Cited by 3

Can Large Language Models Extract Customer Needs as well as Professional Analysts?Preprint

Timoshenko, A., Mao, C., & Hauser, J. R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5167493 · Cited by 4

Computer-assisted qualitative visual analysis: Automating thematic analysis of images

Guinibert, M. (2022) · Interactions · doi:10.1386/iscc_00058_1

Large multimodal model for zero-shot scene classification of high spatial resolution remote sensing images

Chen, X., Zheng, M., Liu, B., Zhang, Y., Chen, C., & Zhang, P. (2025) · Remote Sensing Letters · doi:10.1080/2150704x.2025.2470879 · Cited by 2

Quantum-inspired multimodal fusion with Lindblad master equation for sentiment analysis

Yan, K., Lai, P., Yang, Y., Ren, Y., Badarch, T., Chen, Y., & Zheng, X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130710 · Cited by 3

ImagePrompt: Image-enhanced prompt-tuning for multimodal relation extraction

Zhang, R., Hu, Y., Liu, T., & Cao, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131264 · Cited by 2

Evaluation of Multimodal Image and Text Processing Models from an Uncertainty Perspective

Kostyumov, V., Nutfullin, B., & Pilipenko, O. G. (2025) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661825700166 · Cited by 47

A deep learning based automatic report generator for retinal optical coherence tomography images

Chen, X., Fu, H., Wang, J., Lin, T., Cheng, Q., Li, C., Wang, M., Chen, Z., Lin, A., Zhang, A., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01988-2 · Cited by 3

VisionLingua: Empowering Multimodal Understanding with Cutting-Edge Language Models

Kamboj, D., Gola, K. K., & Arya, S. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-83796-8_4

Mini-Gemini: Mining the Potential of Multi-Modality Vision Language Models

Li, Y., Zhang, Y., Wang, C., Zhong, Z., Chen, Y., Chu, R., Liu, S., & Jia, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3637265 · Cited by 415

The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)Preprint

Yang, Z., Li, L., Lin, K., Wang, J., Lin, C.-C., Liu, Z., & Wang, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.17421 · Cited by 883

MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens

Zheng, K., He, X., & Wang, X. E. (2023) · arXiv · doi:10.48550/arxiv.2310.02239 · Cited by 15

Interleaved Vision-and-Language Generation via Generative Voken

Zheng, K., He, X., & Wang, X. E. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00054 · Cited by 127