CoChat

Quality Assessment in the Era of Large Models: A Survey

Open access
Zhang, Zicheng, Zhou, Yingjie, Li, Chunyi, Zhao, Baixuan, Liu, Xiaohong, Zhai, Guangtao · 2025 · ACM Transactions on Multimedia Computing, Communications, and Applications

The DOI matches its Crossref record; 165 of the 194 references it cites were found in a registry or an index, and 29 are not checked yet.

Abstract

Quality assessment, which evaluates the visual quality level of multimedia experiences, has garnered significant attention from researchers and has evolved substantially through dedicated efforts. Before the advent of large models, quality assessment typically relied on small expert models tailored for specific tasks. While these smaller models are effective at handling their designated tasks and predicting quality levels, they often lack explainability and robustness. With the advancement of large models, which align more closely with human cognitive and perceptual processes, many researchers are now leveraging the prior knowledge embedded in these large models for quality assessment tasks. This emergence of quality assessment within the context of large models motivates us to provide a comprehensive review focusing on two key aspects: (1) the assessment of large models and (2) the role of large models in assessment tasks. We begin by reflecting on the historical development of quality assessment. Subsequently, we move to detailed discussions of related works concerning quality assessment in the era of large models. Finally, we offer insights into the future progression and potential pathways for quality assessment in this new era. We hope that this survey will enable a rapid understanding of the development of quality assessment in the era of large models and inspire further advancements in the field.

Overview

Integrity signals

Registry

Crossref · 10.1145/3722559

Cites

165 of 194 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 194 references

Research works printed but not linked: 81

  1. Lorenzo Agnolucci Leonardo Galteri and Marco Bertini. 2024. Quality-aware image-text alignment for real-world image quality assessment. arXiv:2403.11176. Retrieved from https://arxiv.org/abs/2403.11176 · arXiv
  2. Evangelos Alexiou and Touradj Ebrahimi. 2017. On the performance of metrics to predict quality in point cloud representations. In Applications of Digital Image Processing XL 10396. SPIE, 282–297.
  3. 10.1109/icme.2018.8486512 · doi:10.1109/icme.2018.8486512
  4. 10.1109/qomex.2018.8463406 · doi:10.1109/qomex.2018.8463406
  5. Anas Awadalla Irena Gao Josh Gardner Jack Hessel Yusuf Hanafy Wanrong Zhu Kalyani Marathe Yonatan Bitton Samir Gadre Shiori Sagawa et al. 2023. Openflamingo: An open-source framework for training large autoregressive vision-language models. arXiv:2308.01390. Retrieved from https://arxiv.org/abs/2308.01390 · arXiv
  6. Rizhao Cai Zirui Song Dayan Guan Zhenhao Chen Xing Luo Chenyu Yi and Alex Kot. 2023. BenchLMM: Benchmarking cross-style visual capability of large multimodal models. arXiv:2312.02896. Retrieved from https://arxiv.org/abs/2312.02896 · arXiv
  7. Keqin Chen Zhao Zhang Weili Zeng Richong Zhang Feng Zhu and Rui Zhao. 2023. Shikra: Unleashing multimodal LLM’s referential dialogue magic. arXiv:2306.15195. Retrieved from https://arxiv.org/abs/2306.15195 · arXiv
  8. Zijian Chen Wei Sun Haoning Wu Zicheng Zhang Jun Jia Xiongkuo Min Guangtao Zhai and Wenjun Zhang. 2023. Exploring the naturalness of AI-generated images. arXiv:2312.05476. Retrieved from https://arxiv.org/abs/2312.05476 · arXiv
  9. Iya Chivileva Philip Lynch Tomas E. Ward and Alan F. Smeaton. 2023. Measuring the quality of text-to-video model outputs: Metrics and dataset. arXiv:2309.08009. Retrieved from https://arxiv.org/abs/2309.08009 · arXiv
  10. Wenliang Dai Junnan Li Dongxu Li Anthony Meng Huat Tiong Junqi Zhao Weisheng Wang Boyang Li Pascale Fung and Steven Hoi. 2023. InstructBLIP: Towards general-purpose vision-language models with instruction tuning. arXiv:2305.06500. Retrieved from https://arxiv.org/abs/2305.06500 · arXiv
  11. 10.21227/hp84-8m05 · doi:10.21227/hp84-8m05
  12. Chaoyou Fu Peixian Chen Yunhang Shen Yulei Qin Mengdan Zhang Xu Lin Zhenyu Qiu Wei Lin Jinrui Yang Xiawu Zheng et al. 2023. MME: A comprehensive evaluation benchmark for multimodal large language models. arXiv:2306.13394. Retrieved from https://arxiv.org/abs/2306.13394 · arXiv
  13. Peng Gao Jiaming Han Renrui Zhang Ziyi Lin Shijie Geng Aojun Zhou Wei Zhang Pan Lu Conghui He Xiangyu Yue et al. 2023. LLaMA-Adapter V2: Parameter-efficient visual instruction model. arXiv:2304.15010. Retrieved from https://arxiv.org/abs/2304.15010 · arXiv
  14. Wentao Ge Shunian Chen Guiming Chen Junying Chen Zhihong Chen Shuo Yan Chenghao Zhu Ziyue Lin Wenya Xie Xidong Wang et al. 2023. Mllm-bench evaluating multi-modal llms using gpt-4v. arXiv:2311.13951. Retrieved from https://arxiv.org/abs/2311.13951 · arXiv
  15. Jiaxi Gu Shicong Wang Haoyu Zhao Tianyi Lu Xing Zhang Zuxuan Wu Songcen Xu Wei Zhang Yu-Gang Jiang and Hang Xu. 2023. Reuse and diffuse: Iterative denoising for text-to-video generation. arXiv:2309.03549. Retrieved from https://arxiv.org/abs/2309.03549 · arXiv
  16. Yuwei Guo Ceyuan Yang Anyi Rao Yaohui Wang Yu Qiao Dahua Lin and Bo Dai. 2023. Animatediff: Animate your personalized text-to-image diffusion models without specific tuning. arXiv:2307.04725. Retrieved from https://arxiv.org/abs/2307.04725 · arXiv
  17. Yingqing He Tianyu Yang Yong Zhang Ying Shan and Qifeng Chen. 2022. Latent video diffusion models for high-fidelity video generation with arbitrary lengths. arXiv:2211.13221. Retrieved from https://arxiv.org/abs/2211.13221 · arXiv
  18. Wenyi Hong Ming Ding Wendi Zheng Xinghan Liu and Jie Tang. 2022. Cogvideo: Large-scale pretraining for text-to-video generation via transformers. arXiv:2205.15868. Retrieved from https://arxiv.org/abs/2205.15868 · arXiv
  19. Yipo Huang Quan Yuan Xiangfei Sheng Zhichao Yang Haoning Wu Pengfei Chen Yuzhe Yang Leida Li and Weisi Lin. 2024. AesBench: An expert benchmark for multimodal large language models on image aesthetics perception. arXiv:2401.08276. Retrieved from https://arxiv.org/abs/2401.08276 · arXiv
  20. Zhipeng Huang Zhizheng Zhang Yiting Lu Zheng-Jun Zha Zhibo Chen and Baining Guo. 2024. VisualCritic: Making LMMs perceive visual quality like humans. arXiv:2403.12806. Retrieved from https://arxiv.org/abs/2403.12806 · arXiv
  21. 10.1007/978-3-642-15561-1_8 · doi:10.1007/978-3-642-15561-1_8
  22. Tengchuan Kou Xiaohong Liu Zicheng Zhang Chunyi Li Haoning Wu Xiongkuo Min Guangtao Zhai and Ning Liu. 2024. Subjective-aligned dataset and metric for text-to-video quality assessment. arXiv:2403.11956. Retrieved from https://arxiv.org/abs/2403.11956 · arXiv
  23. Bohao Li Rui Wang Guangzhi Wang Yuying Ge Yixiao Ge and Ying Shan. 2023. SEED-Bench: Benchmarking multimodal LLMs with generative comprehension. arXiv:2307.16125. Retrieved from https://arxiv.org/abs/2307.16125 · arXiv
  24. Bo Li Peiyuan Zhang Jingkang Yang Yuanhan Zhang Fanyi Pu and Ziwei Liu. 2023. Otterhd: A high-resolution multi-modality model. arXiv:2311.04219. Retrieved from https://arxiv.org/abs/2311.04219 · arXiv
  25. Bo Li Yuanhan Zhang Liangyu Chen Jinghao Wang Jingkang Yang and Ziwei Liu. 2023. Otter: A multi-modal model with in-context instruction tuning. arXiv:2305.03726. Retrieved from https://arxiv.org/abs/2305.03726 · arXiv
  26. Chunyi Li Haoning Wu Zicheng Zhang Hongkun Hao Kaiwei Zhang Lei Bai Xiaohong Liu Xiongkuo Min Weisi Lin and Guangtao Zhai. 2024. Q-Refine: A perceptual quality refiner for AI-generated image. arXiv:2401.01117. Retrieved from https://arxiv.org/abs/2401.01117 · arXiv
  27. Chunyi Li Xiele Wu Haoning Wu Donghui Feng Zicheng Zhang Guo Lu Xiongkuo Min Xiaohong Liu Guangtao Zhai and Weisi Lin. 2024. CMC-Bench: Towards a new paradigm of visual signal compression. arXiv:2406.09356. Retrieved from https://arxiv.org/abs/2406.09356 · arXiv
  28. Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. 2023. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In International Conference on Machine Learning. PMLR, 19730–19742.
  29. Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022. Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. In International Conference on Machine Learning. PMLR, 12888–12900.
  30. Juncheng Li, Kaihang Pan, Zhiqi Ge, Minghe Gao, Wei Ji, Wenqiao Zhang, Tat-Seng Chua, Siliang Tang, Hanwang Zhang, and Yueting Zhuang. 2023. Fine-tuning multimodal llms to follow zero-shot demonstrative instructions. In The 12th International Conference on Learning Representations.
  31. Mingsheng Li Xin Chen Chi Zhang Sijin Chen Hongyuan Zhu Fukun Yin Gang Yu and Tao Chen. 2023. M3DBench: Let’s instruct large models with multi-modal 3D prompts. arXiv:2312.10763. Retrieved from https://arxiv.org/abs/2312.10763 · arXiv
  32. Zhiqiu Lin Deepak Pathak Baiqi Li Jiayao Li Xide Xia Graham Neubig Pengchuan Zhang and Deva Ramanan. 2024. Evaluating text-to-visual generation with image-to-text generation. arXiv:2404.01291. Retrieved from https://arxiv.org/abs/2404.01291 · arXiv
  33. Fuxiao Liu, Kevin Lin, Linjie Li, Jianfeng Wang, Yaser Yacoob, and Lijuan Wang. 2023. Mitigating hallucination in large multi-modal models via robust instruction tuning. In The 12th International Conference on Learning Representations.
  34. Haotian Liu Chunyuan Li Qingyang Wu and Yong Jae Lee. 2023. Visual Instruction Tuning. arxiv:2304.08485. Rerieved from https://arxiv.org/abs/2304.08485 · arXiv
  35. Xiaohong Liu Xiongkuo Min Guangtao Zhai Chunyi Li Tengchuan Kou Wei Sun Haoning Wu Yixuan Gao Yuqin Cao Zicheng Zhang et al. 2024. NTIRE 2024 quality qssessment of AI-generated content challenge. arXiv:2404.16687. Retrieved from https://arxiv.org/abs/2404.16687 · arXiv
  36. Yaofang Liu Xiaodong Cun Xuebo Liu Xintao Wang Yong Zhang Haoxin Chen Yang Liu Tieyong Zeng Raymond Chan and Ying Shan. 2023. Evalcrafter: Benchmarking and evaluating large video generation models. arXiv:2310.11440. Retrieved from https://arxiv.org/abs/2310.11440 · arXiv
  37. Pan Lu Hritik Bansal Tony Xia Jiacheng Liu Chunyuan Li Hannaneh Hajishirzi Hao Cheng Kai-Wei Chang Michel Galley and Jianfeng Gao. 2023. Mathvista: Evaluating mathematical reasoning of foundation models in visual contexts. arXiv:2310.02255. Retrieved from https://arxiv.org/abs/2310.02255 · arXiv
  38. Wei Lu, Wei Sun, Wenhan Zhu, Xiongkuo Min, Zicheng Zhang, Tao Wang, and Guangtao Zhai. 2021. A cnn-based quality assessment method for pseudo 4k contents. In International Forum on Digital TV and Wireless Multimedia Communications. Springer, 164–176.
  39. Elman Mansimov Emilio Parisotto Jimmy Lei Ba and Ruslan Salakhutdinov. 2015. Generating images from captions with attention. arXiv:1511.02793. Retrieved from https://arxiv.org/abs/1511.02793 · arXiv
  40. OpenAI. 2023. GPT-4 technical report. arXiv:2303.08774. Retrieved from https://arxiv.org/abs/2303.08774 · arXiv
  41. Wensheng Pan Timin Gao Yan Zhang Runze Hu Xiawu Zheng Enwei Zhang Yuting Gao Yutao Liu Yunhang Shen Ke Li et al. 2024. Multi-modal prompt learning on blind image quality assessment. arXiv:2404.14949. Retrieved from https://arxiv.org/abs/2404.14949 · arXiv
  42. Wensheng Pan, Zhifu Yang, DingMing Liu, Chenxin Fang, Yan Zhang, and Pingyang Dai. 2023. Quality-aware CLIP for blind image quality assessment. In Chinese Conference on Pattern Recognition and Computer Vision (PRCV). Springer, 396–408.
  43. Zhiliang Peng Wenhui Wang Li Dong Yaru Hao Shaohan Huang Shuming Ma and Furu Wei. 2023. Kosmos-2: Grounding multimodal large language models to the world. arXiv: 2306.14824. Retrieved from https://arxiv.org/abs/2306.14824 · arXiv
  44. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning. PMLR, 8748–8763.
  45. Aditya Ramesh Prafulla Dhariwal Alex Nichol Casey Chu and Mark Chen. 2022. Hierarchical text-conditional image generation with CLIP latents. arXiv:2204.06125. Retrieved from https://arxiv.org/abs/2204.06125 · arXiv
  46. Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, and Honglak Lee. 2016. Generative adversarial text to image synthesis. In International Conference on Machine Learning. PMLR, 1060–1069.
  47. Wenqi Shao Yutao Hu Peng Gao Meng Lei Kaipeng Zhang Fanqing Meng Peng Xu Siyuan Huang Hongsheng Li Yu Qiao et al. 2023. Tiny lvlm-ehub: Early multimodal experiments with bard. arXiv:2308.03729. Retrieved from https://arxiv.org/abs/2308.03729 · arXiv
  48. Wei Sun Haoning Wu Zicheng Zhang Jun Jia Zhichao Zhang Linhan Cao Qiubo Chen Xiongkuo Min Weisi Lin and Guangtao Zhai. 2024. Enhancing blind video quality assessment with rich quality-aware features. arXiv:2405.08745. Retrieved from https://arxiv.org/abs/2405.08745 · arXiv · doi:10.2139/ssrn.5571157
  49. Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale et al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv:2307.09288. Retrieved from https://arxiv.org/abs/2307.09288 · arXiv
  50. Jiarui Wang, Huiyu Duan, Jing Liu, Shi Chen, Xiongkuo Min, and Guangtao Zhai. 2023. Aigciqa2023: A large-scale image quality assessment database for AI generated images: From the perspectives of quality, authenticity and correspondence. In CAAI International Conference on Artificial Intelligence. Springer, 46–57.
  51. Ke Wang Junting Pan Weikang Shi Zimu Lu Mingjie Zhan and Hongsheng Li. 2024. Measuring multimodal mathematical reasoning with MATH-vision dataset. arXiv:2402.14804. Retrieved from https://arxiv.org/abs/2402.14804 · arXiv
  52. Xuezhi Wang Jason Wei Dale Schuurmans Quoc Le Ed Chi Sharan Narang Aakanksha Chowdhery and Denny Zhou. 2022. Self-consistency improves chain of thought reasoning in language models. arXiv:2203.11171. Retrieved from https://arxiv.org/abs/2203.11171 · arXiv
  53. Yaohui Wang Xinyuan Chen Xin Ma Shangchen Zhou Ziqi Huang Yi Wang Ceyuan Yang Yinan He Jiashuo Yu Peiqing Yang et al. 2023. Lavie: High-quality video generation with cascaded latent diffusion models. arXiv:2309.15103. Retrieved from https://arxiv.org/abs/2309.15103 · arXiv
  54. 10.5555/3019345 · doi:10.5555/3019345
  55. Chenfei Wu Lun Huang Qianxi Zhang Binyang Li Lei Ji Fan Yang Guillermo Sapiro and Nan Duan. 2021. Godiva: Generating open-domain videos from natural descriptions. arXiv:2104.14806. Retrieved from https://arxiv.org/abs/2104.14806 · arXiv
  56. Haoning Wu Chaofeng Chen Liang Liao Jingwen Hou Wenxiu Sun Qiong Yan Jinwei Gu and Weisi Lin. 2022. Neighbourhood representative sampling for efficient end-to-end video quality assessment. arXiv:2210.05357. Retrieved from https://arxiv.org/abs/2210.05357 · arXiv
  57. Haoning Wu Liang Liao Annan Wang Chaofeng Chen Jingwen Hou Hou Erli Zhang Wenxiu Sun Sun Qiong Yan and Weisi Lin. 2023. Towards robust text-prompted semantic criterion for in-the-wild video quality assessment. arXiv:2304.14672. Retrieved from https://arxiv.org/abs/2304.14672 · arXiv
  58. Haoning Wu Zicheng Zhang Erli Zhang Chaofeng Chen Liang Liao Annan Wang Kaixin Xu Chunyi Li Jingwen Hou Guangtao Zhai et al. 2023. Q-instruct: Improving low-level visual abilities for multi-modality foundation models. arXiv:2311.06783. Retrieved from https://arxiv.org/abs/2311.06783 · arXiv
  59. Haoning Wu Zicheng Zhang Weixia Zhang Chaofeng Chen Liang Liao Chunyi Li Yixuan Gao Annan Wang Erli Zhang Wenxiu Sun et al. 2023. Q-align: Teaching lmms for visual scoring via discrete text-defined levels. arXiv:2312.17090. Retrieved from https://arxiv.org/abs/2312.17090 · arXiv
  60. Haoning Wu Hanwei Zhu Zicheng Zhang Erli Zhang Chaofeng Chen Liang Liao Chunyi Li Annan Wang Wenxiu Sun Qiong Yan et al. 2024. Towards open-ended visual quality comparison. arXiv:2402.16641. Retrieved from https://arxiv.org/abs/2402.16641 · arXiv
  61. Qinghao Ye Haiyang Xu Guohai Xu Jiabo Ye Ming Yan Yiyang Zhou Junyang Wang Anwen Hu Pengcheng Shi Yaya Shi et al. 2023. mPLUG-Owl: Modularization empowers large language models with multimodality. arXiv:2304.14178. Retrieved from https://arxiv.org/abs/2304.14178 · arXiv
  62. Qinghao Ye Haiyang Xu Jiabo Ye Ming Yan Haowei Liu Qi Qian Ji Zhang Fei Huang and Jingren Zhou. 2023. mplug-owl2: Revolutionizing multi-modal large language model with modality collaboration. arXiv:2311.04257. Retrieved from https://arxiv.org/abs/2311.04257 · arXiv
  63. Zhenqiang Ying, Maniratnam Mandal, Deepti Ghadiyaram, and Alan Bovik. 2021. Patch-VQ: ‘Patching Up’ the video quality problem. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 14019–14029.
  64. Zhiyuan You Jinjin Gu Zheyuan Li Xin Cai Kaiwen Zhu Tianfan Xue and Chao Dong. 2024. Descriptive image quality assessment in the wild. arXiv:2405.18842. Retrieved from https://arxiv.org/abs/2405.18842 · arXiv
  65. Zhiyuan You Zheyuan Li Jinjin Gu Zhenfei Yin Tianfan Xue and Chao Dong. 2023. Depicting beyond scores: Advancing image quality assessment through multi-modal language models. arXiv:2312.08962. Retrieved from https://arxiv.org/abs/2312.08962 · arXiv
  66. Jiahui Yu Yuanzhong Xu Jing Yu Koh Thang Luong Gunjan Baid Zirui Wang Vijay Vasudevan Alexander Ku Yinfei Yang Burcu Karagol Ayan et al. 2022. Scaling autoregressive models for content-rich text-to-image generation. arXiv:2206.10789. Retrieved from https://arxiv.org/abs/2206.10789 · arXiv
  67. Weihao Yu Zhengyuan Yang Linjie Li Jianfeng Wang Kevin Lin Zicheng Liu Xinchao Wang and Lijuan Wang. 2023. Mm-vet: Evaluating large multimodal models for integrated capabilities. arXiv:2308.02490. Retrieved from https://arxiv.org/abs/2308.02490 · arXiv
  68. Xiang Yue Yuansheng Ni Kai Zhang Tianyu Zheng Ruoqi Liu Ge Zhang Samuel Stevens Dongfu Jiang Weiming Ren Yuxuan Sun et al. 2023. Mmmu: A massive multi-discipline multimodal understanding and reasoning benchmark for expert agi. arXiv:2311.16502. Retrieved from https://arxiv.org/abs/2311.16502 · arXiv
  69. David Junhao Zhang Jay Zhangjie Wu Jia-Wei Liu Rui Zhao Lingmin Ran Yuchao Gu Difei Gao and Mike Zheng Shou. 2023. Show-1: Marrying pixel and latent diffusion models for text-to-video generation. arXiv:2309.15818. Retrieved from https://arxiv.org/abs/2309.15818 · arXiv
  70. Pan Zhang Xiaoyi Dong Bin Wang Yuhang Cao Chao Xu Linke Ouyang Zhiyuan Zhao Shuangrui Ding Songyang Zhang Haodong Duan et al. 2023. InternLM-XComposer: A vision-language large model for advanced text-image comprehension and composition. arXiv:2309.15112. Retrieved from https://arxiv.org/abs/2309.15112 · arXiv
  71. 10.1109/icmew53276.2021.9455963 · doi:10.1109/icmew53276.2021.9455963
  72. Zicheng Zhang Wei Sun Yingjie Zhou Haoning Wu Chunyi Li Xiongkuo Min and Xiaohong Liu. 2023. Advancing zero-shot digital human quality assessment through text-prompted evaluation. arXiv:2307.02808. Retrieved from https://arxiv.org/abs/2307.02808 · arXiv
  73. Zicheng Zhang Haoning Wu Chunyi Li Yingjie Zhou Wei Sun Xiongkuo Min Zijian Chen Xiaohong Liu Weisi Lin and Guangtao Zhai. 2024. A-Bench: Are LMMs masters at evaluating AI-generated images? arXiv:2406.03070. Retrieved from https://arxiv.org/abs/2406.03070 · arXiv
  74. Zicheng Zhang Haoning Wu Erli Zhang Guangtao Zhai and Weisi Lin. 2024. A benchmark for multi-modal foundation models on low-level vision: From single images to pairs. arXiv:2402.07116. Retrieved from https://arxiv.org/abs/2402.07116 · arXiv
  75. Zicheng Zhang Yingjie Zhou Wei Sun Xiongkuo Min and Guangtao Zhai. 2023. Simple baselines for projection-based full-reference and no-reference point cloud quality assessment. arXiv:2310.17147. Retrieved from https://arxiv.org/abs/2310.17147 · arXiv
  76. Xunchu Zhou Xiaohong Liu Yunlong Dong Tengchuan Kou Yixuan Gao Zicheng Zhang Chunyi Li Haoning Wu and Guangtao Zhai. 2024. Light-VQA+: A video quality assessment model for exposure correction with vision-language guidance. arXiv:2405.03333. Retrieved from https://arxiv.org/abs/2405.03333 · arXiv
  77. Yingjie Zhou, Zicheng Zhang, Wei Sun, Xiongkuo Min, and Guangtao Zhai. 2023. Perceptual quality assessment for point clouds: A survey. ZTE Communications 21 (2023), 4.
  78. Zhaokun Zhou Qiulin Wang Bin Lin Yiwei Su Rui Chen Xin Tao Amin Zheng Li Yuan Pengfei Wan and Di Zhang. 2024. UNIAA: A unified multi-modal image aesthetic assessment baseline and benchmark. arXiv:2404.09619. Retrieved from https://arxiv.org/abs/2404.09619 · arXiv
  79. Deyao Zhu Jun Chen Xiaoqian Shen Xiang Li and Mohamed Elhoseiny. 2023. MiniGPT-4: Enhancing vision-language understanding with advanced large language models. arXiv:2304.10592. Retrieved from https://arxiv.org/abs/2304.10592 · arXiv
  80. Hanwei Zhu Haoning Wu Yixuan Li Zicheng Zhang Baoliang Chen Lingyu Zhu Yuming Fang Guangtao Zhai Weisi Lin and Shiqi Wang. 2024. Adaptive image quality assessment via teaching large multimodal model to compare. arXiv:2405.19298. Retrieved from https://arxiv.org/abs/2405.19298 · arXiv
  81. Xilei Zhu, Huiyu Duan, Yuqin Cao, Yuxin Zhu, Yucheng Zhu, Jing Liu, Li Chen, Xiongkuo Min, and Guangtao Zhai. 2023. Perceptual quality assessment of omnidirectional audio-visual signals. In CAAI International Conference on Artificial Intelligence. Springer, 512–525.

Cited by

See all 68

Metadata

Authors
Zhang, Z., Zhou, Y., Li, C., Zhao, B., Liu, X., & Zhai, G.
Affiliations
Shanghai Jiao Tong University (CN)
Venue
ACM Transactions on Multimedia Computing, Communications, and Applications
Published
2025-07-19
Volume
21
Issue
7
Pages
1-31
ISSN
  • 1551-6857 (ISSN-L)
  • 1551-6865
OpenAlex
W4408326517
Cited by
23
References
137
Citations by year
2026: 5 · 2025: 16
FWCI
7.42
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • ACM Transactions on Multimedia Computing Communications and Applications (publishedVersion, public-domain)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Key R&D Program of China (2021YFE0206700)
  • National Natural Science Foundation of China (62301310, 623B2073)
  • Sichuan Science and Technology Program (2024NSFSC1426)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
Keywords
quality assessment, large language models, visual quality, multimedia quality, expert models, human perception, explainability, robustness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Quality Assessment in the Era of Large Models: A Survey. https://app.cochat.ai/papers/10.1145/3722559
The paper
Zhang, Z., Zhou, Y., Li, C., Zhao, B., Liu, X., & Zhai, G. (2025). Quality Assessment in the Era of Large Models: A Survey. ACM Transactions on Multimedia Computing, Communications, and Applications. https://doi.org/10.1145/3722559

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.