Quality Assessment in the Era of Large Models: A Survey
Open accessThe DOI matches its Crossref record; 165 of the 194 references it cites were found in a registry or an index, and 29 are not checked yet.
Abstract
Quality assessment, which evaluates the visual quality level of multimedia experiences, has garnered significant attention from researchers and has evolved substantially through dedicated efforts. Before the advent of large models, quality assessment typically relied on small expert models tailored for specific tasks. While these smaller models are effective at handling their designated tasks and predicting quality levels, they often lack explainability and robustness. With the advancement of large models, which align more closely with human cognitive and perceptual processes, many researchers are now leveraging the prior knowledge embedded in these large models for quality assessment tasks. This emergence of quality assessment within the context of large models motivates us to provide a comprehensive review focusing on two key aspects: (1) the assessment of large models and (2) the role of large models in assessment tasks. We begin by reflecting on the historical development of quality assessment. Subsequently, we move to detailed discussions of related works concerning quality assessment in the era of large models. Finally, we offer insights into the future progression and potential pathways for quality assessment in this new era. We hope that this survey will enable a rapid understanding of the development of quality assessment in the era of large models and inspire further advancements in the field.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“More recent approaches, including transformer-based and deep-learning-based models, have improved perceptual alignment but often introduce higher computational complexity and reduced interpretability [59-62].”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [61]
Citations
Cites
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
CIDEr: Consensus-based image description evaluation
Vedantam, R., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299087 · Cited by 4,845
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Research works printed but not linked: 81
- Lorenzo Agnolucci Leonardo Galteri and Marco Bertini. 2024. Quality-aware image-text alignment for real-world image quality assessment. arXiv:2403.11176. Retrieved from https://arxiv.org/abs/2403.11176 · arXiv
- Evangelos Alexiou and Touradj Ebrahimi. 2017. On the performance of metrics to predict quality in point cloud representations. In Applications of Digital Image Processing XL 10396. SPIE, 282–297.
- 10.1109/icme.2018.8486512 · doi:10.1109/icme.2018.8486512
- 10.1109/qomex.2018.8463406 · doi:10.1109/qomex.2018.8463406
- Anas Awadalla Irena Gao Josh Gardner Jack Hessel Yusuf Hanafy Wanrong Zhu Kalyani Marathe Yonatan Bitton Samir Gadre Shiori Sagawa et al. 2023. Openflamingo: An open-source framework for training large autoregressive vision-language models. arXiv:2308.01390. Retrieved from https://arxiv.org/abs/2308.01390 · arXiv
- Rizhao Cai Zirui Song Dayan Guan Zhenhao Chen Xing Luo Chenyu Yi and Alex Kot. 2023. BenchLMM: Benchmarking cross-style visual capability of large multimodal models. arXiv:2312.02896. Retrieved from https://arxiv.org/abs/2312.02896 · arXiv
- Keqin Chen Zhao Zhang Weili Zeng Richong Zhang Feng Zhu and Rui Zhao. 2023. Shikra: Unleashing multimodal LLM’s referential dialogue magic. arXiv:2306.15195. Retrieved from https://arxiv.org/abs/2306.15195 · arXiv
- Zijian Chen Wei Sun Haoning Wu Zicheng Zhang Jun Jia Xiongkuo Min Guangtao Zhai and Wenjun Zhang. 2023. Exploring the naturalness of AI-generated images. arXiv:2312.05476. Retrieved from https://arxiv.org/abs/2312.05476 · arXiv
- Iya Chivileva Philip Lynch Tomas E. Ward and Alan F. Smeaton. 2023. Measuring the quality of text-to-video model outputs: Metrics and dataset. arXiv:2309.08009. Retrieved from https://arxiv.org/abs/2309.08009 · arXiv
- Wenliang Dai Junnan Li Dongxu Li Anthony Meng Huat Tiong Junqi Zhao Weisheng Wang Boyang Li Pascale Fung and Steven Hoi. 2023. InstructBLIP: Towards general-purpose vision-language models with instruction tuning. arXiv:2305.06500. Retrieved from https://arxiv.org/abs/2305.06500 · arXiv
- 10.21227/hp84-8m05 · doi:10.21227/hp84-8m05
- Chaoyou Fu Peixian Chen Yunhang Shen Yulei Qin Mengdan Zhang Xu Lin Zhenyu Qiu Wei Lin Jinrui Yang Xiawu Zheng et al. 2023. MME: A comprehensive evaluation benchmark for multimodal large language models. arXiv:2306.13394. Retrieved from https://arxiv.org/abs/2306.13394 · arXiv
- Peng Gao Jiaming Han Renrui Zhang Ziyi Lin Shijie Geng Aojun Zhou Wei Zhang Pan Lu Conghui He Xiangyu Yue et al. 2023. LLaMA-Adapter V2: Parameter-efficient visual instruction model. arXiv:2304.15010. Retrieved from https://arxiv.org/abs/2304.15010 · arXiv
- Wentao Ge Shunian Chen Guiming Chen Junying Chen Zhihong Chen Shuo Yan Chenghao Zhu Ziyue Lin Wenya Xie Xidong Wang et al. 2023. Mllm-bench evaluating multi-modal llms using gpt-4v. arXiv:2311.13951. Retrieved from https://arxiv.org/abs/2311.13951 · arXiv
- Jiaxi Gu Shicong Wang Haoyu Zhao Tianyi Lu Xing Zhang Zuxuan Wu Songcen Xu Wei Zhang Yu-Gang Jiang and Hang Xu. 2023. Reuse and diffuse: Iterative denoising for text-to-video generation. arXiv:2309.03549. Retrieved from https://arxiv.org/abs/2309.03549 · arXiv
- Yuwei Guo Ceyuan Yang Anyi Rao Yaohui Wang Yu Qiao Dahua Lin and Bo Dai. 2023. Animatediff: Animate your personalized text-to-image diffusion models without specific tuning. arXiv:2307.04725. Retrieved from https://arxiv.org/abs/2307.04725 · arXiv
- Yingqing He Tianyu Yang Yong Zhang Ying Shan and Qifeng Chen. 2022. Latent video diffusion models for high-fidelity video generation with arbitrary lengths. arXiv:2211.13221. Retrieved from https://arxiv.org/abs/2211.13221 · arXiv
- Wenyi Hong Ming Ding Wendi Zheng Xinghan Liu and Jie Tang. 2022. Cogvideo: Large-scale pretraining for text-to-video generation via transformers. arXiv:2205.15868. Retrieved from https://arxiv.org/abs/2205.15868 · arXiv
- Yipo Huang Quan Yuan Xiangfei Sheng Zhichao Yang Haoning Wu Pengfei Chen Yuzhe Yang Leida Li and Weisi Lin. 2024. AesBench: An expert benchmark for multimodal large language models on image aesthetics perception. arXiv:2401.08276. Retrieved from https://arxiv.org/abs/2401.08276 · arXiv
- Zhipeng Huang Zhizheng Zhang Yiting Lu Zheng-Jun Zha Zhibo Chen and Baining Guo. 2024. VisualCritic: Making LMMs perceive visual quality like humans. arXiv:2403.12806. Retrieved from https://arxiv.org/abs/2403.12806 · arXiv
- 10.1007/978-3-642-15561-1_8 · doi:10.1007/978-3-642-15561-1_8
- Tengchuan Kou Xiaohong Liu Zicheng Zhang Chunyi Li Haoning Wu Xiongkuo Min Guangtao Zhai and Ning Liu. 2024. Subjective-aligned dataset and metric for text-to-video quality assessment. arXiv:2403.11956. Retrieved from https://arxiv.org/abs/2403.11956 · arXiv
- Bohao Li Rui Wang Guangzhi Wang Yuying Ge Yixiao Ge and Ying Shan. 2023. SEED-Bench: Benchmarking multimodal LLMs with generative comprehension. arXiv:2307.16125. Retrieved from https://arxiv.org/abs/2307.16125 · arXiv
- Bo Li Peiyuan Zhang Jingkang Yang Yuanhan Zhang Fanyi Pu and Ziwei Liu. 2023. Otterhd: A high-resolution multi-modality model. arXiv:2311.04219. Retrieved from https://arxiv.org/abs/2311.04219 · arXiv
- Bo Li Yuanhan Zhang Liangyu Chen Jinghao Wang Jingkang Yang and Ziwei Liu. 2023. Otter: A multi-modal model with in-context instruction tuning. arXiv:2305.03726. Retrieved from https://arxiv.org/abs/2305.03726 · arXiv
- Chunyi Li Haoning Wu Zicheng Zhang Hongkun Hao Kaiwei Zhang Lei Bai Xiaohong Liu Xiongkuo Min Weisi Lin and Guangtao Zhai. 2024. Q-Refine: A perceptual quality refiner for AI-generated image. arXiv:2401.01117. Retrieved from https://arxiv.org/abs/2401.01117 · arXiv
- Chunyi Li Xiele Wu Haoning Wu Donghui Feng Zicheng Zhang Guo Lu Xiongkuo Min Xiaohong Liu Guangtao Zhai and Weisi Lin. 2024. CMC-Bench: Towards a new paradigm of visual signal compression. arXiv:2406.09356. Retrieved from https://arxiv.org/abs/2406.09356 · arXiv
- Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. 2023. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In International Conference on Machine Learning. PMLR, 19730–19742.
- Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022. Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. In International Conference on Machine Learning. PMLR, 12888–12900.
- Juncheng Li, Kaihang Pan, Zhiqi Ge, Minghe Gao, Wei Ji, Wenqiao Zhang, Tat-Seng Chua, Siliang Tang, Hanwang Zhang, and Yueting Zhuang. 2023. Fine-tuning multimodal llms to follow zero-shot demonstrative instructions. In The 12th International Conference on Learning Representations.
- Mingsheng Li Xin Chen Chi Zhang Sijin Chen Hongyuan Zhu Fukun Yin Gang Yu and Tao Chen. 2023. M3DBench: Let’s instruct large models with multi-modal 3D prompts. arXiv:2312.10763. Retrieved from https://arxiv.org/abs/2312.10763 · arXiv
- Zhiqiu Lin Deepak Pathak Baiqi Li Jiayao Li Xide Xia Graham Neubig Pengchuan Zhang and Deva Ramanan. 2024. Evaluating text-to-visual generation with image-to-text generation. arXiv:2404.01291. Retrieved from https://arxiv.org/abs/2404.01291 · arXiv
- Fuxiao Liu, Kevin Lin, Linjie Li, Jianfeng Wang, Yaser Yacoob, and Lijuan Wang. 2023. Mitigating hallucination in large multi-modal models via robust instruction tuning. In The 12th International Conference on Learning Representations.
- Haotian Liu Chunyuan Li Qingyang Wu and Yong Jae Lee. 2023. Visual Instruction Tuning. arxiv:2304.08485. Rerieved from https://arxiv.org/abs/2304.08485 · arXiv
- Xiaohong Liu Xiongkuo Min Guangtao Zhai Chunyi Li Tengchuan Kou Wei Sun Haoning Wu Yixuan Gao Yuqin Cao Zicheng Zhang et al. 2024. NTIRE 2024 quality qssessment of AI-generated content challenge. arXiv:2404.16687. Retrieved from https://arxiv.org/abs/2404.16687 · arXiv
- Yaofang Liu Xiaodong Cun Xuebo Liu Xintao Wang Yong Zhang Haoxin Chen Yang Liu Tieyong Zeng Raymond Chan and Ying Shan. 2023. Evalcrafter: Benchmarking and evaluating large video generation models. arXiv:2310.11440. Retrieved from https://arxiv.org/abs/2310.11440 · arXiv
- Pan Lu Hritik Bansal Tony Xia Jiacheng Liu Chunyuan Li Hannaneh Hajishirzi Hao Cheng Kai-Wei Chang Michel Galley and Jianfeng Gao. 2023. Mathvista: Evaluating mathematical reasoning of foundation models in visual contexts. arXiv:2310.02255. Retrieved from https://arxiv.org/abs/2310.02255 · arXiv
- Wei Lu, Wei Sun, Wenhan Zhu, Xiongkuo Min, Zicheng Zhang, Tao Wang, and Guangtao Zhai. 2021. A cnn-based quality assessment method for pseudo 4k contents. In International Forum on Digital TV and Wireless Multimedia Communications. Springer, 164–176.
- Elman Mansimov Emilio Parisotto Jimmy Lei Ba and Ruslan Salakhutdinov. 2015. Generating images from captions with attention. arXiv:1511.02793. Retrieved from https://arxiv.org/abs/1511.02793 · arXiv
- OpenAI. 2023. GPT-4 technical report. arXiv:2303.08774. Retrieved from https://arxiv.org/abs/2303.08774 · arXiv
- Wensheng Pan Timin Gao Yan Zhang Runze Hu Xiawu Zheng Enwei Zhang Yuting Gao Yutao Liu Yunhang Shen Ke Li et al. 2024. Multi-modal prompt learning on blind image quality assessment. arXiv:2404.14949. Retrieved from https://arxiv.org/abs/2404.14949 · arXiv
- Wensheng Pan, Zhifu Yang, DingMing Liu, Chenxin Fang, Yan Zhang, and Pingyang Dai. 2023. Quality-aware CLIP for blind image quality assessment. In Chinese Conference on Pattern Recognition and Computer Vision (PRCV). Springer, 396–408.
- Zhiliang Peng Wenhui Wang Li Dong Yaru Hao Shaohan Huang Shuming Ma and Furu Wei. 2023. Kosmos-2: Grounding multimodal large language models to the world. arXiv: 2306.14824. Retrieved from https://arxiv.org/abs/2306.14824 · arXiv
- Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning. PMLR, 8748–8763.
- Aditya Ramesh Prafulla Dhariwal Alex Nichol Casey Chu and Mark Chen. 2022. Hierarchical text-conditional image generation with CLIP latents. arXiv:2204.06125. Retrieved from https://arxiv.org/abs/2204.06125 · arXiv
- Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, and Honglak Lee. 2016. Generative adversarial text to image synthesis. In International Conference on Machine Learning. PMLR, 1060–1069.
- Wenqi Shao Yutao Hu Peng Gao Meng Lei Kaipeng Zhang Fanqing Meng Peng Xu Siyuan Huang Hongsheng Li Yu Qiao et al. 2023. Tiny lvlm-ehub: Early multimodal experiments with bard. arXiv:2308.03729. Retrieved from https://arxiv.org/abs/2308.03729 · arXiv
- Wei Sun Haoning Wu Zicheng Zhang Jun Jia Zhichao Zhang Linhan Cao Qiubo Chen Xiongkuo Min Weisi Lin and Guangtao Zhai. 2024. Enhancing blind video quality assessment with rich quality-aware features. arXiv:2405.08745. Retrieved from https://arxiv.org/abs/2405.08745 · arXiv · doi:10.2139/ssrn.5571157
- Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale et al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv:2307.09288. Retrieved from https://arxiv.org/abs/2307.09288 · arXiv
- Jiarui Wang, Huiyu Duan, Jing Liu, Shi Chen, Xiongkuo Min, and Guangtao Zhai. 2023. Aigciqa2023: A large-scale image quality assessment database for AI generated images: From the perspectives of quality, authenticity and correspondence. In CAAI International Conference on Artificial Intelligence. Springer, 46–57.
- Ke Wang Junting Pan Weikang Shi Zimu Lu Mingjie Zhan and Hongsheng Li. 2024. Measuring multimodal mathematical reasoning with MATH-vision dataset. arXiv:2402.14804. Retrieved from https://arxiv.org/abs/2402.14804 · arXiv
- Xuezhi Wang Jason Wei Dale Schuurmans Quoc Le Ed Chi Sharan Narang Aakanksha Chowdhery and Denny Zhou. 2022. Self-consistency improves chain of thought reasoning in language models. arXiv:2203.11171. Retrieved from https://arxiv.org/abs/2203.11171 · arXiv
- Yaohui Wang Xinyuan Chen Xin Ma Shangchen Zhou Ziqi Huang Yi Wang Ceyuan Yang Yinan He Jiashuo Yu Peiqing Yang et al. 2023. Lavie: High-quality video generation with cascaded latent diffusion models. arXiv:2309.15103. Retrieved from https://arxiv.org/abs/2309.15103 · arXiv
- 10.5555/3019345 · doi:10.5555/3019345
- Chenfei Wu Lun Huang Qianxi Zhang Binyang Li Lei Ji Fan Yang Guillermo Sapiro and Nan Duan. 2021. Godiva: Generating open-domain videos from natural descriptions. arXiv:2104.14806. Retrieved from https://arxiv.org/abs/2104.14806 · arXiv
- Haoning Wu Chaofeng Chen Liang Liao Jingwen Hou Wenxiu Sun Qiong Yan Jinwei Gu and Weisi Lin. 2022. Neighbourhood representative sampling for efficient end-to-end video quality assessment. arXiv:2210.05357. Retrieved from https://arxiv.org/abs/2210.05357 · arXiv
- Haoning Wu Liang Liao Annan Wang Chaofeng Chen Jingwen Hou Hou Erli Zhang Wenxiu Sun Sun Qiong Yan and Weisi Lin. 2023. Towards robust text-prompted semantic criterion for in-the-wild video quality assessment. arXiv:2304.14672. Retrieved from https://arxiv.org/abs/2304.14672 · arXiv
- Haoning Wu Zicheng Zhang Erli Zhang Chaofeng Chen Liang Liao Annan Wang Kaixin Xu Chunyi Li Jingwen Hou Guangtao Zhai et al. 2023. Q-instruct: Improving low-level visual abilities for multi-modality foundation models. arXiv:2311.06783. Retrieved from https://arxiv.org/abs/2311.06783 · arXiv
- Haoning Wu Zicheng Zhang Weixia Zhang Chaofeng Chen Liang Liao Chunyi Li Yixuan Gao Annan Wang Erli Zhang Wenxiu Sun et al. 2023. Q-align: Teaching lmms for visual scoring via discrete text-defined levels. arXiv:2312.17090. Retrieved from https://arxiv.org/abs/2312.17090 · arXiv
- Haoning Wu Hanwei Zhu Zicheng Zhang Erli Zhang Chaofeng Chen Liang Liao Chunyi Li Annan Wang Wenxiu Sun Qiong Yan et al. 2024. Towards open-ended visual quality comparison. arXiv:2402.16641. Retrieved from https://arxiv.org/abs/2402.16641 · arXiv
- Qinghao Ye Haiyang Xu Guohai Xu Jiabo Ye Ming Yan Yiyang Zhou Junyang Wang Anwen Hu Pengcheng Shi Yaya Shi et al. 2023. mPLUG-Owl: Modularization empowers large language models with multimodality. arXiv:2304.14178. Retrieved from https://arxiv.org/abs/2304.14178 · arXiv
- Qinghao Ye Haiyang Xu Jiabo Ye Ming Yan Haowei Liu Qi Qian Ji Zhang Fei Huang and Jingren Zhou. 2023. mplug-owl2: Revolutionizing multi-modal large language model with modality collaboration. arXiv:2311.04257. Retrieved from https://arxiv.org/abs/2311.04257 · arXiv
- Zhenqiang Ying, Maniratnam Mandal, Deepti Ghadiyaram, and Alan Bovik. 2021. Patch-VQ: ‘Patching Up’ the video quality problem. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 14019–14029.
- Zhiyuan You Jinjin Gu Zheyuan Li Xin Cai Kaiwen Zhu Tianfan Xue and Chao Dong. 2024. Descriptive image quality assessment in the wild. arXiv:2405.18842. Retrieved from https://arxiv.org/abs/2405.18842 · arXiv
- Zhiyuan You Zheyuan Li Jinjin Gu Zhenfei Yin Tianfan Xue and Chao Dong. 2023. Depicting beyond scores: Advancing image quality assessment through multi-modal language models. arXiv:2312.08962. Retrieved from https://arxiv.org/abs/2312.08962 · arXiv
- Jiahui Yu Yuanzhong Xu Jing Yu Koh Thang Luong Gunjan Baid Zirui Wang Vijay Vasudevan Alexander Ku Yinfei Yang Burcu Karagol Ayan et al. 2022. Scaling autoregressive models for content-rich text-to-image generation. arXiv:2206.10789. Retrieved from https://arxiv.org/abs/2206.10789 · arXiv
- Weihao Yu Zhengyuan Yang Linjie Li Jianfeng Wang Kevin Lin Zicheng Liu Xinchao Wang and Lijuan Wang. 2023. Mm-vet: Evaluating large multimodal models for integrated capabilities. arXiv:2308.02490. Retrieved from https://arxiv.org/abs/2308.02490 · arXiv
- Xiang Yue Yuansheng Ni Kai Zhang Tianyu Zheng Ruoqi Liu Ge Zhang Samuel Stevens Dongfu Jiang Weiming Ren Yuxuan Sun et al. 2023. Mmmu: A massive multi-discipline multimodal understanding and reasoning benchmark for expert agi. arXiv:2311.16502. Retrieved from https://arxiv.org/abs/2311.16502 · arXiv
- David Junhao Zhang Jay Zhangjie Wu Jia-Wei Liu Rui Zhao Lingmin Ran Yuchao Gu Difei Gao and Mike Zheng Shou. 2023. Show-1: Marrying pixel and latent diffusion models for text-to-video generation. arXiv:2309.15818. Retrieved from https://arxiv.org/abs/2309.15818 · arXiv
- Pan Zhang Xiaoyi Dong Bin Wang Yuhang Cao Chao Xu Linke Ouyang Zhiyuan Zhao Shuangrui Ding Songyang Zhang Haodong Duan et al. 2023. InternLM-XComposer: A vision-language large model for advanced text-image comprehension and composition. arXiv:2309.15112. Retrieved from https://arxiv.org/abs/2309.15112 · arXiv
- 10.1109/icmew53276.2021.9455963 · doi:10.1109/icmew53276.2021.9455963
- Zicheng Zhang Wei Sun Yingjie Zhou Haoning Wu Chunyi Li Xiongkuo Min and Xiaohong Liu. 2023. Advancing zero-shot digital human quality assessment through text-prompted evaluation. arXiv:2307.02808. Retrieved from https://arxiv.org/abs/2307.02808 · arXiv
- Zicheng Zhang Haoning Wu Chunyi Li Yingjie Zhou Wei Sun Xiongkuo Min Zijian Chen Xiaohong Liu Weisi Lin and Guangtao Zhai. 2024. A-Bench: Are LMMs masters at evaluating AI-generated images? arXiv:2406.03070. Retrieved from https://arxiv.org/abs/2406.03070 · arXiv
- Zicheng Zhang Haoning Wu Erli Zhang Guangtao Zhai and Weisi Lin. 2024. A benchmark for multi-modal foundation models on low-level vision: From single images to pairs. arXiv:2402.07116. Retrieved from https://arxiv.org/abs/2402.07116 · arXiv
- Zicheng Zhang Yingjie Zhou Wei Sun Xiongkuo Min and Guangtao Zhai. 2023. Simple baselines for projection-based full-reference and no-reference point cloud quality assessment. arXiv:2310.17147. Retrieved from https://arxiv.org/abs/2310.17147 · arXiv
- Xunchu Zhou Xiaohong Liu Yunlong Dong Tengchuan Kou Yixuan Gao Zicheng Zhang Chunyi Li Haoning Wu and Guangtao Zhai. 2024. Light-VQA+: A video quality assessment model for exposure correction with vision-language guidance. arXiv:2405.03333. Retrieved from https://arxiv.org/abs/2405.03333 · arXiv
- Yingjie Zhou, Zicheng Zhang, Wei Sun, Xiongkuo Min, and Guangtao Zhai. 2023. Perceptual quality assessment for point clouds: A survey. ZTE Communications 21 (2023), 4.
- Zhaokun Zhou Qiulin Wang Bin Lin Yiwei Su Rui Chen Xin Tao Amin Zheng Li Yuan Pengfei Wan and Di Zhang. 2024. UNIAA: A unified multi-modal image aesthetic assessment baseline and benchmark. arXiv:2404.09619. Retrieved from https://arxiv.org/abs/2404.09619 · arXiv
- Deyao Zhu Jun Chen Xiaoqian Shen Xiang Li and Mohamed Elhoseiny. 2023. MiniGPT-4: Enhancing vision-language understanding with advanced large language models. arXiv:2304.10592. Retrieved from https://arxiv.org/abs/2304.10592 · arXiv
- Hanwei Zhu Haoning Wu Yixuan Li Zicheng Zhang Baoliang Chen Lingyu Zhu Yuming Fang Guangtao Zhai Weisi Lin and Shiqi Wang. 2024. Adaptive image quality assessment via teaching large multimodal model to compare. arXiv:2405.19298. Retrieved from https://arxiv.org/abs/2405.19298 · arXiv
- Xilei Zhu, Huiyu Duan, Yuqin Cao, Yuxin Zhu, Yucheng Zhu, Jing Liu, Li Chen, Xiongkuo Min, and Guangtao Zhai. 2023. Perceptual quality assessment of omnidirectional audio-visual signals. In CAAI International Conference on Artificial Intelligence. Springer, 512–525.
Cited by
Teaching Large Language Models to Regress Accurate Image Quality Scores Using Score Distribution
You, Z., Cai, X. C., Gu, J., Xue, T., & Dong, C. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01350 · Cited by 225
Advances in artificial intelligence: a review for the creative industries
Anantrasirichai, N., Zhang, F., & Bull, D. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11494-w · Cited by 106
Large multimodal models evaluation: a survey
Zhang, Z., Wang, J., Wen, F., Guo, Y., Zhao, X., Fang, X., Ding, S., Jia, Z., Xiao, J., Shen, Y., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-025-4676-4 · Cited by 69
Self-citationVQA 2 : Visual Question Answering for Video Quality Assessment
Jia, Z., Zhang, Z., Qian, J., Wu, H., Sun, W., Li, C., Liu, X., Lin, W., Zhai, G., & Min, X. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754696 · Cited by 60
Self-citationQ-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content
Zhang, Z., Kou, T., Wang, S., Li, C., Sun, W., Wang, W., Li, X., Wang, Z., Cao, X., Min, X., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00993 · Cited by 50
Self-citation
Metadata
- Authors
- Zhang, Z., Zhou, Y., Li, C., Zhao, B., Liu, X., & Zhai, G.
- Affiliations
- Shanghai Jiao Tong University (CN)
- Venue
- ACM Transactions on Multimedia Computing, Communications, and Applications
- Published
- 2025-07-19
- Volume
- 21
- Issue
- 7
- Pages
- 1-31
- ISSN
- 1551-6857 (ISSN-L)
- 1551-6865
- OpenAlex
- W4408326517
- Cited by
- 23
- References
- 137
- Citations by year
- 2026: 5 · 2025: 16
- FWCI
- 7.42
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- ACM Transactions on Multimedia Computing Communications and Applications (publishedVersion, public-domain)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Key R&D Program of China (2021YFE0206700)
- National Natural Science Foundation of China (62301310, 623B2073)
- Sichuan Science and Technology Program (2024NSFSC1426)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- quality assessment, large language models, visual quality, multimedia quality, expert models, human perception, explainability, robustness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quality Assessment in the Era of Large Models: A Survey. https://app.cochat.ai/papers/10.1145/3722559
- The paper
- Zhang, Z., Zhou, Y., Li, C., Zhao, B., Liu, X., & Zhai, G. (2025). Quality Assessment in the Era of Large Models: A Survey. ACM Transactions on Multimedia Computing, Communications, and Applications. https://doi.org/10.1145/3722559
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.