CoChat
Sign Up
PreprintCited by 4Multimodal Machine Learning ApplicationsAssistive Technology in Communication and MobilityDigital Accessibility for Disabilities

"It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models

Open access
Garg, Kapil, Tang, Xinru, Heo, Jimin, Morgan, Dwayne R., Gergle, Darren, Sudderth, Erik B., Piper, Anne Marie·2025·arXiv
DOI 10.48550/arxiv.2511.08917arXiv 2511.08917

Preprint — published as 10.1145/3772318.3791309 · Paper page

Open this paper in CoChat — free account

Abstract

Vision-Language Models (VLMs) are increasingly used by blind and low-vision (BLV) people to identify and understand products in their everyday lives, such as food, personal care items, and household goods. Despite their prevalence, we lack an empirical understanding of how common image quality issues--such as blur, misframing, and rotation--affect the accuracy of VLM-generated captions and whether the resulting captions meet BLV people's information needs. Based on a survey of 86 BLV participants, we develop an annotated dataset of 1,859 product images from BLV people to systematically evaluate how image quality issues affect VLM-generated captions. While the best VLM achieves 98% accuracy on images with no quality issues, accuracy drops to 75% overall when quality issues are present, worsening considerably as issues compound. We discuss the need for model evaluations that center on disabled people's experiences throughout the process and offer concrete recommendations for HCI and ML researchers to make VLMs more reliable for BLV people.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2511.08917

Cites

0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Sighted people often do not understand what information blind people want in visual descriptions.

    “Sighted people often do not understand what information blind people want in visual descriptions [31, 90].”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [31]

    In Results (p. 7), blind and low-vision participants report that AI-generated product captions often omit details they need. Final Reflections (p. 8) calls on developers to understand those needs and records one participant’s concern about models trained by non-disabled people. These passages support a mismatch in product-captioning tools, but do not establish that sighted people generally or often misunderstand what blind people want in visual descriptions. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • The survey allowed Garg et al. to incorporate information that blind people want but that sighted crowdworkers had not included.

    “The survey allowed them to incorporate information that blind people want but that sighted crowdworkers had not included [31].”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [31]

    Section 5.1 (p. 15) says the survey surfaced blind and low-vision participants’ unmet needs for details in product images. Section 4.1 (p. 8) separately says crowdworker captions varied in detail and motivated a dataset with verified annotations. The paper does not establish that the survey let the authors incorporate specific information that sighted crowdworkers had omitted. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • These inconsistencies can significantly impact benchmarking and the usability of downstream applications for BLV users.

    “These inconsistencies can significantly impact benchmarking and the usability of downstream applications for BLV users [31, 50].”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [31]

  • Labeling issues are common in accessibility datasets and can benefit from the involvement of PWD.

    “Similar to stuttered speech datasets, labeling issues are common in accessibility datasets and can benefit from the involvement of PWD [12, 31].”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [31]

  • Garg et al. benchmarked vision-language models using a re-annotated subset of VizWiz, informed by a survey of blind participants.

    “For example, Garg et al. benchmarked visionlanguage models using a re-annotated subset of VizWiz, informed by a survey of blind participants [31].”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [31]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

The publisher hasn’t deposited this paper’s reference list.

Part of this paper’s reference list could not be split into single entries.

Research works printed but not linked: 131

  1. [3][3] Rudaiba Adnin and Maitraye Das. 2024. 'I Look at It as the King of Knowledge': How Blind People Use and Understand Generative AI Tools. In The 26th International ACM SIGACCESS Conference on Computers and Accessibility (St. John's NL Canada, 2024-10-27). ACM, 1-14. doi:10.1145/3663548.3675631 - · DOI · Paper page
  2. [4][4] Sakshi Agarwal, Gabe Hope, and Erik B. Sudderth. 2024. VIPaint: Image Inpainting with Pre-Trained Diffusion Models via Variational Inference . doi:10.48550/ arXiv.2411.18929 arXiv:2411.18929 [cs] - · arXiv
  3. [5][5] Lorenzo Agnolucci, Leonardo Galteri, Marco Bertini, and Alberto Del Bimbo. 2024. ARNIQA: Learning Distortion Manifold for Image Quality Assessment. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision . 189-198. -
  4. [6][6] Dragan Ahmetovic, Daisuke Sato, Uran Oh, Tatsuya Ishihara, Kris Kitani, and Chieko Asakawa. 2020. ReCog: Supporting Blind People in Recognizing Personal Objects. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20) . Association for Computing Machinery, New York, NY, USA, 1-12. doi:10.1145/3313831.3376143 - · DOI
  5. [8][8] Rahaf Alharbi, Robin N. Brewer, and Sarita Schoenebeck. 2022. Understanding Emerging Obfuscation Technologies in Visual Description Services for Blind and Low Vision People. 6 (2022), 1-33. Issue CSCW2. doi:10.1145/3555570 - · DOI
  6. [9][9] Rahaf Alharbi, Pa Lor, Jaylin Herskovitz, Sarita Schoenebeck, and Robin N. Brewer. 2024. Misfitting With AI: How Blind People Verify and Contest AI Errors. In Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA, 2024-10-27) (ASSETS '24) . Association for Computing Machinery, 1-17. doi:10.1145/3663548.3675659 - · DOI · Paper page
  7. [11][11] Peter Anderson, Basura Fernando, Mark Johnson, and Stephen Gould. 2016. SPICE: Semantic Propositional Image Caption Evaluation. In Computer Vision ECCV 2016 (Cham, 2016), Bastian Leibe, Jiri Matas, Nicu Sebe, and Max Welling (Eds.). Springer International Publishing, 382-398. doi:10.1007/978-3-319-46454-1\_24 - · DOI · Paper page
  8. [12][12] Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization (Ann Arbor, Michigan, 2005-06), Jade Goldstein, Alon Lavie, Chin-Yew Lin, and Clare Voss (Eds.). Association for Computational Linguistics, 65-72. https://aclanthology.org/W05-0909/ -
  9. [17][17] Nilavra Bhattacharya, Qing Li, and Danna Gurari. 2019. Why Does a Visual Question Have Different Answers?. In Proceedings of the IEEE/CVF International Conference on Computer Vision (2019). 4271-4280. http://openaccess.thecvf.com/content\_ICCV\_2019/html/Bhattacharya\_Why\_ Does\_a\_Visual\_Question\_Have\_Different\_Answers\_ICCV\_2019\_paper.html -
  10. [18][18] Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, and Tom Yeh. 2010. VizWiz: Nearly Real-Time Answers to Visual Questions. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York New York USA, 2010-10-03). ACM, 333-342. doi:10.1145/1866029.1866080 - · DOI · Paper page
  11. [19][19] Erin Brady, Meredith Ringel Morris, Yu Zhong, Samuel White, and Jeffrey P. Bigham. 2013. Visual Challenges in the Everyday Lives of Blind People. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris France, 2013-04-27). ACM, 2117-2126. doi:10.1145/2470654.2481291 - · DOI
  12. [20][20] Danielle Bragg, Naomi Caselli, Julie A Hochgesang, Matt Huenerfauth, Leah Katz-Hernandez, Oscar Koller, Raja Kushalnagar, Christian Vogler, and Richard E Ladner. 2021. The fate landscape of sign language ai datasets: An interdisciplinary perspective. ACM Transactions on Accessible Computing (TACCESS) 14, 2 (2021), 1-45. -
  13. [21][21] Yang Trista Cao, Kyle Seelman, Kyungjun Lee, and Hal Daumé III. 2022. What's Different between Visual Question Answering for Machine 'Understanding' Versus for Accessibility?. In Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , Yulan He, Heng Ji, Sujian Li, Yang Liu, and Chua-Hui Chang (Eds.). Association for Computational Linguistics, Online only, 1025-1034. doi:10.18653/v1/2022.aaclmain.75 - · DOI
  14. [22][22] Peter Carragher, Nikitha Rao, Abhinand Jha, R. Raghav, and Kathleen M. Carley. 2025. SegSub: Evaluating Robustness to Knowledge Conflicts and Hallucinations in Vision-Language Models. Workshop Proceedings of the 19th International AAAI Conference on Web and Social Media 2025 (June 2025), 27. doi:10.36190/2025.27 - · DOI
  15. [23][23] David M. Chan, Austin Myers, Sudheendra Vijayanarasimhan, David A. Ross, and John Canny. 2023. IC3: Image Captioning by Committee Consensus. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 8975-9003. doi:10.18653/v1/2023.emnlpmain.556 - · DOI
  16. [24][24] Ruei-Che Chang, Yuxuan Liu, and Anhong Guo. 2024. WorldScribe: Towards Context-Aware Live Visual Descriptions. In Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST '24) . Association for Computing Machinery, New York, NY, USA, 1-18. doi:10.1145/3654777.3676375 - · DOI
  17. [25][25] Ruei-Che Chang, Yuxuan Liu, Lotus Zhang, and Anhong Guo. 2024. EditScribe: Non-Visual Image Editing with Natural Language Verification Loops. In Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '24) . Association for Computing Machinery, New York, NY, USA, 1-19. doi:10.1145/3663548.3675599 - · DOI
  18. [26][26] Ruei-Che Chang, Rosiana Natalie, Wenqian Xu, Jovan Zheng Feng Yap, and Anhong Guo. 2025. Probing the Gaps in ChatGPT's Live Video Chat for Real-World Assistance for People Who Are Blind or Visually Impaired. In Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '25) . Association for Computing Machinery, New York, NY, USA, 1-14. doi:10.1145/3663547.3746319 - · DOI
  19. [27][27] Meng Chen, Akhil Iyer, and Amy Pavel. 2025. Surfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptions. In Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '25) . Association for Computing Machinery, New York, NY, USA, 1-17. doi:10.1145/3663547.3746393 - · DOI · Paper page
  20. [28][28] Xinlei Chen, Hao Fang, Tsung-Yi Lin, Ramakrishna Vedantam, Saurabh Gupta, Piotr Dollar, and C. Lawrence Zitnick. 2015. Microsoft COCO Captions: Data Collection and Evaluation Server . doi:10.48550/arXiv.1504.00325 arXiv:1504.00325 [cs] - · DOI · Paper page
  21. [29][29] Zhaorun Chen, Zhuokai Zhao, Hongyin Luo, Huaxiu Yao, Bo Li, and Jiawei Zhou. 2024. HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding. In Proceedings of the 41st International Conference on Machine Learning (ICML'24, Vol. 235) . JMLR.org, Vienna, Austria, 7824-7846. -
  22. [30][30] Tai-Yin Chiu, Yinan Zhao, and Danna Gurari. 2020. Assessing Image Quality Issues for Real-World Problems. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 3643-3653. doi:10.1109/CVPR42600.2020.00370 - · DOI · Paper page
  23. [31][31] Hyungjin Chung, Jeongsol Kim, Michael T Mccann, Marc L Klasky, and Jong Chul Ye. 2023. Diffusion posterior sampling for general noisy inverse problems. In ICLR . -
  24. [32][32] Jeremy Cole, Michael Zhang, Daniel Gillick, Julian Eisenschlos, Bhuwan Dhingra, and Jacob Eisenstein. 2023. Selectively Answering Ambiguous Questions. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 530-543. doi:10.18653/v1/2023.emnlpmain.35 - · DOI
  25. [33][33] Nathan Davis, Bo Xie, and Danna Gurari. 2020. Quality of Images Showing Medication Packaging from Individuals with Vision Impairments: Implications for the Design of Visual Question Answering Applications. 57, 1 (2020), e251. doi:10.1002/pra2.251 - · DOI · Paper page
  26. [34][34] DeepSeek-AI, Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, Damai Dai, Daya Guo, Dejian Yang, Deli Chen, Dongjie Ji, Erhang Li, Fangyun Lin, Fucong Dai, Fuli Luo, Guangbo Hao, Guanting Chen, Guowei Li, H. Zhang, Han Bao, Hanwei Xu, Haocheng Wang, Haowei Zhang, Honghui Ding, Huajian Xin, Huazuo Gao, Hui Li, Hui Qu, J. L. Cai, Jian Liang, Jianzhong Guo, Jiaqi Ni, Jiashi Li, Jiawei Wang, Jin Chen, Jingchang Chen, Jingyang Yuan, Junjie Qiu, Junlong Li, Junxiao Song, Kai Dong, Kai Hu, Kaige Gao, Kang Guan, Kexin Huang, Kuai Yu, Lean Wang, Lecong Zhang, Lei Xu, Leyi Xia, Liang Zhao, Litong Wang, Liyue Zhang, Meng Li, Miaojun Wang, Mingchuan Zhang, Minghua Zhang, Minghui Tang, Mingming Li, Ning Tian, Panpan Huang, Peiyi Wang, Peng Zhang, Qiancheng Wang, Qihao Zhu, Qinyu Chen, Qiushi Du, R. J. Chen, R. L. Jin, Ruiqi Ge, Ruisong Zhang, Ruizhe Pan, Runji Wang, Runxin Xu, Ruoyu Zhang, Ruyi Chen, S. S. Li, Shanghao Lu, Shangyan Zhou, Shanhuang Chen, Shaoqing Wu, Shengfeng Ye, Shengfeng Ye, Shirong Ma, Shiyu Wang, Shuang Zhou, Shuiping Yu, Shunfeng Zhou, Shuting Pan, T. Wang, Tao Yun, Tian Pei, Tianyu Sun, W. L. Xiao, Wangding Zeng, Wanjia Zhao, Wei An, Wen Liu, Wenfeng Liang, Wenjun Gao, Wenqin Yu, Wentao Zhang, X. Q. Li, Xiangyue Jin, Xianzu Wang, Xiao Bi, Xiaodong Liu, Xiaohan Wang, Xiaojin Shen, Xiaokang Chen, Xiaokang Zhang, Xiaosha Chen, Xiaotao Nie, Xiaowen Sun, Xiaoxiang Wang, Xin Cheng, Xin Liu, Xin Xie, Xingchao Liu, Xingkai Yu, Xinnan Song, Xinxia Shan, Xinyi Zhou, Xinyu Yang, Xinyuan Li, Xuecheng Su, Xuheng Lin, Y. K. Li, Y. Q. Wang, Y. X. Wei, Y. X. Zhu, Yang Zhang, Yanhong Xu, Yanhong Xu, Yanping Huang, Yao Li, Yao Zhao, Yaofeng Sun, Yaohui Li, Yaohui Wang, Yi Yu, Yi Zheng, Yichao Zhang, Yifan Shi, Yiliang Xiong, Ying He, Ying Tang, Yishi Piao, Yisong Wang, Yixuan Tan, Yiyang Ma, Yiyuan Liu, Yongqiang Guo, Yu Wu, Yuan Ou, Yuchen Zhu, Yuduan Wang, Yue Gong, Yuheng Zou, Yujia He, Yukun Zha, Yunfan Xiong, Yunxian Ma, Yuting Yan, Yuxiang Luo, Yuxiang You, Yuxuan Liu, Yuyang Zhou, Z. F. Wu, Z. Z. Ren, Zehui Ren, Zhangli Sha, Zhe Fu, Zhean Xu, Zhen Huang, Zhen Zhang, Zhenda Xie, Zhengyan Zhang, Zhewen Hao, Zhibin Gou, Zhicheng Ma, Zhigang Yan, Zhihong Shao, Zhipeng Xu, Zhiyu Wu, Zhongyu Zhang, Zhuoshu Li, Zihui Gu, Zijia Zhu, Zijun Liu, Zilin Li, Ziwei Xie, Ziyang Song, Ziyi Gao, and Zizheng Pan. 2025. DeepSeek-V3 Technical Report. doi:10.48550/arXiv.2412.19437 arXiv:2412.19437 [cs] - · DOI · Paper page
  27. [35][35] Matt Deitke, Christopher Clark, Sangho Lee, Rohun Tripathi, Yue Yang, Jae Sung Park, Mohammadreza Salehi, Niklas Muennighoff, Kyle Lo, Luca Soldaini, Jiasen Lu, Taira Anderson, Erin Bransom, Kiana Ehsani, Huong Ngo, YenSung Chen, Ajay Patel, Mark Yatskar, Chris Callison-Burch, Andrew Head, Rose Hendrix, Favyen Bastani, Eli VanderBilt, Nathan Lambert, Yvonne Chou, Arnavi Chheda, Jenna Sparks, Sam Skjonsberg, Michael Schmitz, Aaron Sarnat, Byron Bischoff, Pete Walsh, Chris Newell, Piper Wolters, Tanmay Gupta, Kuo-Hao Zeng, Jon Borchardt, Dirk Groeneveld, Crystal Nam, Sophie Lebrecht, Caitlin Wittlif, Carissa Schoenick, Oscar Michel, Ranjay Krishna, Luca Weihs, Noah A. Smith, Hannaneh Hajishirzi, Ross Girshick, Ali Farhadi, and Aniruddha Kembhavi. 2025. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 91-104. -
  28. [36][36] Ailin Deng, Tri Cao, Zhirui Chen, and Bryan Hooi. 2025. Words or Vision: Do Vision-Language Models Have Blind Faith in Text?. In 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 3867-3876. doi:10.1109/ CVPR52734.2025.00366 -
  29. [37][37] Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: A Large-Scale Hierarchical Image Database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition . 248-255. doi:10.1109/CVPR.2009. 5206848 - · DOI
  30. [38][38] Aashaka Desai, Lauren Berger, Fyodor Minakov, Nessa Milano, Chinmay Singh, Kriston Pumphrey, Richard Ladner, Hal Daumé III, Alex X Lu, Naomi Caselli, et al. 2023. ASL citizen: a community-sourced dataset for advancing isolated sign language recognition. Advances in Neural Information Processing Systems 36 (2023), 76893-76907. -
  31. [39][39] Tim Dettmers and Luke Zettlemoyer. 2023. The Case for 4-Bit Precision: KBit Inference Scaling Laws. In Proceedings of the 40th International Conference on Machine Learning (ICML'23, Vol. 202) . JMLR.org, Honolulu, Hawaii, USA, 7750-7774. -
  32. [40][40] Jinhao Duan, Fei Kong, Hao Cheng, James Diffenderfer, Bhavya Kailkhura, Lichao Sun, Xiaofeng Zhu, Xiaoshuang Shi, and Kaidi Xu. 2025. TruthPrInt: Mitigating Large Vision-Language Models Object Hallucination Via Latent Truthful-Guided Pre-Intervention. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 7372-7382. -
  33. [43][43] Zhiyuan Fan, Yumeng Wang, Sandeep Polisetty, and Yi R. Fung. 2025. Unveiling the Lack of LVLM Robustness to Fundamental Visual Variations: Why and Path Forward. In Findings of the Association for Computational Linguistics: ACL 2025 , Wanxiang Che, Joyce Nabende, Ekaterina Shutova, and Mohammad Taher Pilehvar (Eds.). Association for Computational Linguistics, Vienna, Austria, 20222-20242. doi:10.18653/v1/2025.findings-acl.1037 - · DOI · Paper page
  34. [44][44] Zilin Fang, Andrey Ignatov, Eduard Zamfir, and Radu Timofte. 2023. SQAD: Automatic Smartphone Camera Quality Assessment and Benchmarking. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 2053220542. -
  35. [45][45] Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis, and William T. Freeman. 2006. Removing Camera Shake from a Single Photograph. 25, 3 (2006), 787-794. doi:10.1145/1141911.1141956 - · DOI
  36. [46][46] Elias Frantar, Saleh Ashkboos, Torsten Hoefler, and Dan Alistarh. 2023. OPTQ: Accurate Quantization for Generative Pre-trained Transformers. In The Eleventh International Conference on Learning Representations . https://iclr.cc/virtual/ 2023/poster/10855 -
  37. [47][47] Vinitha Gadiraju, Shaun Kane, Sunipa Dev, Alex Taylor, Ding Wang, Remi Denton, and Robin Brewer. 2023. 'I wouldn't say offensive but...': DisabilityCentered Perspectives on Large Language Models. In Proceedings of the 2023 ACMConference on Fairness, Accountability, and Transparency (Chicago, IL, USA) (FAccT '23) . Association for Computing Machinery, New York, NY, USA, 205-216. doi:10.1145/3593013.3593989 - · DOI · Paper page
  38. [48][48] Bhanuka Gamage, Thanh-Toan Do, Nicholas Seow Chiang Price, Arthur Lowery, and Kim Marriott. 2023. What Do Blind and Low-Vision People Really Want from Assistive Smart Devices? Comparison of the Literature with a Focus Study. In Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA, 2023-10-22) (ASSETS '23) . Association for Computing Machinery, 1-21. doi:10.1145/3597638.3608955 - · DOI · Paper page
  39. [49][49] S. Alireza Golestaneh, Saba Dadsetan, and Kris M. Kitani. 2022. No-Reference Image Quality Assessment via Transformers, Relative Ranking, and SelfConsistency. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision . 1220-1230. -
  40. [50][50] Ricardo E Gonzalez Penuela, Jazmin Collins, Cynthia Bennett, and Shiri Azenkot. 2024. Investigating Use Cases of AI-Powered Scene Description Applications for Blind and Low Vision People. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI '24) . Association for Computing Machinery, New York, NY, USA, 1-21. doi:10.1145/3613904.3642211 - · DOI
  41. [51][51] Steven M. Goodman, Ping Liu, Dhruv Jain, Emma J. McDonnell, Jon E. Froehlich, and Leah Findlater. 2021. Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 2, Article 63 (June 2021), 23 pages. doi:10.1145/ 3463501 -
  42. [54][54] Danna Gurari and Kristen Grauman. 2017. CrowdVerge: Predicting If People Will Agree on the Answer to a Visual Question. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 201705-02) (CHI '17) . Association for Computing Machinery, 3511-3522. doi:10.1145/ 3025453.3025781 -
  43. [55][55] Danna Gurari, Qing Li, Abigale J. Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, and Jeffrey P. Bigham. 2018. VizWiz Grand Challenge: Answering Visual Questions from Blind People. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . 3608-3617. doi:10.1109/CVPR.2018.00380 - · DOI · Paper page
  44. [56][56] Danna Gurari, Yinan Zhao, Meng Zhang, and Nilavra Bhattacharya. 2020. Captioning Images Taken by People Who Are Blind. In Computer Vision - ECCV 2020 , Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm (Eds.). Vol. 12362. Springer International Publishing, 417-434. doi:10.1007/9783-030-58520-4\_25 - · DOI
  45. [57][57] Dan Hendrycks and Thomas Dietterich. 2019. Benchmarking Neural Network Robustness to Common Corruptions and Perturbations. In International Conference on Learning Representations . -
  46. [58][58] Jaylin Herskovitz, Andi Xu, Rahaf Alharbi, and Anhong Guo. 2024. ProgramAlly: Creating Custom Visual Access Programs via Multi-Modal End-User Programming. In Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST '24) . Association for Computing Machinery, New York, NY, USA, 1-15. doi:10.1145/3654777.3676391 - · DOI
  47. [59][59] Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, and Yejin Choi. 2021. CLIPScore: A Reference-free Evaluation Metric for Image Captioning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , Marie-Francine Moens, Xuanjing Huang, Lucia Specia, and Scott Wen-tau Yih (Eds.). Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, 7514-7528. doi:10.18653/v1/2021.emnlp-main.595 - · DOI · Paper page
  48. [60][60] Jonggi Hong, Jaina Gandhi, Ernest Essuah Mensah, Farnaz Zamiri Zeraati, Ebrima Jarjue, Kyungjun Lee, and Hernisa Kacorri. 2022. Blind Users Accessing Their Training Images in Teachable Object Recognizers. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (Athens Greece, 2022-10-23). ACM, 1-18. doi:10.1145/3517428.3544824 - · DOI · Paper page
  49. [61][61] Jonggi Hong and Hernisa Kacorri. 2024. Understanding How Blind Users Handle Object Recognition Errors: Strategies and Challenges. In Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA, 2024-10-27) (ASSETS '24) . Association for Computing Machinery, 1-15. doi:10.1145/3663548.3675635 - · DOI · Paper page
  50. [62][62] Mina Huh, Yi-Hao Peng, and Amy Pavel. 2023. GenAssist: Making image generation accessible. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . 1-17. -
  51. [63][63] Mina Huh, Fangyuan Xu, Yi-Hao Peng, Chongyan Chen, Hansika Murugu, Danna Gurari, Eunsol Choi, and Amy Pavel. 2024. Long-Form Answers to Visual Questions from Blind and Low Vision People. In First Conference on Language Modeling . -
  52. [64][64] Chandrika Jayant, Hanjie Ji, Samuel White, and Jeffrey P. Bigham. 2011. Supporting Blind Photography. In The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '11) . Association for Computing Machinery, New York, NY, USA, 203-210. doi:10.1145/2049536. 2049573 - · DOI
  53. [65][65] Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, and Jianfeng Gao. 2019. TIGEr: Text-to-Image Grounding for Image Caption Evaluation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan (Eds.). Association for Computational Linguistics, Hong Kong, China, 2141-2152. doi:10.18653/v1/D19-1220 - · DOI · Paper page
  54. [66][66] Hernisa Kacorri, Kris M. Kitani, Jeffrey P. Bigham, and Chieko Asakawa. 2017. People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2017-05-02) (CHI '17) . Association for Computing Machinery, 5839-5849. doi:10.1145/3025453.3025899 - · DOI
  55. [68][68] Insoo Kim, Seungju Han, Ji-won Baek, Seong-Jin Park, Jae-Joon Han, and Jinwoo Shin. 2021. Quality-Agnostic Image Recognition via Invertible Decoder. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 12257-12266. -
  56. [69][69] Sunnie S. Y. Kim, Q. Vera Liao, Mihaela Vorvoreanu, Stephanie Ballard, and Jennifer Wortman Vaughan. 2024. 'I'm Not Sure, But...': Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust. In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency (FAccT '24) . Association for Computing Machinery, New York, NY, USA, 822-835. doi:10.1145/3630106.3658941 - · DOI · Paper page
  57. [70][70] Lorenz Kuhn, Yarin Gal, and Sebastian Farquhar. 2023. Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation. In The Eleventh International Conference on Learning Representations . -
  58. [72][72] Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, and Kyomin Jung. 2020. Vilbertscore: Evaluating image caption using vision-and-language bert. In Proceedings of the first workshop on evaluation and comparison of NLP systems . 34-39. -
  59. [73][73] Jaewook Lee, Jaylin Herskovitz, Yi-Hao Peng, and Anhong Guo. 2022. ImageExplorer: Multi-Layered Touch Exploration to Encourage Skepticism Towards Imperfect AI-Generated Image Captions. In CHI Conference on Human Factors in Computing Systems (New Orleans LA USA, 2022-04-29). ACM, 1-15. doi:10.1145/3491102.3501966 - · DOI · Paper page
  60. [74][74] Kyungjun Lee, Jonggi Hong, Simone Pimento, Ebrima Jarjue, and Hernisa Kacorri. 2019. Revisiting Blind Photography in the Context of Teachable Object Recognizers. In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA, 2019-10-24) (ASSETS '19) . Association for Computing Machinery, 83-95. doi:10.1145/3308561.3353799 - · DOI
  61. [75][75] Kuang-Huei Lee, Xi Chen, Gang Hua, Houdong Hu, and Xiaodong He. 2018. Stacked cross attention for image-text matching. In Proceedings of the European conference on computer vision (ECCV) . 201-216. -
  62. [76][76] Sooyeon Lee, Madison Reddie, and John M. Carroll. 2021. Designing for Independence for People with Visual Impairments. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 149 (April 2021), 19 pages. doi:10.1145/3449223 - · DOI
  63. [77][77] Sooyeon Lee, Madison Reddie, Chun-Hua Tsai, Jordan Beck, Mary Beth Rosson, and John M Carroll. 2020. The emerging professional practice of remote sighted assistance for people with visual impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems . 1-12. -
  64. [78][78] Sicong Leng, Hang Zhang, Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, and Lidong Bing. 2024. Mitigating Object Hallucinations in Large VisionLanguage Models through Visual Contrastive Decoding. 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (June 2024), 1387213882. doi:10.1109/CVPR52733.2024.01316 - · DOI · Paper page
  65. [79][79] Qisheng Li and Shaomei Wu. 2024. 'I Want to Publicize My Stutter': Communityled Collection and Curation of Chinese Stuttered Speech Data. Proceedings of the ACM on Human-Computer Interaction 8, CSCW2 (2024), 1-27. -
  66. [80][80] Zhiqi Li, Guo Chen, Shilong Liu, Shihao Wang, Vibashan VS, Yishen Ji, Shiyi Lan, Hao Zhang, Yilin Zhao, Subhashree Radhakrishnan, Nadine Chang, Karan Sapra, Amala Sanjay Deshmukh, Tuomas Rintamaki, Matthieu Le, Ilia Karmanov, Lukas Voegtle, Philipp Fischer, De-An Huang, Timo Roman, Tong Lu, Jose M. Alvarez, Bryan Catanzaro, Jan Kautz, Andrew Tao, Guilin Liu, and Zhiding Yu. 2025. Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Models. doi:10.48550/arXiv.2501.14818 arXiv:2501.14818 [cs] - · DOI · Paper page
  67. [81][81] Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out (Barcelona, Spain, 2004-07). Association for Computational Linguistics, 74-81. https://aclanthology.org/W04-1013/ -
  68. [82][82] Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. In Computer Vision - ECCV 2014 , David Fleet, Tomas Pajdla, Bernt Schiele, and Tinne Tuytelaars (Eds.). Springer International Publishing, Cham, 740-755. doi:10.1007/978-3-319-10602-1\_48 - · DOI · Paper page
  69. [84][84] Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. 2023. Visual Instruction Tuning. Advances in Neural Information Processing Systems 36 (December 2023), 34892-34916. -
  70. [85][85] Huan Liu, Lingyu Xiao, Jiangjiang Liu, Xiaofan Li, Ze Feng, Sen Yang, and Jingdong Wang. 2024. Revisiting MLLMs: An In-Depth Analysis of Image Classification Abilities. CoRR abs/2412.16418 (December 2024). - · arXiv
  71. [87][87] Ximing Lu et al. 2023. Inference-Time Policy Adapters (IPA): Tailoring ExtremeScale LMs without Fine-tuning. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics, 6863-6883. -
  72. [88][88] Jianqi Ma, Weiyuan Shao, Hao Ye, Li Wang, Hong Wang, Yingbin Zheng, and Xiangyang Xue. 2018. Arbitrary-oriented scene text detection via rotation proposals. IEEE Transactions on Multimedia 20, 11 (2018), 3111-3122. -
  73. [89][89] Xiaoyu Ma, Chenxi Feng, Jiaojiao Wang, Qiang Lin, Suiyu Zhang, Jinchi Zhu, Xiaodiao Chen, Chang Liu, and Dingguo Yu. 2023. A Model-Agnostic SemanticQuality Compatible Framework Based on Self-Supervised Semantic Decoupling. In Proceedings of the 31st ACM International Conference on Multimedia (MM '23) . Association for Computing Machinery, New York, NY, USA, 6774-6784. doi:10.1145/3581783.3613775 - · DOI
  74. [90][90] Haley MacLeod, Cynthia L. Bennett, Meredith Ringel Morris, and Edward Cutrell. 2017. Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2017-05-02) (CHI '17) . Association for Computing Machinery, 5988-5999. doi:10.1145/3025453.3025814 - · DOI · Paper page
  75. [91][91] Potsawee Manakul, Adian Liusie, and Mark Gales. 2023. SelfCheckGPT: ZeroResource Black-Box Hallucination Detection for Generative Large Language Models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 9004-9017. doi:10.18653/v1/ 2023.emnlp-main.557 - · DOI
  76. [92][92] Maniratnam Mandal, Deepti Ghadiyaram, Danna Gurari, and Alan C. Bovik. 2023. Helping Visually Impaired People Take Better Quality Pictures. 32 (2023), 3873-3884. doi:10.1109/TIP.2023.3282067 - · DOI · Paper page
  77. [93][93] H. B. Mann and D. R. Whitney. 1947. On a Test of Whether One of Two Random Variables Is Stochastically Larger than the Other. 18, 1 (1947), 50-60. jstor:2236101 https://www.jstor.org/stable/2236101 -
  78. [96][96] Ananya Gubbi Mohanbabu and Amy Pavel. 2024. Context-Aware Image Descriptions for Web Accessibility. In Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA, 2024-10-27) (ASSETS '24) . Association for Computing Machinery, 1-17. doi:10.1145/3663548.3675658 - · DOI
  79. [97][97] Cecily Morrison, Martin Grayson, Rita Faia Marques, Daniela Massiceti, Camilla Longden, Linda Wen, and Edward Cutrell. 2023. Understanding Personalized Accessibility through Teachable AI: Designing and Evaluating Find My Things for People Who Are Blind or Low Vision. In Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA, 2023-10-22) (ASSETS '23) . Association for Computing Machinery, 1-12. [doi:10.1145/3597638.3608395](https://doi.org/10.1145/3597638.3608395) - · DOI
  80. [98][98] Thao Nguyen, Samir Yitzhak Gadre, Gabriel Ilharco, Sewoong Oh, and Ludwig Schmidt. 2023. Improving Multimodal Datasets with Image Captioning. In Proceedings of the 37th International Conference on Neural Information Processing Systems (NIPS '23) . Curran Associates Inc., Red Hook, NY, USA, 22047-22069. -
  81. [102][102] Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2001. BLEU: A Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 (Philadelphia, Pennsylvania, 2001). Association for Computational Linguistics, 311. doi:10.3115/1073083.1073135 - · DOI · Paper page
  82. [103][103] Sohyeon Park, Aehong Min, Jesus Armando Beltran, and Gillian R Hayes. 2025. 'As an Autistic Person Myself:' The Bias Paradox Around Autism in LLMs. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25) . Association for Computing Machinery, New York, NY, USA, Article 774, 17 pages. doi:10.1145/3706598.3713420 - · DOI
  83. [104][104] Vishnu Prabhakaran, Purav Aggarwal, Vishruit Kulshreshtha, Arunita Das, Sahini Venkata Sitaram Sruti, and Anoop Saladi. 2025. VIT-Pro: Visual Instruction Tuning for Product Images. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 3: Industry Track) , Weizhu Chen, Yi Yang, Mohammad Kachuee, and Xue-Yong Fu (Eds.). Association for Computational Linguistics, Albuquerque, New Mexico, 695-707. -
  84. [105][105] Jiyang Qi, Yan Gao, Yao Hu, Xinggang Wang, Xiaoyu Liu, Xiang Bai, Serge Belongie, Alan Yuille, Philip HS Torr, and Song Bai. 2022. Occluded video instance segmentation: A benchmark. International Journal of Computer Vision 130, 8 (2022), 2022-2039. -
  85. [106][106] Lianhui Qin, Sean Welleck, Daniel Khashabi, and Yejin Choi. 2022. Cold decoding: Energy-based constrained text generation with langevin dynamics. Advances in Neural Information Processing Systems 35 (2022), 9538-9551. -
  86. [107][107] Jielin Qiu, Yi Zhu, Xingjian Shi, Florian Wenzel, Zhiqiang Tang, Ding Zhao, Bo Li, and Mu Li. 2024. Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift. Journal of Data-centric Machine Learning Research} (Jan. 2024). doi:10.48550/arXiv.2212.08044 arXiv:2212.08044 [cs] - · DOI · Paper page
  87. [108][108] Sreetama Sarkar, Yue Che, Alex Gavin, Peter Anthony Beerel, and Souvik Kundu. 2025. Mitigating Hallucinations in Vision-Language Models through ImageGuided Head Suppression. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing , Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, and Violet Peng (Eds.). Association for Computational Linguistics, Suzhou, China, 12492-12511. doi:10.18653/v1/2025.emnlpmain.631 - · DOI
  88. [109][109] Ashutosh Saxena, Justin Driemeyer, and Andrew Y Ng. 2009. Learning 3-d object orientation from images. In 2009 IEEE International conference on robotics and automation . IEEE, 794-800. -
  89. [110][110] Hope Schroeder, Deb Roy, and Jad Kabbara. 2025. Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks. In Findings of the Association for Computational Linguistics: ACL 2025 , Wanxiang Che, Joyce Nabende, Ekaterina Shutova, and Mohammad Taher Pilehvar (Eds.). Association for Computational Linguistics, Vienna, Austria, 25771-25795. -
  90. [111][111] Tanusree Sharma, Abigale Stangl, Lotus Zhang, Yu-Yun Tseng, Inan Xu, Leah Findlater, Danna Gurari, and Yang Wang. 2023. Disability-First Design and Creation of A Dataset Showing Private Visual Information Collected With People Who Are Blind. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23) . Association for Computing Machinery, New York, NY, USA, 1-15. doi:10.1145/3544548.3580922 - · DOI · Paper page
  91. [113][113] Rachel N. Simons, Danna Gurari, and Kenneth R. Fleischmann. 2020. 'I Hope This Is Helpful': Understanding Crowdworkers' Challenges and Motivations for an Image Description Task. 4 (2020), 1-26. Issue CSCW2. doi:10.1145/3415176 - · DOI · Paper page
  92. [114][114] Abigale Stangl, Emma Sadjo, Pardis Emami-Naeini, Yang Wang, Danna Gurari, and Leah Findlater. 2023. 'Dump It, Destroy It, Send It to Data Heaven': Blind People's Expectations for Visual Privacy in Visual Assistance Technologies. In Proceedings of the 20th International Web for All Conference (New York, NY, USA, 2023-04-30) (W4A '23) . Association for Computing Machinery, 134-147. doi:10.1145/3587281.3587296 - · DOI · Paper page
  93. [115][115] Abigale Stangl, Kristina Shiroma, Nathan Davis, Bo Xie, Kenneth R. Fleischmann, Leah Findlater, and Danna Gurari. 2022. Privacy Concerns for Visual Assistance Technologies. ACM Trans. Access. Comput. 15, 2, Article 15 (May 2022), 43 pages. doi:10.1145/3517384 - · DOI · Paper page
  94. [116][116] Abigale Stangl, Nitin Verma, Kenneth R. Fleischmann, Meredith Ringel Morris, and Danna Gurari. 2021. Going Beyond One-Size-Fits-All Image Descriptions to Satisfy the Information Wants of People Who Are Blind or Have Low Vision. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA, 2021-10-17) (ASSETS '21) . Association for Computing Machinery, 1-15. doi:10.1145/3441852.3471233 - · DOI · Paper page
  95. [117][117] Mark Steyvers, Heliodoro Tejeda, Aakriti Kumar, Catarina Belem, Sheer Karny, Xinyue Hu, Lukas W. Mayer, and Padhraic Smyth. 2025. What Large Language Models Know and What People Think They Know. 7, 2 (2025), 221-231. doi:10. 1038/s42256-024-00976-7 -
  96. [118][118] Jian Sun, Wenfei Cao, Zongben Xu, and Jean Ponce. 2015. Learning a convolutional neural network for non-uniform motion blur removal. In Proceedings of the IEEE conference on computer vision and pattern recognition . 769-777. -
  97. [119][119] Zhen Tan, Dawei Li, Song Wang, Alimohammad Beigi, Bohan Jiang, Amrita Bhattacharjee, Mansooreh Karami, Jundong Li, Lu Cheng, and Huan Liu. 2024. Large Language Models for Data Annotation and Synthesis: A Survey. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , Yaser Al-Onaizan, Mohit Bansal, and Yun-Nung Chen (Eds.). Association for Computational Linguistics, Miami, Florida, USA, 930-957. doi:10.18653/v1/2024.emnlp-main.54 - · DOI · Paper page
  98. [120][120] Xinru Tang, Ali Abdolrahmani, Darren Gergle, and Anne Marie Piper. 2025. Everyday Uncertainty: How Blind People Use GenAI Tools for Information Access. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems . 1-17. -
  99. [121][121] Yilin Tang, Yuyang Fang, Tianle Wang, Lingyun Sun, and Liuqing Chen. 2025. 'This Is My Fault', Really? Understanding Blind and Low-Vision People's Perception of Hallucination in Large Vision Language Models. In Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST '25) . Association for Computing Machinery, New York, NY, USA, 1-20. doi:10.1145/3746059.3747597 - · DOI
  100. [122][122] Aman Singh Thakur, Kartik Choudhary, Venkat Srinik Ramayapally, Sankaran Vaidyanathan, and Dieuwke Hupkes. 2025. Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges. In Proceedings of the Fourth Workshop on Generation, Evaluation and Metrics (GEM 2 ) , Ofir Arviv, Miruna Clinciu, Kaustubh Dhole, Rotem Dror, Sebastian Gehrmann, Eliya Habba, Itay Itzhak, Simon Mille, Yotam Perlitz, Enrico Santus, João Sedoc, Michal Shmueli Scheuer, Gabriel Stanovsky, and Oyvind Tafjord (Eds.). Association for Computational Linguistics, Vienna, Austria and virtual meeting, 404-430. -
  101. [124][124] Lida Theodorou, Daniela Massiceti, Luisa Zintgraf, Simone Stumpf, Cecily Morrison, Edward Cutrell, Matthew Tobias Harris, and Katja Hofmann. 2021. Disability-first dataset creation: Lessons from constructing a dataset for teachable object recognition with blind and low vision data collectors. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility . 1-12. -
  102. [126][126] Tess Van Daele, Akhil Iyer, Yuning Zhang, Jalyn C Derry, Mina Huh, and Amy Pavel. 2024. Making short-form videos accessible with hierarchical video summaries. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems . 1-17. -
  103. [127][127] Marynel Vázquez and Aaron Steinfeld. 2014. An Assisted Photography Framework to Help Visually Impaired Users Properly Aim a Camera. ACM Trans. Comput.-Hum. Interact. 21, 5 (Nov. 2014), 25:1-25:29. doi:10.1145/2651380 - · DOI
  104. [128][128] Ramakrishna Vedantam, C. Lawrence Zitnick, and Devi Parikh. 2015. CIDEr: Consensus-Based Image Description Evaluation. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . 4566-4575. doi:10.1109/CVPR. 2015.7299087 - · DOI
  105. [129][129] Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. 2015. Show and Tell: A Neural Image Caption Generator. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Boston, MA, USA, 2015-06). IEEE, 3156-3164. doi:10.1109/CVPR.2015.7298935 - · DOI · Paper page
  106. [130][130] Tess Winlock, Eric Christiansen, and Serge Belongie. 2010. Toward Real-Time Grocery Detection for the Visually Impaired. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops . 49-56. doi:10.1109/CVPRW.2010.5543576 - · DOI
  107. [131][131] Tsung-Han Wu, Heekyung Lee, Jiaxin Ge, Joseph E. Gonzalez, Trevor Darrell, and David M. Chan. 2025. Generate, but Verify: Reducing Hallucination in Vision-Language Models with Retrospective Resampling. In The Thirty-Ninth Annual Conference on Neural Information Processing Systems . -
  108. [132][132] Jingyi Xie, Rui Yu, He Zhang, Syed Masum Billah, Sooyeon Lee, and John M. Carroll. 2025. Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25) . Association for Computing Machinery, New York, NY, USA, 1-17. doi:10.1145/ 3706598.3714210 -
  109. [133][133] Yasin Abbasi Yadkori, Ilja Kuzborskij, David Stutz, András György, Adam Fisch, Arnaud Doucet, Iuliya Beloshapka, Wei-Hung Weng, Yao-Yuan Yang, Csaba Szepesvári, et al. 2024. Mitigating LLM Hallucinations via Conformal Abstention. arXiv preprint arXiv:2405.01563 (2024). - · arXiv
  110. [134][134] An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, Chujie Zheng, Dayiheng Liu, Fan Zhou, Fei Huang, Feng Hu, Hao Ge, Haoran Wei, Huan Lin, Jialong Tang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jing Zhou, Jingren Zhou, Junyang Lin, Kai Dang, Keqin Bao, Kexin Yang, Le Yu, Lianghao Deng, Mei Li, Mingfeng Xue, Mingze Li, Pei Zhang, Peng Wang, Qin Zhu, Rui Men, Ruize Gao, Shixuan Liu, Shuang Luo, Tianhao Li, Tianyi Tang, Wenbiao Yin, Xingzhang Ren, Xinyu Wang, Xinyu Zhang, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yinger Zhang, Yu Wan, Yuqiong Liu, Zekun Wang, Zeyu Cui, Zhenru Zhang, Zhipeng Zhou, and Zihan Qiu. 2025. Qwen3 Technical Report. doi:10.48550/arXiv.2505.09388 arXiv:2505.09388 [cs] - · DOI · Paper page
  111. [135][135] Chun-Ju Yang, Kristen Grauman, and Danna Gurari. 2018. Visual Question Answer Diversity. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing (2018), Vol. 6. 184-192. https://ojs.aaai.org/index.php/ HCOMP/article/view/13341 -
  112. [136][136] Le Yang, Ziwei Zheng, Boxu Chen, Zhengyu Zhao, Chenhao Lin, and Chao Shen. 2025. Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projection. In 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 14635-14645. doi:10.1109/CVPR52734.2025.01364 - · DOI · Paper page
  113. [137][137] Sidi Yang, Tianhe Wu, Shuwei Shi, Shanshan Lao, Yuan Gong, Mingdeng Cao, Jiahao Wang, and Yujiu Yang. 2022. MANIQA: Multi-Dimension Attention Network for No-Reference Image Quality Assessment. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 1191-1200. -
  114. [138][138] Cong Yao, Xiang Bai, Wenyu Liu, Yi Ma, and Zhuowen Tu. 2012. Detecting texts of arbitrary orientations in natural images. In 2012 IEEE conference on computer vision and pattern recognition . 1083-1090. -
  115. [139][139] Shukang Yin, Chaoyou Fu, Sirui Zhao, Tong Xu, Hao Wang, Dianbo Sui, Yunhang Shen, Ke Li, Xing Sun, and Enhong Chen. 2024. Woodpecker: Hallucination Correction for Multimodal Large Language Models. Science China Information Sciences 67, 12 (December 2024), 220105. doi:10.1007/s11432-024-4251-x - · DOI
  116. [140][140] Gal Yona, Roee Aharoni, and Mor Geva. 2024. Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words?. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , Yaser Al-Onaizan, Mohit Bansal, and Yun-Nung Chen (Eds.). Association for Computational Linguistics, Miami, Florida, USA, 7752-7764. doi:10.18653/v1/2024.emnlpmain.443 - · DOI
  117. [141][141] Dokyoon Yoon, Youngsook Song, and Woomyong Park. 2025. Stop Learning It All to Mitigate Visual Hallucination, Focus on the Hallucination Target. 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (June 2025), 4200-4208. doi:10.1109/CVPR52734.2025.00397 - · DOI · Paper page
  118. [142][142] Lu Yu, Malvina Nikandrou, Jiali Jin, and Verena Rieser. 2023. Quality-Agnostic Image Captioning to Safely Assist People with Vision Impairment. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI '23) . Macao, P.R.China, 6281-6289. doi:10.24963/ijcai.2023/697 - · DOI
  119. [143][143] Xiaoyu Zeng, Yanan Wang, Tai-Yin Chiu, Nilavra Bhattacharya, and Danna Gurari. 2020. Vision Skills Needed to Answer Visual Questions. 4 (2020), 1-31. Issue CSCW2. doi:10.1145/3415220 - · DOI
  120. [144][144] Bohan Zhai, Shijia Yang, Chenfeng Xu, Sheng Shen, Kurt Keutzer, Chunyuan Li, and Manling Li. 2024. HallE-Control: Controlling Object Hallucination in Large Multimodal Models. doi:10.48550/arXiv.2310.01779 arXiv:2310.01779 [cs] - · DOI · Paper page
  121. [145][145] Guanqi Zhan, Weidi Xie, and Andrew Zisserman. 2022. A Tri-Layer Plugin to Improve Occluded Detection. In BMVC . -
  122. [146][146] Jinrui Zhang, Teng Wang, Haigang Zhang, Ping Lu, and Feng Zheng. 2024. Reflective Instruction Tuning: Mitigating Hallucinations in Large Vision-Language Models. In Computer Vision - ECCV 2024: 18th European Conference, Milan, Italy, September 29-October 4, 2024, Proceedings, Part LXVIII . Springer-Verlag, Berlin, Heidelberg, 196-213. doi:10.1007/978-3-031-73113-6\_12 - · DOI · Paper page
  123. [147][147] Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020. BERTScore: Evaluating Text Generation with BERT. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020 . https://openreview.net/forum?id=SkeHuCVFDr -
  124. [148][148] Yuhui Zhang, Alyssa Unell, Xiaohan Wang, Dhruba Ghosh, Yuchang Su, Ludwig Schmidt, and Serena Yeung-Levy. 2024. Why Are Visually-Grounded Language Models Bad at Image Classification? Advances in Neural Information Processing Systems 37 (December 2024), 51727-51753. -
  125. [149][149] Youjian Zhang, Chaoyue Wang, Stephen J Maybank, and Dacheng Tao. 2021. Exposure trajectory recovery from motion blur. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 11 (2021), 7490-7504. -
  126. [150][150] Linxi Zhao, Yihe Deng, Weitong Zhang, and Quanquan Gu. 2025. Mitigating Object Hallucination in Large Vision-Language Models via Image-Grounded Guidance. In Forty-Second International Conference on Machine Learning . -
  127. [151][151] Yuhang Zhao, Sarit Szpiro, Jonathan Knighten, and Shiri Azenkot. 2016. CueSee: Exploring Visual Cues for People with Low Vision to Facilitate a Visual Search Task. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Heidelberg Germany, 2016-09-12). ACM, 73-84. doi:10.1145/2971648.2971730 - · DOI · Paper page
  128. [152][152] Yuhang Zhao, Shaomei Wu, Lindsay Reynolds, and Shiri Azenkot. 2018. A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC Canada, 2018-04-21). ACM, 1-14. doi:10. 1145/3173574.3173789 -
  129. [153][153] Yi Zhao, Yilin Zhang, Rong Xiang, Jing Li, and Hillming Li. 2024. VIALM: A Survey and Benchmark of Visually Impaired Assistance with Large Models. doi:10.48550/arXiv.2402.01735 arXiv:2402.01735 [cs] - · DOI
  130. [154][154] Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023. Judging LLM-as-a-Judge with MTBench and Chatbot Arena. In Proceedings of the 37th International Conference on Neural Information Processing Systems (NIPS '23) . Curran Associates Inc., Red Hook, NY, USA, 46595-46623. -
  131. [155][155] Yiyang Zhou, Chenhang Cui, Jaehong Yoon, Linjun Zhang, Zhun Deng, Chelsea Finn, Mohit Bansal, and Huaxiu Yao. 2024. Analyzing and Mitigating Object Hallucination in Large Vision-Language Models. In The Twelfth International Conference on Learning Representations .

Cited by

Sorted by citations

Related

Authors
Garg, K., Tang, X., Heo, J., Morgan, D. R., Gergle, D., Sudderth, E. B., & Piper, A. M.
Affiliations
  • University of California, Irvine (US)
  • Northwestern University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
Pages
1-27
DOI
10.48550/arxiv.2511.08917
arXiv
2511.08917
OpenAlex
W4416219320
Cited by
2
References
0
Citations by year
2026: 2
FWCI
17.81
Type
conference paper
Language
en
Open access
Licence
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
National Science Foundation (2326023, 2326024)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
Keywords
vision-language models, blind and low vision people, image quality, blur, image rotation, assistive technology, accessibility, annotated dataset, user-centered evaluation, information needs

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review