A Survey on Evaluation of Large Language Models

Chang, Yupeng, Wang, Xu, Wang, Jindong, Wu, Yuan, Yang, Linyi, Zhu, Kaijie, Chen, Hao, Yi, Xiaoyuan, Wang, Cunxiang, Wang, Yidong, Ye, Wei, Zhang, Yue, Chang, Yi, Yu, Philip S., Yang, Qiang, Xie, Xing·2024·ACM Transactions on Intelligent Systems and Technology
DOI 10.1145/3641289

Cited by (1,046)

Items 501–600 of 1,046

  1. Monolithic 3D Stackable DRAM
    Po-Kai Hsu, Janak Sharda, Xiangjin Wu, H.‐S. Philip Wong, Shimeng Yu · 2025 · IEEE Nanotechnology Magazine
  2. Trustworthy Driver State Perception via Contextual Interaction-Driven Evidential Vision-Language Fusion in Vehicular Cyber-Physical Systems
    Chuanfei Hu, Xinde Li, Jianxin Pang · 2025 · IEEE Transactions on Intelligent Transportation Systems
  3. Intention Recognition of Space Noncooperative Targets Using Large Language Models
    Heng Jing, Qinbo Sun, Zhaohui Dang, Hua Wang · 2025 · Space Science & Technology
  4. Leveraging Machine learning and generative AI for content Engagement: An Exploration of drivers for the success of YouTube videos
    Arindra Nath Mishra, Pooja Sengupta, Baidyanath N. Biswas, Ajay Kumar, Kristof Coussement · 2025 · Journal of Business Research
  5. Is Relevance Propagated from Retriever to Generator in RAG?
    Fangzheng Tian, Debasis Ganguly, Craig Macdonald · 2025 · Lecture notes in computer science
  6. Integrating large language models, reinforcement learning, and machine learning for intelligent indoor thermal comfort regulation
    Deli Liu, Feixiong Ling, Xiaoping Zhou, Yu Li · 2025 · Architectural Science Review
  7. Exploring AI-Based Support in Speech-Language Pathology for Culturally and Linguistically Diverse Children
    Aaleyah Lewis, Aayushi Dangol, Hyewon Suh, Abbie Olszewski, James A. Fogarty, Julie A. Kientz · 2025 · CHI Conference on Human Factors in Computing Systems
  8. LLMSRec: Large language model with service network augmentation for web service recommendation
    Qian Peng, Buqing Cao, Xiang Xie · 2025 · Knowledge-Based Systems
  9. CMedRAGBot: A Chinese Medical Chatbot Based on Graph RAG and Large Language Models
    Dongfang Zhang, Haoze Du, Xiaolei Wang, Mingdong Zhu, Xiaoxiao Pang, Dong‐Qing Wei, Xianfang Wang · 2025 · Interdisciplinary Sciences Computational Life Sciences
  10. Sparks of Large Audio Models: A Survey and Outlook
    Latif, Siddique, Shoukat, Moazzam, Shamshad, Fahad, Usama, Muhammad, Ren, Yi, Cuayáhuitl, Heriberto, Wang, Wenwu, Zhang, Xulong, Togneri, Roberto, Cambria, Erik et al. · 2023 · arXiv
  11. Chain of Risks Evaluation (CORE): A framework for safer large language models in public mental health
    Li, Lingyu, Kong, Shuqi, Zhao, Haiquan, Li, Chunbo, Teng, Yan, Wang, Yingchun · 2025 · Psychiatry and Clinical Neurosciences
  12. Unveiling the multifaceted concept of cognitive security: Trends, perspectives, and future challenges
    Fran Casino · 2025 · Technology in Society
  13. Scalable Resource Provisioning Framework for Fog Computing Using LLM-Guided Q-Learning Approach
    K. Bhargavi, Sajjan G. Shiva · 2025 · Algorithms
  14. Developing a large language model for oil- and gas-related rock mechanics: Progress and challenges
    Botao Lin, Yan Jin, Qianwen Cao, Han Meng, Huiwen Pang, Shiming Wei · 2025 · Natural Gas Industry B
  15. The evolution of language models: From N-Grams to LLMs, and beyond
    Mohammad Raeini · 2025 · Natural Language Processing Journal
  16. Data Science and Machine Learning in Geo-Electromagnetics: A Review
    Qinghua Huang, Sihong Wu, Jiyan Xue · 2025 · Surveys in Geophysics
  17. Can Multimodal Large Language Models Grade Like an Expert? A Study on UML Class Diagram Assessment Accuracy
    María Blanca Ibáñez, María Lucía Barrón Estrada, Ramón Zataraín Cabada · 2025 · Computer Applications in Engineering Education
  18. A comparative study on retrieval-augmented generation and chain-of-thought applications for LLM-assisted engineering design ideation
    Pingfei Jiang · 2025 · Journal of Engineering Design
  19. Natural language-driven production planning: integrating large language models with automatic simulation model generation in manufacturing systems
    Mohaiad Elbasheer, Yuanjun Laili, Francesco Longo, Vittorio Solina, Yiran Tao, Pierpaolo Veltri, Yuteng Zhang, Lin Zhang · 2025 · Journal of Intelligent Manufacturing
  20. Attack and defense techniques in large language models: A survey and new perspectives
    Zhiyu Liao, Kang Chen, Yuanguo Lin, Kangkang Li, Yunxuan Liu, Hefeng Chen, Xingwang Huang, Yuanhui Yu · 2025 · Neural Networks
  21. Between regulation and accessibility: how Chinese university students navigate global and domestic generative AI
    Qin Xie, Ming Li, Fei Cheng · 2025 · Globalisation Societies and Education
  22. Automating Life Cycle Assessments through Artificial Intelligence Agents and Integrated Assessment Models
    Nathan Preuss, Fengqi You · 2025 · Environmental Science & Technology
  23. A survey on large language models driven meta-optimizers for automated intelligent optimization
    Yan Zheng, Lida Zhang, Kaiwen Li, Rui Wang, Wenhua Li, Tao Zhang, Qingfu Zhang, Yaochu Jin · 2026 · Artificial Intelligence Review
  24. Structured clinical approach to enable large language models to be used for improved clinical diagnosis and explainable reasoning
    Muhammad Ayoub, Hai Zhao, Lifeng Li, Dongjie Yang, Shabir Hussain, Junaid Abdul Wahid · 2026 · Communications Medicine
  25. Using ChatGPT in construction projects: unveiling its cybersecurity risks through a bibliometric analysis
    Muammer Semih Sonkor, Borja García de Soto · 2024 · International Journal of Construction Management
  26. A vulnerability detection framework by focusing on critical execution paths
    Jianxin Cheng, Yizhou Chen, Yongzhi Cao · 2024 · Information and Software Technology
  27. Large language models reshaping molecular biology and drug development
    Satvik Tripathi, Kyla Gabriel, Pushpendra Kumar Tripathi, Edward Kim · 2024 · Chemical Biology & Drug Design
  28. Exploring a learning-to-rank approach to enhance the Retrieval Augmented Generation (RAG)-based electronic medical records search engines
    Cheng Ye · 2024 · Informatics and Health
  29. Enhancing Urban Walkability Assessment with Multimodal Large Language Models
    Ivan Blečić, Valeria Saiu, Giuseppe Andrea Trunfio · 2024 · Lecture notes in computer science
  30. Deep Learning Approaches for Power Prediction in Wind–Solar Tower Systems
    Mostafa A. Rushdi, Shigeo Yoshida, Koichi Watanabe, Yuji Ohya, Amr Mohamed Metwally Ismaiel · 2024 · Energies
  31. A Survey on Knowledge Editing of Neural Networks
    Vittorio Mazzia, Alessandro Pedrani, Andrea Caciolai, Kay Rottmann, Davide Bernardi · 2024 · IEEE Transactions on Neural Networks and Learning Systems
  32. Combining Uncensored and Censored LLMs for Ransomware Generation
    Muhammad Mudassar Yamin, Ehtesham Hashmi, Basel Katt · 2024 · Lecture notes in computer science
  33. Data augmented large language models for medical record generation
    Xuanyi Zhang, Genghong Zhao, Yi Ren, Weiguang Wang, Wei Cai, Yan Zhao, Xia Zhang, Jiren Liu · 2024 · Applied Intelligence
  34. Prompt engineering-enabled LLM or MLLM and instigative bioinformatics pave the way to identify and characterize the significant SARS-CoV-2 antibody escape mutations
    Chiranjib Chakraborty, Manojit Bhattacharya, Soumen Pal, Sang‐Soo Lee · 2024 · International Journal of Biological Macromolecules
  35. OffensiveLang: A Community Based Implicit Offensive Language Dataset
    Amit Das, Mostafa Rahgouy, Dongji Feng, Zheng Zhang, Tathagata Bhattacharya, Nilanjana Raychawdhary, Fatemeh Jamshidi, Vinija Jain, Aman R. Chadha, Mary J. Sandage et al. · 2024 · IEEE Access
  36. Harnessing Multi-Modal Large Language Models for Measuring and Interpreting Color Differences
    Zhihua Wang, Long Yu, Qiuping Jiang, Chao Huang, Xiaochun Cao · 2025 · IEEE Transactions on Image Processing
  37. The ethical evaluation of large language models and its optimization
    Yujing Lyu, Yanyong Du · 2025 · AI and Ethics
  38. A Critical Approach to ChatGPT: An Experience in SQL Learning
    Laura Farinetti, Luca Cagliero · 2025 · ACM Technical Symposium on Computer Science Education (SIGCSE)
  39. Large Language Models (LLMs) for Smart Manufacturing and Industry X.0
    Márcia Lourenço Baptista, Nan Yue, M. M. Manjurul Islam, Helmut Prendinger · 2025 · Springer series in advanced manufacturing
  40. Evaluating Large Language Models for Enhanced Intrusion Detection in Internet of Things Networks
    Ebelechukwu Nwafor, Ujjwal Baskota, Md Salik Parwez, Jeremy Blackstone, Habeeb Olufowobi · 2024 · Globecom
  41. λ-FAdaMax: A novel fractional-order gradient descent method with decaying second moment for neural network training
    Guangyao Chen, Zhao Xu · 2025 · Expert Systems with Applications
  42. Development of a Comprehensive Evaluation Scale for LLM-Powered Counseling Chatbots (CES-LCC) Using the eDelphi Method
    Marco Bolpagni, Silvia Gabrielli · 2025 · Informatics
  43. NumScout: Unveiling Numerical Defects in Smart Contracts Using LLM-Pruning Symbolic Execution
    Jiachi Chen, Zhenzhe Shao, Shuo Yang, Yiming Shen, Yanlin Wang, Ting Chen, Zhenyu Shan, Zibin Zheng · 2025 · IEEE Transactions on Software Engineering
  44. Towards Universal Thermal Climate Index Prediction via machine learning approaches
    Omid Veisi, Alireza Attarhay Tehrani, Beheshteh Gharaei, Delong K. Du, Amir Shakibamanesh · 2025 · Renewable and Sustainable Energy Reviews
  45. Large Language Models for Automated Web-Form-Test Generation: An Empirical Study
    Tao Li, Chenhui Cui, Rubing Huang, Dave Towey, Lei Ma · 2025 · ACM Transactions on Software Engineering and Methodology
  46. VeCoGen: Automating Generation of Formally Verified C Code With Large Language Models
    Merlijn Sevenhuijsen, Khashayar Etemadi, Mattias Nyberg · 2025 · IEEE/ACM International Conference on Formal Methods in Software Engineering (FormaliSE)
  47. Extracting Formal Specifications From Documents Using LLMS for Test Automation
    Hui Li, Zhen Dong, Siao Wang, Zhang Hui, Liwei Shen, Xin Peng, Dongdong She · 2025 · IEEE International Conference on Program Comprehension (ICPC)
  48. Enhancing disaster preparedness in higher education institutions in Ghana: the role of facility managers
    Abubakar Sadiq Mohammed, Christopher Amoah, Jannat Abbas · 2025 · International Journal of Emergency Services
  49. Applications and Implications of Large Language Models in Qualitative Analysis: A New Frontier for Empirical Software Engineering
    Matheus de Morais Leça, Lucas Valença, Reydne Santos, Ronnie de Souza Santos · 2025 · IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering (WSESE)
  50. MedKA: A knowledge graph-augmented approach to improve factuality in medical Large Language Models
    Yiyan Deng, Shen Zhao, Yongming Miao, Junjie Zhu, Jin Li · 2025 · Journal of Biomedical Informatics
  51. TutorLLM: Customizing Learning Recommendations with Knowledge Tracing and Retrieval-Augmented Generation
    Zhaoxing Li, Jindi Wang, Wen Gu, Vahid Yazdanpanah, Lei Shi, Alexandra Ioana Cristea, Sarah Kiden, Sebastian Stein · 2025 · Lecture notes in computer science
  52. Precision through progression: Empowering temporal knowledge graph reasoning with knowledge-guided chain of thought
    Zhangtao Cheng, Shichong Li, Yichen Xin, Bin Chen, Ting Zhong, Fan Zhou · 2025 · Knowledge-Based Systems
  53. Trustworthiness Evaluation of Large Language Models Using Multi-Criteria Decision Making
    Aksoy, Meltem, Adem, Aylin, Dağdeviren, Metin · 2025 · IEEE Access
  54. Multi-Layered Framework for LLM Hallucination Mitigation in High-Stakes Applications: A Tutorial
    Sachin Hiriyanna, Wenbing Zhao · 2025 · Computers
  55. Boosting Student Engagement in STEM : Integrating Large Language Model‐Based Virtual Agents Into Alternate Reality Games
    Minkai Wang, Jingdong Zhu, Gwo‐Jen Hwang, Shao‐Chen Chang, Qifan Yang, Di Zhang · 2025 · Journal of Computer Assisted Learning
  56. AECBench: A hierarchical benchmark for knowledge evaluation of large language models in the AEC field
    Liang Chen, Zhaoqi Huang, Haofen Wang, Fu Chai, Chunying Yu, Huanhuan Wei, Zhengjie Liu, Yanpeng Li, Hongjun Wang, Ruifeng Luo et al. · 2026 · Advanced Engineering Informatics
  57. A self-correcting Agentic Graph RAG for clinical decision support in hepatology
    Yalan Hu, Wenjie Xuan, Qingqing Zhou, Zhi Li, Ya Li, Jili Hu, Fang Fang · 2025 · Frontiers in Medicine
  58. Large Multimodal Model-Based Environment-Aware Channel Estimation
    Seungnyun Kim, Seokhyun Jeong, Jiao Wu · 2025 · IEEE Journal on Selected Areas in Communications
  59. LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Models
    Aida Kostikova, Zhipin Wang, Deidamea Bajri, Ole Pütz, Benjamin Paaßen, Steffen Eger · 2026 · ACM Computing Surveys
  60. Geometric prompt optimization: An efficient framework for engineering applications of large language models
    Qian-Qi Zhang, Ze-Ling Xu, Yun-Tao Zou, Da-Gang Li · 2026 · Expert systems with applications
  61. The Relevance of Large Language Models for Project Management
    Stamatis Karnouskos · 2024 · IEEE Open Journal of the Industrial Electronics Society
  62. A novel solution for the development of a sentimental analysis chatbot integrating ChatGPT
    Filippo Florindi, Pasquale Fedele, Giovanna Maria Dimitri · 2024 · Personal and Ubiquitous Computing
  63. Large Language Models Based Stemming for Information Retrieval: Promises, Pitfalls and Failures
    Shuai Wang, Shengyao Zhuang, Guido Zuccon · 2024 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
  64. Crystalline Material Discovery in the Era of Artificial Intelligence
    Zhenzhong Wang, Haowei Hua, Wanyu Lin, Ming Yang, Kay Chen Tan · 2026 · ACM Computing Surveys
  65. Cross-Domain Few-Shot In-Context Learning For Enhancing Traffic Sign Recognition
    Yaozong Gan, Guang Li, Ren Togo, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama · 2024 · Proceedings - International Conference on Image Processing
  66. LLMOps: Definitions, Framework and Best Practices
    Megha Sinha, Sreekanth Menon, Ram Sagar · 2024
  67. Construction and preliminary application of large language model for reservoir performance analysis
    Huanquan Pan, Jianqiao Liu, Bin GONG et al. · 2024 · Petroleum Exploration and Development
  68. A temporal–spectral fusion transformer with subject-specific adapter for enhancing RSVP-BCI decoding
    Xujin Li, Wei Wei, Shuang Qiu, Huiguang He · 2024 · Neural Networks
  69. Generating SPARQL Queries over CIDOC-CRM Using a Two-Stage Ontology Path Patterns Method in LLM Prompts
    Michalis Mountantonakis, Yannis Tzitzikas · 2024 · Journal on Computing and Cultural Heritage
  70. Collaborative Problem-Solving with LLM: A Multi-agent System Approach to Solve Complex Tasks Using Autogen
    Ricardo Rodrigues Barbosa, Ricardo Santos, Paulo Nováis · 2025 · Communications in computer and information science
  71. Algorithmic bias: sexualized violence against women in GPT-3 models
    Sarah Wyer, Sue Black · 2025 · AI and Ethics
  72. Supply Chain Network Extraction and Entity Classification Leveraging Large Language Models
    Tong Liu, Hadi Meidani · 2024 · IEEE International Conference on Big Data (BigData)
  73. Evaluating Large Language Models for Optimized Intent Translation and Contradiction Detection Using KNN in IBN
    Muhammad Asad Asif, Talha Ahmed Khan, Wang‐Cheol Song · 2025 · IEEE Access
  74. Reliable Text-to-SQL with Adaptive Abstention
    Chen, Kaiwen, Chen, Yueting, Koudas, Nick, Yu, Xiaohui · 2025 · Proceedings of the ACM on Management of Data
  75. How to Write Effective Prompts for Screening Biomedical Literature Using Large Language Models
    Maria Teresa Colangelo, Stefano Guizzardi, Marco Meleti, Elena Calciolari, Carlo Galli · 2025 · BioMedInformatics
  76. Optimising Contract Interpretations with Large Language Models: A Comparative Evaluation of a Vector Database-Powered Chatbot vs. ChatGPT
    P. V. I. N. Saparamadu, S. Sepasgozar, R. N. D. Guruge, H. Jayasena, Ali Darejeh, Sanee Ebrahimzadeh, B. Eranga · 2025 · Buildings
  77. Enhancing Data Quality in Medical Concept Normalization Through Large Language Models
    Haihua Chen, Ruochi Li, Ana D. Cleveland, Junhua Ding · 2024 · Journal of Biomedical Informatics
  78. LIBRA: Measuring Bias of Large Language Model from a Local Context
    Bo Pang, Tingrui Qiao, Caroline G. Walker, Chris W. Cunningham, Yun Sing Koh · 2025 · Lecture notes in computer science
  79. Can large language models independently complete tasks? A dynamic evaluation framework for multi-turn task planning and completion
    Jun Gao, Junlin Cui, Huijia Wu, Liuyu Xiang, Han Zhao, Xiangang Li, Meng Fang, Yaodong Yang, Zhaofeng He · 2025 · Neurocomputing
  80. Large Language Model Based Intelligent Fault Information Retrieval System for New Energy Vehicles
    Haiyu Zhang, Yinghui Zhao, Boyu Sun, Yaqi Wu, Zetian Fu, Xinqing Xiao · 2025 · Applied Sciences
  81. Topology optimization of random memristors for input-aware dynamic SNN
    Bo Wang, Xinyuan Zhang, Shaocong Wang, Ning Lin, Yi Li, Yifei Yu, Yue Zhang, Jichang Yang, Xiaoshan Wu, Yangu He et al. · 2025 · Science Advances
  82. Beyond words: evaluating large language models in transportation planning
    Shaowei Ying, Zhenlong Li, M. Yu · 2025 · Geo-spatial Information Science
  83. The Effectiveness of Large Language Models in Transforming Unstructured Text to Standardized Formats
    William Brach, Kristián Košťál, Michal Ries · 2025 · IEEE Access
  84. Toward Generative AI–Driven Metadata Modeling: A Human–Large Language Model Collaborative Approach
    Mayukh Bagchi · 2025 · Library trends
  85. MID-LLM: Enhancing Medical Image Diagnostics With LLMs in a Blockchain AI Framework
    Rajesh Kumar, Yunbo Rao, Jay Kumar, Cobbinah B. Mawuli, Waqar Ali, Shaoning Zeng · 2025 · IEEE Internet of Things Journal
  86. CG-RAG: Research Question Answering by Citation Graph Retrieval-Augmented LLMs
    Yuntong Hu, Zhihan Lei, Zhongjie Dai, Allen Zhang, Abhinav Angirekula, Zheng Zhang, Liang Zhao · 2025 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
  87. Psychology's Questionable Research Fundamentals (QRFs): Key problems in quantitative psychology and psychological measurement beyond Questionable Research Practices (QRPs)
    Jana Uher, Jan Ketil Arnulf, Paul T. Barrett, Moritz Heene, Jörg-Henrik Heine, Jack Martin, Lucas B. Mazur, Marek McGann, Robert J. Mislevy, Craig P. Speelman et al. · 2025 · Frontiers in Psychology
  88. SynthMedic: Utilizing large language models for synthetic discharge summary generation, correction and validation
    Georgi Grazhdanski, Vasil Vasilev, Sylvia Vassileva, Dimitar Taskov, Izabel Antova, Ivan Kolev Koychev, Svetla Boytcheva · 2025 · Journal of Biomedical Informatics
  89. A multimodal generative AI-driven 3D geographic scene reconstruction method
    Pei Dang, Jun Zhu, Yuting Rao, Weilian Li, Chao Dang · 2025 · International Journal of Geographical Information Systems
  90. Has the creativity of large-language models peaked?
    Jennifer Haase, Paul H. P. Hanel, Sebastian Pokutta · 2025 · Journal of Creativity
  91. A MISLEADING GALLERY OF FLUID MOTION BY GENERATIVE ARTIFICIAL INTELLIGENCE
    Ali Kashefi · 2024 · Journal of Machine Learning for Modeling and Computing
  92. Measuring China’s Policy Stringency on Climate Change for 1954–2022
    Bo Li, Enxian Fu, Shuhao Yang, Jiaying Lin, Wei Zhang, Jian Zhang, Yaling Lu, Jiantong Wang, Hongqiang Jiang · 2025 · Scientific Data
  93. LLM-Agent-UMF: LLM-based Agent Unified Modeling Framework for Seamless Design of Multi Active/Passive Core-Agent Architectures
    Amine Ben Hassouna, Hana Chaari, Ines Belhaj · 2025 · Information Fusion
  94. R-DDQN: Optimizing Algorithmic Trading Strategies Using a Reward Network in a Double DQN
    Chujin Zhou, Yuling Huang, Kai Cui, Xiaoping Lu · 2024 · Mathematics
  95. Addressing the Productivity Paradox in Healthcare with Retrieval Augmented Generative AI Chatbots
    Sajani Ranasinghe, Daswin De Silva, Nishan Mills, Damminda Alahakoon, Milos Manic, Yen Lim, Weranja K. B. Ranasinghe · 2024 · IEEE International Conference on Industrial Technology (ICIT)
  96. Leverage Large Language Models For Enhanced Aviation Safety
    Kevin L. Fox, Kevin R. Niewoehner, Mark D. Rahmes, Josiah Wong, Rahul Razdan · 2024 · Integrated Communications, Navigation and Surveillance Conference (ICNS)
  97. Natural Language-Oriented Programming (NLOP): Towards Democratizing Software Creation
    A. Beheshti · 2024 · 2024 IEEE International Conference on Software Services Engineering (SSE)
  98. Towards an In-Context LLM-Based Approach for Automating the Definition of Model Views
    James Pontes Miranda, Hugo Brunelière, Massimo Tisi, Gerson Sunyé · 2024 · ACM SIGPLAN International Conference on Software Language Engineering (SLE)
  99. Crisis Management in the Era of the IoT, Edge Computing, and LLMs
    Dražen Ignjatović, Vasileios Karagiannis, Aradina Chettakattu, Denis Havlik, Georg Neubauer · 2024 · International Conference on Internet of Things: Systems, Management and Security (IOTSMS)
  100. Comparative analysis of GPT-4, Gemini, and Ernie as gloss sign language translators in special education
    Achraf Othman, Khansa Chemnad, Ahmed Tlili, Ting Da, Huanhuan Wang, Ronghuai Huang · 2024 · Discover Global Society