A Survey on Evaluation of Large Language Models

Cited by (1,046)

Items 401–500 of 1,046

  1. Chiplet-Gym: Optimizing Chiplet-Based AI Accelerator Design With Reinforcement Learning
    Kaniz Mishty, Mehdi Sadi · 2024 · IEEE Transactions on Computers
  2. A survey on moral foundation theory and pre-trained language models: current advances and challenges
    Lorenzo Zangari, Candida Maria Greco, Davide Picca, Andrea Tagarelli · 2025 · AI & Society
  3. Between Innovation and Tradition: A Narrative Inquiry of Students’ and Teachers’ Experiences with ChatGPT in Philippine Higher Education
    Alma S. Espartinez · 2025 · Social Sciences
  4. Large language models in peer review: challenges and opportunities
    Sun, Zhuanlan · 2025 · Scientometrics
  5. OpenHands: An Open Platform for AI Software Developers as Generalist Agents
    Wang, Xingyao, Li, Boxuan, Song, Yufan, Xu, Frank F., Tang, Xiangru, Zhuge, Mingchen, Pan, Jiayi, Song, Yueqi, Li, Bowen, Singh, Jaskirat et al. · 2024 · arXiv
  6. DCRLRec: Dual-domain contrastive reinforcement large language model for recommendation
    Zijian Bai, Yucheng Zheng, Peng Yang, Siyang Liu, Yiyuan Zhang, Yuanyuan Chang · 2025 · Information Processing & Management
  7. RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometry
    Li Sun, Zhenhao Huang, Suyang Zhou · 2025
  8. Synthetic Human Memories: AI-Edited Images and Videos Can Implant False Memories and Distort Recollection
    Pat Pataranutaporn, Chayapatr Archiwaranguprok, Samantha Chan, Elizabeth F. Loftus, Pattie Maes · 2025 · CHI Conference on Human Factors in Computing Systems
  9. Securing RAG: A Risk Assessment and Mitigation Framework
    Lukas Ammann, Sara Ott, Christoph R. Landolt, Marco P. Lehmann · 2025 · IEEE Swiss Conference on Data Science (SDS)
  10. From Transformers to ChatGPT: An Analysis of Large Language Models Research
    Liviu‐Adrian Cotfas, Andra Sandu, Camelia Delcea, Paul Diaconu, Corina Frăsineanu, Aurelia Stănescu · 2025 · IEEE Access
  11. CTINexus: Automatic Cyber Threat Intelligence Knowledge Graph Construction Using Large Language Models
    Yutong Cheng, Osama Bajaber, Saimon Amanuel Tsegai, Dawn Xiaodong Song, Peng Gao · 2025 · IEEE European Symposium on Security and Privacy
  12. On the Use of LLMs for GIS-Based Spatial Analysis
    Roberto Pierdicca, Nikhil Muralikrishna, Flavio Tonetto, Alessandro Ghianda · 2025 · ISPRS International Journal of Geo-Information
  13. A Review of Prompt Engineering Techniques for Large Language Models
    M. Z. Naser · 2025 · International Journal of Human-Computer Interaction
  14. Deploying LLM Transformer on Edge Computing Devices: A Survey of Strategies, Challenges, and Future Directions
    Endah Kristiani, Vinod Kumar Verma, Yang Chao-Tung · 2026 · AI
  15. Evaluating the Effectiveness of GPT Large Language Model for News Classification in the IPTC News Ontology
    Bahareh Fatemi, Fazle Rabbi, Andreas Lothe Opdahl · 2023 · IEEE Access
  16. Can Autograding of Student-Generated Questions Quality by ChatGPT Match Human Experts?
    Kangkang Li, Qian Yang, Xianmin Yang · 2024 · IEEE Transactions on Learning Technologies
  17. LLMEffiChecker : Understanding and Testing Efficiency Degradation of Large Language Models
    Xiaoning Feng, Xiaohong Han, S. H. Chen, Wei Ming Yang · 2024 · ACM Transactions on Software Engineering and Methodology
  18. Generative AI as Economic Agents
    Nicole Immorlica, Brendan Lucier, Aleksandrs Slivkins · 2024 · ACM SIGecom Exchanges
  19. Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
    Derong Xu, Ziheng Zhang, Zhihong Zhu, Zhenxi Lin, Qidong Liu, Xian Wu, Tong Xu, Wanyu Wang, Yuyang Ye, Xiangyu Zhao et al. · 2024 · ACM International Conference on Information and Knowledge Management (CIKM)
  20. Segment anything model for few-shot medical image segmentation with domain tuning
    Weili Shi, Penglong Zhang, Yuqin Li · 2024 · Complex & Intelligent Systems
  21. A Causality-Aware Paradigm for Evaluating Creativity of Multimodal Large Language Models
    Zeyu Huang, Shanshan Zhong, Pan Zhou, Shanghua Gao, Marinka Žitnik, Liang Lin · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  22. SecureLLM: A Unified Framework for Privacy-Focused Large Language Models
    Konstantinos Kalodanis, Sotirios Papadopoulos, Georgios Feretzakis, Panagiotis Rizomiliotis, Dimosthenis Anagnostopoulos · 2025 · Applied Sciences
  23. ConvD: Attention Enhanced Dynamic Convolutional Embeddings for Knowledge Graph Completion
    Wenbin Guo, Zhao Li, Xin Wang, Zirui Chen, Jun Zhao, Jianxin Li, Ye Yuan · 2025 · IEEE Transactions on Knowledge and Data Engineering
  24. Artificial Intelligence to Support the Training and Assessment of Professionals: A Systematic Literature Review
    Mariano Albaladejo‐González, José A. Ruipérez‐Valiente, Félix Gómez Mármol · 2024 · ACM Computing Surveys
  25. AI agents in chemical research: GVIM – an intelligent research assistant system
    Kangyong Ma · 2025 · Digital Discovery
  26. Mining user privacy concern topics from app reviews
    Jianzhang Zhang, Jialong Zhou, Jinping Hua, Nan Niu, Chuang Liu · 2025 · Journal of Systems and Software
  27. Interpretable physics-informed machine learning approaches to accelerate electrocatalyst development
    Hao Wu, Mingxuan Chen, Hao Cheng, Tong Yang, Minggang Zeng, Ming Yang · 2025 · Journal of Materials Informatics
  28. Data leakage detection in machine learning code: transfer learning, active learning, or low-shot prompting?
    Nouf Alturayeif, Jameleddine Hassine · 2025 · PeerJ Computer Science
  29. Towards realistic evaluation of cultural value alignment in large language models: Diversity enhancement for survey response simulation
    Haijiang Liu, Yong Cao, Xun Wu, Chen Qiu, Jinguang Gu, Maofu Liu, Daniel Hershcovich · 2025 · Information Processing & Management
  30. Customization and personalization of large language models for engineering design
    Zhoumingju Jiang, Ang Liu, Dawen Zhang · 2025 · CIRP Annals
  31. Construction of AI Literacy Evaluation System for College Students and an Empirical Study at Wuhan University
    Dan Wu, Xinjue Sun, Shaobo Liang, Chao Qiu, Ziyi Wei · 2025 · Frontiers of digital education.
  32. Toward Personalizable AI Node Graph Creative Writing Support: Insights on Preferences for Generative AI Features and Information Presentation Across Story Writing Processes
    Hua Xuan Qin, Guangzhi Zhu, Mingming Fan, Pan Hui · 2025 · CHI Conference on Human Factors in Computing Systems
  33. Decoding the Mystery: How Can LLMs Turn Text Into Cypher in Complex Knowledge Graphs?
    Ioanna Mandilara, Christina Maria Androna, Eleni Fotopoulou, Anastasios Zafeiropoulos, Symeon Papavassiliou · 2025 · IEEE Access
  34. Annotation Guideline-Based Knowledge Augmentation: Toward Enhancing Large Language Models for Educational Text Classification
    Shiqi Liu, Sannyuya Liu, Lele Sha, Zijie Zeng, Dragan Gašević, Zhi Liu · 2025 · IEEE Transactions on Learning Technologies
  35. Large language model-guided graph convolution network reasoning system for complex human-robot collaboration disassembly operations
    Jinhua Xiao, Sergio Terzi · 2025 · Procedia CIRP
  36. Mitigating LLM Hallucinations Using a Multi-Agent Framework
    Ahmed M. Darwish, Essam A. Rashed, Ghada Ahmed Khoriba · 2025 · Information
  37. Chat-based Person Retrieval via Dialogue-Refined Cross-Modal Alignment
    Yang Bai, Yucheng Ji, Min Cao, Jinqiao Wang, Mang Ye · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  38. Medical multimodal large language models: A systematic review
    Hu, Yuan, Xu, Chenhan, Lin, Bo, Yang, Weibin, Tang, Yuan Yan · 2025 · Intelligent Oncology
  39. Human evaluation of large language models in healthcare: gaps, challenges, and the need for standardization
    Raghav Awasthi, Atharva Bhattad, Sai Prasad Ramachandran, Shreya V. Mishra, Ashish Kumar Khanna, Jacek B. Cywiński, Kamal Kishore Maheshwari, Dwarikanath Mahapatra, Izabella DiRosa, Anabelle Cohen et al. · 2025 · npj Health Systems
  40. Uncertainty-aware digital twins for deep excavations with lateral support
    Hua-Ming Tian, Yu Wang, Yongjian Huang · 2025 · Automation in Construction
  41. LE-DLCM: Decoupled learner and course modeling with large language models for enhanced course recommendation
    Jinjin Ma, Zhuo Zhao, Zhiwen Xie, Yi Zhang, Guangyou Zhou · 2025 · Knowledge-Based Systems
  42. Large Language Models in Modern Forensic Investigations: Harnessing the Power of Generative Artificial Intelligence in Crime Resolution and Suspect Identification
    Αναστάσιος Νικολακόπουλος, Spyridon Evangelatos, Eleni Veroni · 2024
  43. On the Effectiveness of Large Language Models in Statement-level Code Summarization
    Jie Zhu, Yun Miao, Tingting Xu, Junwu Zhu, Xiaolei Sun · 2024 · IEEE International Conference on Software Quality, Reliability and Security (QRS)
  44. Fine-Tuning Retrieval-Augmented Generation with an Auto-Regressive Language Model for Sentiment Analysis in Financial Reviews
    Miehleketo Mathebula, Abiodun Modupe, Vukosi N. Marivate · 2024 · Applied Sciences
  45. LLMOverTab: Tabular data augmentation with language model-driven oversampling
    Tokimasa Isomura, Ryotaro Shimizu, Masayuki Goto · 2024 · Expert Systems with Applications
  46. Chinese fine-grained financial sentiment analysis with large language models
    Yinyu Lan, Yanru Wu, Xu Wang, Weiqiang Feng, Youhao Zhang · 2024 · Neural Computing and Applications
  47. Optimizing Machine Translation: A Benchmarking Suite for Efficiency and Quality Enhancement
    Navin Kamuni, Suresh Dodda, Sathishkumar Chintala, Naveen Kunchakuri · 2024 · International Conference on Computing, Sciences and Communications (ICCSC)
  48. Retrospective Comparative Analysis of Prostate Cancer In-Basket Messages: Responses From Closed-Domain Large Language Models Versus Clinical Teams
    Yuexing Hao, Jason Holmes, Jared N. Hobson, Alexandra Bennett, Elizabeth L. McKone, Daniel K. Ebner, David M. Routman, Satomi Shiraishi, Samir H. Patel, Nathan Y. Yu et al. · 2025 · Mayo Clinic Proceedings Digital Health
  49. Leveraging large language models to assist philosophical counseling: prospective techniques, value, and challenges
    Bokai Chen, Weiwei Zheng, Liang Zhao, Xiaojun Ding · 2025 · Humanities and Social Sciences Communications
  50. Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
    X.R. Li, Weijieying Ren, Wei Dong Qin, Lei Wang, Tianxiang Zhao, Richang Hong · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
  51. Quality Assurance for LLM-RAG Systems: Empirical Insights from Tourism Application Testing
    Bestoun S. Ahmed, Ludwig Otto Baader, Firas Bayram, Siri Jagstedt, Peter Magnusson · 2025 · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)
  52. Engineering artificial intelligence: framework, challenges, and future direction
    Jay Lee, Hanqi Su, Dai-Yan Ji, Takanobu Minami · 2025 · Machine Learning Engineering
  53. A Survey of Context Engineering for Large Language Models
    Mei, Lingrui, Yao, Jiayu, Ge, Yuyao, Wang, Yiwei, Bi, Baolong, Cai, Yujun, Liu, Jiazhi, Li, Mingyu, Li, Zhong-Zhi, Zhang, Duzhen et al. · 2025 · arXiv
  54. Measuring technology acceptance over time using transfer models based on online customer reviews
    Daniel Baier, Andreas Karasenko, Alexandra Rese · 2025 · Journal of Retailing and Consumer Services
  55. State-of-the-Art and Challenges of Engineering ML- Enabled Software Systems in the Deep Learning Era
    Gebremariam Mesfin Assres, Guru Prasad Bhandari, Andrii Shalaginov, Tor‐Morten Grønli, Gheorghiță Ghinea · 2025 · ACM Computing Surveys
  56. Annotation of biological samples data to standard ontologies with support from large language models
    Andrea Riquelme-García, Juan Mulero-Hernández, Jesualdo Tomás Fernández‐Breis · 2025 · Computational and Structural Biotechnology Journal
  57. Translating code with Large Language Models and human-in-the-loop feedback
    Gabriele Dario De Siano, Anna Rita Fasolino, Giancarlo Sperlí, Andrea Vignali · 2025 · Information and Software Technology
  58. LLMs on a Budget: System-Level Approaches to Power-Efficient and Scalable Fine-Tuning
    Kailash Gogineni, Ali Suvizi, Guru Venkataramani · 2025 · IEEE Open Journal of the Computer Society
  59. Large Language Model Enhanced Recommender Systems: Methods, Applications and Trends
    Qidong Liu, Xiangyu Zhao, Yuhao Wang, Yejing Wang, Zijian Zhang, Yuqi Sun, Xiang Li, Maolin Wang, Pengyue Jia, Chong Chen et al. · 2025 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
  60. Interpretable Citrus Fruit Quality Assessment Using Vision Transformers and Lightweight Large Language Models
    Zineb Jrondi, Abdellatif Moussaid, Moulay Youssef Hadi · 2025 · AgriEngineering
  61. Cooperative Perception for Automated Driving: A Survey of Algorithms, Applications, and Future Directions
    Chuheng Wei, Guoyuan Wu, Matthew Barth · 2025 · Proceedings of the IEEE
  62. Chat to chip: large language model based design of arbitrarily shaped metasurfaces
    Huanshu Zhang, Lei Kang, Sawyer D. Campbell, Douglas H. Werner · 2025 · Nanophotonics
  63. Agentic AI for smart manufacturing
    Jay Lee, Hanqi Su · 2025 · Manufacturing Letters
  64. CTI-Thinker: an LLM-driven system for CTI knowledge graph construction and attack reasoning
    Xiuzhang Yang, Ruijie Zhong, Yuling Chen, Guojun Peng, Di Yao, Chaofan Chen, Chenyang Wang, Dongni Zhang, Yilin Zhou, Zixuan Yang · 2026 · Cybersecurity
  65. A new approach for automatic test case generation from use case diagram using LLMs and prompt engineering
    Lahbib Naimi, El Mahi Bouziane, Mohamed Manaouch, Abdeslam Jakimi · 2024 · International Conference on Circuit, Systems and Communication (ICCSC)
  66. Silent Guardian: Protecting Text From Malicious Exploitation by Large Language Models
    Jiawei Zhao, Kejiang Chen, Xiaojian Yuan, Yuang Qi, Weiming Zhang, Nenghai Yu · 2024 · IEEE Transactions on Information Forensics and Security
  67. Compositionality and Sentence Meaning: Comparing Semantic Parsing and Transformers on a Challenging Sentence Similarity Dataset
    James Fodor, Simon De Deyne, Shinsuke Suzuki · 2024 · Computational Linguistics
  68. On the Use of Large Language Models to Generate Capability Ontologies
    Luis Miguel Vieira da Silva, Aljosha Köcher, Felix Gehlhoff, Alexander Fay · 2024 · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA)
  69. Sustainable Digitalization of Business with Multi-Agent RAG and LLM
    Muhammad Arslan, Saba Munawar, Christophe Cruz · 2024 · Procedia Computer Science
  70. Investigating the role of large language models on questions about refractive surgery
    Süleyman Demir · 2025 · International Journal of Medical Informatics
  71. Automatic instantiation of assurance cases from patterns using large language models
    Oluwafemi Odu, Alvine Boaye Belle, Song Wang, Sègla Kpodjedo, Timothy Christian Lethbridge, Hadi Hemmati · 2025 · Journal of Systems and Software
  72. Learning Electromagnetic Metamaterial Physics With ChatGPT
    Darui Lu, Yang Deng, Jordan M. Malof, Willie J. Padilla · 2025 · IEEE Access
  73. Medical Implications of LLM Based Clinical Decision Support Systems in Healthcare
    Cagatay Umut Ogdu, Selen Gürbüz, Mehmet Karaköse, Eray Hanoğlu · 2025
  74. Research note: assessing human preferences for natural landscapes—an analysis of ChatGPT-4 and LLaVA models
    Yu-Hsin Tung, Zhe-Rui Yang, Meng-Wei Shen, Chun–Yen Chang, Chien‐Chung Chen, Li-Chih Ho · 2025 · Landscape and Urban Planning
  75. A Human-AI Comparative Analysis of Prompt Sensitivity in LLM-Based Relevance Judgment
    Negar Arabzadeh, Charles L. A. Clarke · 2025 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
  76. Toward Large Energy Models: A comparative study of Transformers’ efficacy for energy forecasting
    Yueyan Gu, Farrokh Jazizadeh, Xuan Wang · 2025 · Applied Energy
  77. Media Bias Detector: Designing and Implementing a Tool for Real-Time Selection and Framing Bias Analysis in News Coverage
    Jenny S Wang, Samar Haider, Amir Tohidi, Anushkaa Gupta, Y. Zhang, Chris Callison-Burch, David M. Rothschild, Duncan J. Watts · 2025 · CHI Conference on Human Factors in Computing Systems
  78. Artificial Intelligence Large Language Models Improve Patient Comprehension of Radiologist Magnetic Resonance Imaging Reports
    Emily Berzolla, Griffith G. Gosnell, Larry Chen, Caroline Vonck, Erin F. Alaia, Robert J. Meislin · 2025 · Arthroscopy The Journal of Arthroscopic and Related Surgery
  79. COMPASS: Computational mapping of patient-therapist alliance strategies with language modeling
    Baihan Lin, Djallel Bouneffouf, Yulia Landa, Rachel Jespersen, Cheryl Mary Corcoran, Guillermo Cecchi · 2025 · Translational Psychiatry
  80. Application of Large Language Models in the AECO Industry: Core Technologies, Application Scenarios, and Research Challenges
    Guozong Zhang, Chenyuan Lu, Qianmai Luo · 2025 · Buildings
  81. Foundational models and federated learning: survey, taxonomy, challenges and practical insights
    Cosmin-Andrei Hatfaludi, Alex Serban · 2025 · PeerJ Computer Science
  82. Enhancing Programming Performance, Learning Interest, and Self-Efficacy: The Role of Large Language Models in Middle School Education
    Bixia Tang, Jiarong Liang, Wenshuang Hu, Heng Luo · 2025 · Systems
  83. Benchmarking LLM-based Relevance Judgment Methods
    Negar Arabzadeh, Charles L. A. Clarke · 2025 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
  84. EEE-Bench: A Comprehensive Multimodal Electrical And Electronics Engineering Benchmark
    Ming Li, Jike Zhong, Tianle Chen, Yuxiang Lai, Konstantinos Psounis · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  85. Lisa: a touristic chatbot for Lisbon
    Miguel Cruz, Bruno Jardim, Miguel de Castro Neto · 2025 · Information Technology & Tourism
  86. ComAI: The Convergence of Communication and Artificial Intelligence
    Ping Zhang, Kai Niu, Xiaoyun Wang, Yiming Liu, Zijian Liang, Chen Dong, Jincheng Dai, Xiaodong Xu, Wenjun Xu, Zhi Zhang et al. · 2025 · IEEE Communications Surveys & Tutorials
  87. Verifying energy generation via edge LLM for web3-based decentralized clean energy networks
    Shan Jiang, Wenchang Chai, Mingjin Zhang, Jiannong Cao, Shichang Xuan, Jiaxing Shen · 2025 · Information Fusion
  88. Lightweight multimodal LLM-empowered dual-agent collaboration for reliable defect detection and maintenance recommendation in tunnel infrastructure
    Gang Yu, Ruibin Ju, Vijayan Sugumaran, H Liu · 2025 · Reliability Engineering & System Safety
  89. Large language model agent as a mechanical designer
    Yayati Jadhav, Amir Barati Farimani · 2026 · Journal of Engineering Design
  90. Advancing Autonomous Incident Response: Leveraging LLMs and Cyber Threat Intelligence
    Amine Tellache, Abdelaziz Amara Korba, Amdjed Mokhtari, Horea Florin Moldovan, Yacine M. Ghamri-Doudane · 2025 · Globecom
  91. Improving Clinical Decision Making With a Two-Stage Recommender System
    Shaina Raza, Chen Ding · 2023 · IEEE Transactions on Computational Biology and Bioinformatics
  92. LLMs with User-defined Prompts as Generic Data Operators for Reliable Data Processing
    Luyi Ma, Nikhil Thakurdesai, Jiao Chen, Jianpeng Xu, Evren Körpeoğlu, Sushant Kumar, Kannan Achan · 2023 · IEEE International Conference on Big Data (BigData)
  93. Preserving Linguistic Diversity in the Digital Age: A Scalable Model for Cultural Heritage Continuity
    James Hutson, Pace Ellsworth, Matt Ellsworth · 2024 · Journal of Contemporary Language Research
  94. Enhancing Network Attack Detection Accuracy through the Integration of Large Language Models and Synchronized Attention Mechanism
    Yuzhe Bai, Min Sun, Liman Zhang, Yinong Wang, Sihan Liu, Yanqiu Liu, Jingling Tan, Yingqiu Yang, Chunli Lv · 2024 · Applied Sciences
  95. Large language models in electronic laboratory notebooks: Transforming materials science research workflows
    Mehrdad Jalali, Yi Luo, Lachlan Caulfield, Eric Sauter, Alexei Nefedov, Christof Wöll · 2024 · Materials Today Communications
  96. Vivid-persona: customizable persona tool with interactive and immersive experiences
    Leijing Zhou, Fang Yan, Shiying Ding, Yiming Cheng, Bing Yan, Wanye Zhu, Song Bao, Jian Wang, Siyang Song · 2024 · Journal of Engineering Design
  97. From fragments to digital wholeness: An AI generative approach to reconstructing archaeological vessels
    Lorenzo Cardarelli · 2024 · Journal of Cultural Heritage
  98. Redefining crowdsourced test report prioritization: An innovative approach with large language model
    Yuchen Ling, Shengcheng Yu, Chunrong Fang, Guobin Pan, Jun Wang, Jia Liu · 2024 · Information and Software Technology
  99. A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal Models
    Fan Li, Han Su, Ching‐Hung Lee, Shanshan Feng, Zhuoxuan Jiang, Zhu Sun · 2025 · International Journal of Human-Computer Interaction
  100. Semantic analysis of test items through large language model embeddings predicts a-priori factorial structure of personality tests
    Nicola Milano, Maria Luongo, Michela Ponticorvo, ‎Davide Marocco · 2025 · Current Research in Behavioral Sciences