A Survey on Evaluation of Large Language Models
Chang, Yupeng, Wang, Xu, Wang, Jindong, Wu, Yuan, Yang, Linyi, Zhu, Kaijie, Chen, Hao, Yi, Xiaoyuan, Wang, Cunxiang, Wang, Yidong, Ye, Wei, Zhang, Yue, Chang, Yi, Yu, Philip S., Yang, Qiang, Xie, Xing·2024·ACM Transactions on Intelligent Systems and Technology
DOI 10.1145/3641289
Cited by (1,046)
Items 401–500 of 1,046
- Chiplet-Gym: Optimizing Chiplet-Based AI Accelerator Design With Reinforcement LearningKaniz Mishty, Mehdi Sadi · 2024 · IEEE Transactions on Computers
- A survey on moral foundation theory and pre-trained language models: current advances and challengesLorenzo Zangari, Candida Maria Greco, Davide Picca, Andrea Tagarelli · 2025 · AI & Society
- Between Innovation and Tradition: A Narrative Inquiry of Students’ and Teachers’ Experiences with ChatGPT in Philippine Higher EducationAlma S. Espartinez · 2025 · Social Sciences
- Large language models in peer review: challenges and opportunitiesSun, Zhuanlan · 2025 · Scientometrics
- OpenHands: An Open Platform for AI Software Developers as Generalist AgentsWang, Xingyao, Li, Boxuan, Song, Yufan, Xu, Frank F., Tang, Xiangru, Zhuge, Mingchen, Pan, Jiayi, Song, Yueqi, Li, Bowen, Singh, Jaskirat et al. · 2024 · arXiv
- DCRLRec: Dual-domain contrastive reinforcement large language model for recommendationZijian Bai, Yucheng Zheng, Peng Yang, Siyang Liu, Yiyuan Zhang, Yuanyuan Chang · 2025 · Information Processing & Management
- RiemannGFM: Learning a Graph Foundation Model from Riemannian GeometryLi Sun, Zhenhao Huang, Suyang Zhou · 2025
- Synthetic Human Memories: AI-Edited Images and Videos Can Implant False Memories and Distort RecollectionPat Pataranutaporn, Chayapatr Archiwaranguprok, Samantha Chan, Elizabeth F. Loftus, Pattie Maes · 2025 · CHI Conference on Human Factors in Computing Systems
- Securing RAG: A Risk Assessment and Mitigation FrameworkLukas Ammann, Sara Ott, Christoph R. Landolt, Marco P. Lehmann · 2025 · IEEE Swiss Conference on Data Science (SDS)
- From Transformers to ChatGPT: An Analysis of Large Language Models ResearchLiviu‐Adrian Cotfas, Andra Sandu, Camelia Delcea, Paul Diaconu, Corina Frăsineanu, Aurelia Stănescu · 2025 · IEEE Access
- CTINexus: Automatic Cyber Threat Intelligence Knowledge Graph Construction Using Large Language ModelsYutong Cheng, Osama Bajaber, Saimon Amanuel Tsegai, Dawn Xiaodong Song, Peng Gao · 2025 · IEEE European Symposium on Security and Privacy
- On the Use of LLMs for GIS-Based Spatial AnalysisRoberto Pierdicca, Nikhil Muralikrishna, Flavio Tonetto, Alessandro Ghianda · 2025 · ISPRS International Journal of Geo-Information
- A Review of Prompt Engineering Techniques for Large Language ModelsM. Z. Naser · 2025 · International Journal of Human-Computer Interaction
- Deploying LLM Transformer on Edge Computing Devices: A Survey of Strategies, Challenges, and Future DirectionsEndah Kristiani, Vinod Kumar Verma, Yang Chao-Tung · 2026 · AI
- Evaluating the Effectiveness of GPT Large Language Model for News Classification in the IPTC News OntologyBahareh Fatemi, Fazle Rabbi, Andreas Lothe Opdahl · 2023 · IEEE Access
- Can Autograding of Student-Generated Questions Quality by ChatGPT Match Human Experts?Kangkang Li, Qian Yang, Xianmin Yang · 2024 · IEEE Transactions on Learning Technologies
- LLMEffiChecker : Understanding and Testing Efficiency Degradation of Large Language ModelsXiaoning Feng, Xiaohong Han, S. H. Chen, Wei Ming Yang · 2024 · ACM Transactions on Software Engineering and Methodology
- Generative AI as Economic AgentsNicole Immorlica, Brendan Lucier, Aleksandrs Slivkins · 2024 · ACM SIGecom Exchanges
- Editing Factual Knowledge and Explanatory Ability of Medical Large Language ModelsDerong Xu, Ziheng Zhang, Zhihong Zhu, Zhenxi Lin, Qidong Liu, Xian Wu, Tong Xu, Wanyu Wang, Yuyang Ye, Xiangyu Zhao et al. · 2024 · ACM International Conference on Information and Knowledge Management (CIKM)
- Segment anything model for few-shot medical image segmentation with domain tuningWeili Shi, Penglong Zhang, Yuqin Li · 2024 · Complex & Intelligent Systems
- A Causality-Aware Paradigm for Evaluating Creativity of Multimodal Large Language ModelsZeyu Huang, Shanshan Zhong, Pan Zhou, Shanghua Gao, Marinka Žitnik, Liang Lin · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
- SecureLLM: A Unified Framework for Privacy-Focused Large Language ModelsKonstantinos Kalodanis, Sotirios Papadopoulos, Georgios Feretzakis, Panagiotis Rizomiliotis, Dimosthenis Anagnostopoulos · 2025 · Applied Sciences
- ConvD: Attention Enhanced Dynamic Convolutional Embeddings for Knowledge Graph CompletionWenbin Guo, Zhao Li, Xin Wang, Zirui Chen, Jun Zhao, Jianxin Li, Ye Yuan · 2025 · IEEE Transactions on Knowledge and Data Engineering
- Artificial Intelligence to Support the Training and Assessment of Professionals: A Systematic Literature ReviewMariano Albaladejo‐González, José A. Ruipérez‐Valiente, Félix Gómez Mármol · 2024 · ACM Computing Surveys
- AI agents in chemical research: GVIM – an intelligent research assistant systemKangyong Ma · 2025 · Digital Discovery
- Mining user privacy concern topics from app reviewsJianzhang Zhang, Jialong Zhou, Jinping Hua, Nan Niu, Chuang Liu · 2025 · Journal of Systems and Software
- Interpretable physics-informed machine learning approaches to accelerate electrocatalyst developmentHao Wu, Mingxuan Chen, Hao Cheng, Tong Yang, Minggang Zeng, Ming Yang · 2025 · Journal of Materials Informatics
- Data leakage detection in machine learning code: transfer learning, active learning, or low-shot prompting?Nouf Alturayeif, Jameleddine Hassine · 2025 · PeerJ Computer Science
- Towards realistic evaluation of cultural value alignment in large language models: Diversity enhancement for survey response simulationHaijiang Liu, Yong Cao, Xun Wu, Chen Qiu, Jinguang Gu, Maofu Liu, Daniel Hershcovich · 2025 · Information Processing & Management
- Customization and personalization of large language models for engineering designZhoumingju Jiang, Ang Liu, Dawen Zhang · 2025 · CIRP Annals
- Construction of AI Literacy Evaluation System for College Students and an Empirical Study at Wuhan UniversityDan Wu, Xinjue Sun, Shaobo Liang, Chao Qiu, Ziyi Wei · 2025 · Frontiers of digital education.
- Toward Personalizable AI Node Graph Creative Writing Support: Insights on Preferences for Generative AI Features and Information Presentation Across Story Writing ProcessesHua Xuan Qin, Guangzhi Zhu, Mingming Fan, Pan Hui · 2025 · CHI Conference on Human Factors in Computing Systems
- Decoding the Mystery: How Can LLMs Turn Text Into Cypher in Complex Knowledge Graphs?Ioanna Mandilara, Christina Maria Androna, Eleni Fotopoulou, Anastasios Zafeiropoulos, Symeon Papavassiliou · 2025 · IEEE Access
- Annotation Guideline-Based Knowledge Augmentation: Toward Enhancing Large Language Models for Educational Text ClassificationShiqi Liu, Sannyuya Liu, Lele Sha, Zijie Zeng, Dragan Gašević, Zhi Liu · 2025 · IEEE Transactions on Learning Technologies
- Large language model-guided graph convolution network reasoning system for complex human-robot collaboration disassembly operationsJinhua Xiao, Sergio Terzi · 2025 · Procedia CIRP
- Mitigating LLM Hallucinations Using a Multi-Agent FrameworkAhmed M. Darwish, Essam A. Rashed, Ghada Ahmed Khoriba · 2025 · Information
- Chat-based Person Retrieval via Dialogue-Refined Cross-Modal AlignmentYang Bai, Yucheng Ji, Min Cao, Jinqiao Wang, Mang Ye · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- Medical multimodal large language models: A systematic reviewHu, Yuan, Xu, Chenhan, Lin, Bo, Yang, Weibin, Tang, Yuan Yan · 2025 · Intelligent Oncology
- Human evaluation of large language models in healthcare: gaps, challenges, and the need for standardizationRaghav Awasthi, Atharva Bhattad, Sai Prasad Ramachandran, Shreya V. Mishra, Ashish Kumar Khanna, Jacek B. Cywiński, Kamal Kishore Maheshwari, Dwarikanath Mahapatra, Izabella DiRosa, Anabelle Cohen et al. · 2025 · npj Health Systems
- Uncertainty-aware digital twins for deep excavations with lateral supportHua-Ming Tian, Yu Wang, Yongjian Huang · 2025 · Automation in Construction
- LE-DLCM: Decoupled learner and course modeling with large language models for enhanced course recommendationJinjin Ma, Zhuo Zhao, Zhiwen Xie, Yi Zhang, Guangyou Zhou · 2025 · Knowledge-Based Systems
- Large Language Models in Modern Forensic Investigations: Harnessing the Power of Generative Artificial Intelligence in Crime Resolution and Suspect IdentificationΑναστάσιος Νικολακόπουλος, Spyridon Evangelatos, Eleni Veroni · 2024
- On the Effectiveness of Large Language Models in Statement-level Code SummarizationJie Zhu, Yun Miao, Tingting Xu, Junwu Zhu, Xiaolei Sun · 2024 · IEEE International Conference on Software Quality, Reliability and Security (QRS)
- Fine-Tuning Retrieval-Augmented Generation with an Auto-Regressive Language Model for Sentiment Analysis in Financial ReviewsMiehleketo Mathebula, Abiodun Modupe, Vukosi N. Marivate · 2024 · Applied Sciences
- LLMOverTab: Tabular data augmentation with language model-driven oversamplingTokimasa Isomura, Ryotaro Shimizu, Masayuki Goto · 2024 · Expert Systems with Applications
- Chinese fine-grained financial sentiment analysis with large language modelsYinyu Lan, Yanru Wu, Xu Wang, Weiqiang Feng, Youhao Zhang · 2024 · Neural Computing and Applications
- Optimizing Machine Translation: A Benchmarking Suite for Efficiency and Quality EnhancementNavin Kamuni, Suresh Dodda, Sathishkumar Chintala, Naveen Kunchakuri · 2024 · International Conference on Computing, Sciences and Communications (ICCSC)
- Retrospective Comparative Analysis of Prostate Cancer In-Basket Messages: Responses From Closed-Domain Large Language Models Versus Clinical TeamsYuexing Hao, Jason Holmes, Jared N. Hobson, Alexandra Bennett, Elizabeth L. McKone, Daniel K. Ebner, David M. Routman, Satomi Shiraishi, Samir H. Patel, Nathan Y. Yu et al. · 2025 · Mayo Clinic Proceedings Digital Health
- Leveraging large language models to assist philosophical counseling: prospective techniques, value, and challengesBokai Chen, Weiwei Zheng, Liang Zhao, Xiaojun Ding · 2025 · Humanities and Social Sciences Communications
- Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient TuningX.R. Li, Weijieying Ren, Wei Dong Qin, Lei Wang, Tianxiang Zhao, Richang Hong · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
- Quality Assurance for LLM-RAG Systems: Empirical Insights from Tourism Application TestingBestoun S. Ahmed, Ludwig Otto Baader, Firas Bayram, Siri Jagstedt, Peter Magnusson · 2025 · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)
- Engineering artificial intelligence: framework, challenges, and future directionJay Lee, Hanqi Su, Dai-Yan Ji, Takanobu Minami · 2025 · Machine Learning Engineering
- A Survey of Context Engineering for Large Language ModelsMei, Lingrui, Yao, Jiayu, Ge, Yuyao, Wang, Yiwei, Bi, Baolong, Cai, Yujun, Liu, Jiazhi, Li, Mingyu, Li, Zhong-Zhi, Zhang, Duzhen et al. · 2025 · arXiv
- Measuring technology acceptance over time using transfer models based on online customer reviewsDaniel Baier, Andreas Karasenko, Alexandra Rese · 2025 · Journal of Retailing and Consumer Services
- State-of-the-Art and Challenges of Engineering ML- Enabled Software Systems in the Deep Learning EraGebremariam Mesfin Assres, Guru Prasad Bhandari, Andrii Shalaginov, Tor‐Morten Grønli, Gheorghiță Ghinea · 2025 · ACM Computing Surveys
- Annotation of biological samples data to standard ontologies with support from large language modelsAndrea Riquelme-García, Juan Mulero-Hernández, Jesualdo Tomás Fernández‐Breis · 2025 · Computational and Structural Biotechnology Journal
- Translating code with Large Language Models and human-in-the-loop feedbackGabriele Dario De Siano, Anna Rita Fasolino, Giancarlo Sperlí, Andrea Vignali · 2025 · Information and Software Technology
- LLMs on a Budget: System-Level Approaches to Power-Efficient and Scalable Fine-TuningKailash Gogineni, Ali Suvizi, Guru Venkataramani · 2025 · IEEE Open Journal of the Computer Society
- Large Language Model Enhanced Recommender Systems: Methods, Applications and TrendsQidong Liu, Xiangyu Zhao, Yuhao Wang, Yejing Wang, Zijian Zhang, Yuqi Sun, Xiang Li, Maolin Wang, Pengyue Jia, Chong Chen et al. · 2025 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
- Interpretable Citrus Fruit Quality Assessment Using Vision Transformers and Lightweight Large Language ModelsZineb Jrondi, Abdellatif Moussaid, Moulay Youssef Hadi · 2025 · AgriEngineering
- Cooperative Perception for Automated Driving: A Survey of Algorithms, Applications, and Future DirectionsChuheng Wei, Guoyuan Wu, Matthew Barth · 2025 · Proceedings of the IEEE
- Chat to chip: large language model based design of arbitrarily shaped metasurfacesHuanshu Zhang, Lei Kang, Sawyer D. Campbell, Douglas H. Werner · 2025 · Nanophotonics
- Agentic AI for smart manufacturingJay Lee, Hanqi Su · 2025 · Manufacturing Letters
- CTI-Thinker: an LLM-driven system for CTI knowledge graph construction and attack reasoningXiuzhang Yang, Ruijie Zhong, Yuling Chen, Guojun Peng, Di Yao, Chaofan Chen, Chenyang Wang, Dongni Zhang, Yilin Zhou, Zixuan Yang · 2026 · Cybersecurity
- A new approach for automatic test case generation from use case diagram using LLMs and prompt engineeringLahbib Naimi, El Mahi Bouziane, Mohamed Manaouch, Abdeslam Jakimi · 2024 · International Conference on Circuit, Systems and Communication (ICCSC)
- Silent Guardian: Protecting Text From Malicious Exploitation by Large Language ModelsJiawei Zhao, Kejiang Chen, Xiaojian Yuan, Yuang Qi, Weiming Zhang, Nenghai Yu · 2024 · IEEE Transactions on Information Forensics and Security
- Compositionality and Sentence Meaning: Comparing Semantic Parsing and Transformers on a Challenging Sentence Similarity DatasetJames Fodor, Simon De Deyne, Shinsuke Suzuki · 2024 · Computational Linguistics
- On the Use of Large Language Models to Generate Capability OntologiesLuis Miguel Vieira da Silva, Aljosha Köcher, Felix Gehlhoff, Alexander Fay · 2024 · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA)
- Sustainable Digitalization of Business with Multi-Agent RAG and LLMMuhammad Arslan, Saba Munawar, Christophe Cruz · 2024 · Procedia Computer Science
- Investigating the role of large language models on questions about refractive surgerySüleyman Demir · 2025 · International Journal of Medical Informatics
- Automatic instantiation of assurance cases from patterns using large language modelsOluwafemi Odu, Alvine Boaye Belle, Song Wang, Sègla Kpodjedo, Timothy Christian Lethbridge, Hadi Hemmati · 2025 · Journal of Systems and Software
- Learning Electromagnetic Metamaterial Physics With ChatGPTDarui Lu, Yang Deng, Jordan M. Malof, Willie J. Padilla · 2025 · IEEE Access
- Medical Implications of LLM Based Clinical Decision Support Systems in HealthcareCagatay Umut Ogdu, Selen Gürbüz, Mehmet Karaköse, Eray Hanoğlu · 2025
- Research note: assessing human preferences for natural landscapes—an analysis of ChatGPT-4 and LLaVA modelsYu-Hsin Tung, Zhe-Rui Yang, Meng-Wei Shen, Chun–Yen Chang, Chien‐Chung Chen, Li-Chih Ho · 2025 · Landscape and Urban Planning
- A Human-AI Comparative Analysis of Prompt Sensitivity in LLM-Based Relevance JudgmentNegar Arabzadeh, Charles L. A. Clarke · 2025 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
- Toward Large Energy Models: A comparative study of Transformers’ efficacy for energy forecastingYueyan Gu, Farrokh Jazizadeh, Xuan Wang · 2025 · Applied Energy
- Media Bias Detector: Designing and Implementing a Tool for Real-Time Selection and Framing Bias Analysis in News CoverageJenny S Wang, Samar Haider, Amir Tohidi, Anushkaa Gupta, Y. Zhang, Chris Callison-Burch, David M. Rothschild, Duncan J. Watts · 2025 · CHI Conference on Human Factors in Computing Systems
- Artificial Intelligence Large Language Models Improve Patient Comprehension of Radiologist Magnetic Resonance Imaging ReportsEmily Berzolla, Griffith G. Gosnell, Larry Chen, Caroline Vonck, Erin F. Alaia, Robert J. Meislin · 2025 · Arthroscopy The Journal of Arthroscopic and Related Surgery
- COMPASS: Computational mapping of patient-therapist alliance strategies with language modelingBaihan Lin, Djallel Bouneffouf, Yulia Landa, Rachel Jespersen, Cheryl Mary Corcoran, Guillermo Cecchi · 2025 · Translational Psychiatry
- Application of Large Language Models in the AECO Industry: Core Technologies, Application Scenarios, and Research ChallengesGuozong Zhang, Chenyuan Lu, Qianmai Luo · 2025 · Buildings
- Foundational models and federated learning: survey, taxonomy, challenges and practical insightsCosmin-Andrei Hatfaludi, Alex Serban · 2025 · PeerJ Computer Science
- Enhancing Programming Performance, Learning Interest, and Self-Efficacy: The Role of Large Language Models in Middle School EducationBixia Tang, Jiarong Liang, Wenshuang Hu, Heng Luo · 2025 · Systems
- Benchmarking LLM-based Relevance Judgment MethodsNegar Arabzadeh, Charles L. A. Clarke · 2025 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
- EEE-Bench: A Comprehensive Multimodal Electrical And Electronics Engineering BenchmarkMing Li, Jike Zhong, Tianle Chen, Yuxiang Lai, Konstantinos Psounis · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- Lisa: a touristic chatbot for LisbonMiguel Cruz, Bruno Jardim, Miguel de Castro Neto · 2025 · Information Technology & Tourism
- ComAI: The Convergence of Communication and Artificial IntelligencePing Zhang, Kai Niu, Xiaoyun Wang, Yiming Liu, Zijian Liang, Chen Dong, Jincheng Dai, Xiaodong Xu, Wenjun Xu, Zhi Zhang et al. · 2025 · IEEE Communications Surveys & Tutorials
- Verifying energy generation via edge LLM for web3-based decentralized clean energy networksShan Jiang, Wenchang Chai, Mingjin Zhang, Jiannong Cao, Shichang Xuan, Jiaxing Shen · 2025 · Information Fusion
- Lightweight multimodal LLM-empowered dual-agent collaboration for reliable defect detection and maintenance recommendation in tunnel infrastructureGang Yu, Ruibin Ju, Vijayan Sugumaran, H Liu · 2025 · Reliability Engineering & System Safety
- Large language model agent as a mechanical designerYayati Jadhav, Amir Barati Farimani · 2026 · Journal of Engineering Design
- Advancing Autonomous Incident Response: Leveraging LLMs and Cyber Threat IntelligenceAmine Tellache, Abdelaziz Amara Korba, Amdjed Mokhtari, Horea Florin Moldovan, Yacine M. Ghamri-Doudane · 2025 · Globecom
- Improving Clinical Decision Making With a Two-Stage Recommender SystemShaina Raza, Chen Ding · 2023 · IEEE Transactions on Computational Biology and Bioinformatics
- LLMs with User-defined Prompts as Generic Data Operators for Reliable Data ProcessingLuyi Ma, Nikhil Thakurdesai, Jiao Chen, Jianpeng Xu, Evren Körpeoğlu, Sushant Kumar, Kannan Achan · 2023 · IEEE International Conference on Big Data (BigData)
- Preserving Linguistic Diversity in the Digital Age: A Scalable Model for Cultural Heritage ContinuityJames Hutson, Pace Ellsworth, Matt Ellsworth · 2024 · Journal of Contemporary Language Research
- Enhancing Network Attack Detection Accuracy through the Integration of Large Language Models and Synchronized Attention MechanismYuzhe Bai, Min Sun, Liman Zhang, Yinong Wang, Sihan Liu, Yanqiu Liu, Jingling Tan, Yingqiu Yang, Chunli Lv · 2024 · Applied Sciences
- Large language models in electronic laboratory notebooks: Transforming materials science research workflowsMehrdad Jalali, Yi Luo, Lachlan Caulfield, Eric Sauter, Alexei Nefedov, Christof Wöll · 2024 · Materials Today Communications
- Vivid-persona: customizable persona tool with interactive and immersive experiencesLeijing Zhou, Fang Yan, Shiying Ding, Yiming Cheng, Bing Yan, Wanye Zhu, Song Bao, Jian Wang, Siyang Song · 2024 · Journal of Engineering Design
- From fragments to digital wholeness: An AI generative approach to reconstructing archaeological vesselsLorenzo Cardarelli · 2024 · Journal of Cultural Heritage
- Redefining crowdsourced test report prioritization: An innovative approach with large language modelYuchen Ling, Shengcheng Yu, Chunrong Fang, Guobin Pan, Jun Wang, Jia Liu · 2024 · Information and Software Technology
- A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal ModelsFan Li, Han Su, Ching‐Hung Lee, Shanshan Feng, Zhuoxuan Jiang, Zhu Sun · 2025 · International Journal of Human-Computer Interaction
- Semantic analysis of test items through large language model embeddings predicts a-priori factorial structure of personality testsNicola Milano, Maria Luongo, Michela Ponticorvo, Davide Marocco · 2025 · Current Research in Behavioral Sciences