Empirical study on fine-tuning pre-trained large language models for fault diagnosis of complex systems

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173

Survey of Hallucination in Natural Language Generation

Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025

Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models

Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505

Learning without Forgetting

Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202

Large language models encode clinical knowledge

Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083

Large Language Models Encode Clinical Knowledge

Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083

A plant-wide industrial process control problem

Downs, J. J., & Vogel, E. F. (1993) · Computers & Chemical Engineering · doi:10.1016/0098-1354(93)80018-i · Cited by 3,348

Training Language Models to Follow Instructions with Human Feedback

Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101

Llama 2: Open Foundation and Fine-Tuned Chat Models

Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604

FD-LLM: Large language model for fault diagnosis of complex equipment

Lin, L., Zhang, S., Fu, S., & Liu, Y. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103208 · Cited by 153

Enhancing diagnostic capability with multi-agents conversational large language models

Chen, X., Yi, H., You, M., Liu, W., Wang, L., Li, H., Zhang, X., Guo, Y., Fan, L., Chen, G., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01550-0 · Cited by 147

IIoT-enabled digital twin for legacy and smart factory machines with LLM integration

Gautam, A., Aryal, M. R., Deshpande, S., Padalkar, S., Nikolaenko, M., Tang, M., & Anand, S. (2025) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2025.03.022 · Cited by 64

A Survey on Applications of Large Language Model-Driven Digital Twins for Intelligent Network Optimization

Guo, Z., Tang, F., Luo, L., Zhao, M., & Kato, N. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3568637 · Cited by 52

A Review of Large Language Models for Energy Systems: Applications, Challenges, and Future Prospects

Mirshekali, H., Shadi, M. R., Ladani, F. G., & Shaker, H. R. (2025) · IEEE Access · doi:10.1109/access.2025.3610994 · Cited by 64

Exploring LLM-based Frameworks for Fault DiagnosisPreprint

Lee, X. Y., Vidyaratne, L., Farahat, A., & Gupta, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.23113

The Interpretable Reasoning and Intelligent Decision-Making Based on Event Knowledge Graph With LLMs in Fault Diagnosis Scenarios

Men, C., Han, Y., Wang, P., Tao, J., & Huang, C. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3550999 · Cited by 37

Domain-specific large language models for fault diagnosis of heating, ventilation, and air conditioning systems by labeled-data-supervised fine-tuning

Zhang, J., Zhang, C., Lu, J., & Zhao, Y. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.124378 · Cited by 79

Using SLMs and LLMs for Diagnosis

Plank, S., & Wotawa, F. (2026) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.dx.2026.14

A Multi-stage Post-Training Framework for Domain-Specific Language Models in Fault DiagnosisPreprint

Zhang, W., Fang, H., Wu, T., Wang, C., Xu, L., Bu, J., Yu, Y. S., & Zhong, Q. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5953702

Human-Like One-Shot Fault Diagnosis via Large Language Model

Han, H., Gao, X., Han, H., Gao, H., & Qi, Y. (2025) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2025.3635892 · Cited by 4

A large language model-guided machinery fault diagnosis model based on multi-task prompt tuning and adaptive adversarial distillationPreprint

Jiang, Z., & Yu, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6293248

Can Large Language Models Diagnose Machine Faults? A Comprehensive Survey from Deep Learning to Foundation ModelsPreprint

Chen, W., Zhang, J., Liu, H., Wang, M., & Li, Y. (2026) · doi:10.36227/techrxiv.177281073.38924355/v1

Hybrid Fine-Tuning in Large Language Model Learning for Machinery Fault Diagnosis

Pang, Z., Zhang, H., & Li, T. (2024) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin58382.2024.10774330 · Cited by 11

How can the integration of AI large language models and knowledge graph enhance fault diagnosis? A systematic literature review

Razaq, W. B. M., Chen, H., Machado, M., & Moreira, J. L. R. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.114908 · Cited by 4