Analysis of Log Files to Enable Smart-Troubleshooting in Industry 4.0: A Systematic Mapping Study
Open accessThe DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index.
Abstract
A crucial element of Industry 4.0, is the utilization of smart devices that generate log files. Log files are key components containing data on system operations, faults (unexpected glitches or malfunctions), errors (mistakes or incorrect actions), and failures (complete breakdowns or non-functionality). This paper presents a systematic mapping study analyzing research conducted on log files for smart-troubleshooting in Industry 4.0. To the best of our knowledge, this is the study that aims to identify research trends, log file attributes, techniques, and challenges involved in log file analysis for smart-troubleshooting. From an initial set of 941 potentially relevant peer-reviewed publications, 74 primary studies were selected and analyzed using a meticulous data extraction, analysis, and synthesis process. The results of the study demonstrate that the majority of research has focused on developing algorithms for log analysis, with machine learning being the most commonly used approach. The smart-troubleshooting encompasses a range of activities and tools that are essential for collecting failure data generated by diverse interconnected devices, conducting analyses, and aligning them with troubleshooting instructions and software remedies. Moreover, the study identifies the need for further research in the areas of real-time log analysis, anomaly detection, and the integration of log analysis with other Industry 4.0 technologies. In conclusion, our study provides insights into the current state of research in log analysis for smart-troubleshooting in Industry 4.0 and identifies areas for future research. The use of smart devices generating log files in Industry 4.0 highlights the importance of log file analysis for troubleshooting purposes. Further research is needed to address the challenges and opportunities in this field to integrate log analysis with other Industry 4.0 technologies for performing more efficient and effective troubleshooting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![FIGURE 1 Smart-troubleshooting in Industry 4.0 [18]](https://figures.cochat.ai/paper-figures/e00aa29c20ef41a885d12cb15f379594/analysis-of-log-files-to-enable-smart-troubleshooting-in-industry-4-0-a-figure-1.png)












Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Several studies have also shown that LLMs can support system log analysis [20,21], including the identi cation of potential root causes of failures [22]”
From Let’s read the log: root cause analysis of railway test execution logs with large language models (2026) · cites this paper as [20]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The vision of autonomic computing
Kephart, J. O., & Chess, D. M. (2003) · Computer · doi:10.1109/mc.2003.1160055 · Cited by 6,572 · cited 1×
“Based on our focus on self-adaptive systems, the management of such systems commonly adheres to the Monitor-Analyze-Plan-Execute over a shared Knowledge (MAPE-K) frameworks [18].”
BackgroundBasic concepts and taxonomy of dependable and secure computing
Avizienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,223 · cited 1×
“Smart-troubleshooting consists of four phases as follows [14]: 1) The prevention phase involves anticipating failures before they occur.”
BackgroundExperimentation in Software Engineering
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., & Wesslén, A. (2012) · doi:10.1007/978-3-642-29044-2 · Cited by 4,460
Systematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239 · cited 1×
“We used a systematic process of key-wording for the selection of primary studies for data extraction [32].”
MethodDesign Principles for Industrie 4.0 Scenarios
Hermann, M., Pentek, T., & Otto, B. (2016) · 2016 49th Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2016.488 · Cited by 2,974 · cited 1×
“Industry 4.0 represents a new era of manufacturing that involves the integration of digital technologies with industrial The associate editor coordinating the review of this manuscript and approving it for publication was Rongbo Zhu . processes [1].”
InfluentialBrereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2007) · Journal of Systems and Software · doi:10.1016/j.jss.2006.07.009 · Cited by 2,394
The Goal Question Metric Approach
Basili, V. R., Caldiera, G., & Rombach, H. D. (1994) · Cited by 1,651
Industry 4.0 technologies assessment: A sustainability perspective
Bai, C., Dallasega, P., Orzes, G., & Sarkis, J. (2020) · International Journal of Production Economics · doi:10.1016/j.ijpe.2020.107776 · Cited by 1,417 · cited 1×
“Industry 4.0 has the potential to automate complex and repetitive tasks, reducing production time and costs, and increasing flexibility and responsiveness to changing customer demands [12].”
BackgroundInfluentialIndustry 4.0: Towards future industrial opportunities and challenges
Zhou, K., Liu, T., & Zhou, L. (2015) · 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) · doi:10.1109/fskd.2015.7382284 · Cited by 1,221 · cited 1×
“A. INDUSTRY 4.0 The concept of ‘‘Industry 4.0’’ was initially introduced in an article in 2011 by the German government as a high-tech plan for 2020 [10].”
BackgroundInfluentialA systematic review of systematic review process research in software engineering
Kitchenham, B., & Brereton, P. (2013) · Information and Software Technology · doi:10.1016/j.infsof.2013.07.010 · Cited by 1,094
Recommended Steps for Thematic Synthesis in Software Engineering
Cruzes, D. S., & Dyba, T. (2011) · 2011 International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2011.36 · Cited by 960 · cited 1×
“To ensure a consistent and reliable classification process, we followed the guidelines presented by Cruzes and Dyba [34].”
MethodRequirements engineering paper classification and evaluation criteria: a proposal and a discussion
Wieringa, R., Maiden, N., Mead, N., & Rolland, C. (2006) · Requirements Engineering · doi:10.1007/s00766-005-0021-6 · Cited by 940 · cited 2×
“The first facet consists of two clusters that collect common information about each study, such as title, authors, and publication information and the research type based on Wieringa et al.’s taxonomy [30] and validation types based on Shaw’s taxonomy [31].”
MethodRodgers, M., Sowden, A., Petticrew, M., Arai, L., Roberts, H., Britten, N., & Popay, J. (2009) · Evaluation · doi:10.1177/1356389008097871 · Cited by 561
Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis
Fu, Q., Lou, J.-G., Wang, Y., & Li, J. (2009) · 2009 Ninth IEEE International Conference on Data Mining · doi:10.1109/icdm.2009.60 · Cited by 542 · cited 1×
“One method for achieving this is through the use of system logs, which record important events and system states at various times [19].”
MethodAnomaly Detection for a Water Treatment System Using Unsupervised Machine Learning
Inoue, J., Yamagata, Y., Chen, Y., Poskitt, C. M., & Sun, J. (2017) · 2017 IEEE International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw.2017.149 · Cited by 344
Selecting and Appraising Studies for a Systematic Review
Meade, M. O., & Richardson, W. S. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-7-199710010-00005 · Cited by 283 · cited 1×
“Candidate entries were then filtered using selection criteria [24].”
MethodGuide to computer security log management
Kent, K., & Souppaya, M. P. (2006) · doi:10.6028/nist.sp.800-92 · Cited by 275 · cited 1×
“According to the National Institute of Standards and Technology (NIST), a log refers to a documented account of the events taking place within an organization’s systems and networks [20].”
Semi-Supervised Log-Based Anomaly Detection via Probabilistic Label Estimation
Yang, L., Chen, J., Wang, Z., Wang, W., Jiang, J., Dong, X., & Zhang, W. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) · doi:10.1109/icse43902.2021.00130 · Cited by 244 · cited 1×
“One drawback of the proposed techniques is that the clustering technique employed may incur high costs when applied to high-dimensional data, and utilizing dimension reduction could potentially lead to a loss in accuracy [P71].”
MethodDetecting Anomaly in Big Data System Logs Using Convolutional Neural Network
Lu, S., Wei, X., Li, Y., & Wang, L. (2018) · 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech) · doi:10.1109/dasc/picom/datacom/cyberscitec.2018.00037 · Cited by 220
Identifying impactful service system problems via log analysis
He, S., Lin, Q., Lou, J.-G., Zhang, H., Lyu, M. R., & Zhang, D. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236083 · Cited by 201
Upgrading the manufacturing sector via applications of Industrial Internet of Things (IIoT)
Javaid, M., Haleem, A., Singh, R. P., Rab, S., & Suman, R. (2021) · Sensors International · doi:10.1016/j.sintl.2021.100129 · Cited by 192
Survey of Real-time Processing Technologies of IoT Data Streams
Yasumoto, K., Yamaguchi, H., & Shigeno, H. (2016) · Journal of Information Processing · doi:10.2197/ipsjjip.24.195 · Cited by 139 · cited 1×
“These IoT devices frequently collect large amounts of multi-variate time-series data, which can be used offline or in real-time to identify failure conditions and anomalies [5].”
BackgroundHou, Q., & Dong, J. (2023) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2023.3238709 · Cited by 127 · cited 1×
“It addresses the problem of maintaining system functionality in the presence of disturbances or failures, which is a key aspect of fault tolerance [8].”
BackgroundLogLens: A Real-Time Log Analysis System
Debnath, B. K., Solaimani, M., Gulzar, M. A., Arora, N., Lumezanu, C., Xu, J., Zong, B., Zhang, H., Jiang, G., & Khan, L. R. (2018) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2018.00105 · Cited by 117 · cited 1×
“For example, heterogeneous log files are utilized in the design and functioning of the LogLens automated log analyzer [P2].”
Method(2015) · Cited by 114
Anomaly detection for industrial control systems using process mining
Myers, D., Suriadi, S., Radke, K., & Foo, E. (2018) · Computers & Security · doi:10.1016/j.cose.2018.06.002 · Cited by 108
Farshchi, M., Schneider, J.-G., Weber, I., & Grundy, J. (2015) · 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2015.7381796 · Cited by 104
AutoLog: Anomaly detection by deep autoencoding of system logs
Catillo, M., Pecchia, A., & Villano, U. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116263 · Cited by 102 · cited 1×
“This implies that there may be security issues associated with the some approach that need to be addressed [P51].”
BackgroundZuo, Y., Wu, Y., Min, G., Huang, C., & Pei, K. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2966615 · Cited by 94
A Survey of Software Log Instrumentation
Chen, B., & Jiang, Z. M. (2021) · ACM Computing Surveys · doi:10.1145/3448976 · Cited by 94
Log-based software monitoring: a systematic mapping study
Cândido, J., Aniche, M. F., & van Deursen, A. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.489 · Cited by 87 · cited 1×
“The authors provide insights into the state-of-the-art for technology transfer and structure the research field in light of the life-cycle of log data [40].”
BackgroundLogSed: Anomaly Diagnosis through Mining Time-Weighted Control Flow Graph in Logs
Jia, T., Yang, L., Chen, P., Li, Y., Meng, F., & Xu, J. (2017) · 2017 IEEE 10th International Conference on Cloud Computing (CLOUD) · doi:10.1109/cloud.2017.64 · Cited by 86
Li, B., Ma, S., Deng, R., Choo, K. R., & Yang, J. Q. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3152620 · Cited by 69
Execution anomaly detection in large-scale systems through console log analysis
Bao, L., Li, Q., Lu, P., Lu, J., Ruan, T., & Zhang, K. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.05.016 · Cited by 67 · cited 1×
“One of the challenges related to log file analysis is that the proposed techniques are not versatile [P64].”
MethodEvaluating strategies for study selection in systematic literature studies
Ali, N. B., & Petersen, K. (2014) · Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/2652524.2652557 · Cited by 64 · cited 1×
“Following the guidelines by Ali and Petersen [29], we defined selection criteria to ensure an objective selection process.”
MethodA Semantic-aware Representation Framework for Online Log Analysis
Meng, W., Liu, Y., Huang, Y., Zhang, S., Zaiter, F., Chen, B., & Pei, D. (2020) · 2020 29th International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn49398.2020.9209707 · Cited by 63
An Integrated Method for Anomaly Detection From Massive System Logs
Liu, Z., Qin, T., Guan, X., Jiang, H., & Wang, C. (2018) · IEEE Access · doi:10.1109/access.2018.2843336 · Cited by 61
Machine learning to detect anomalies in web log analysis
Cao, Q., Qiao, Y., & Lyu, Z. (2017) · 2017 3rd IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/compcomm.2017.8322600 · Cited by 55 · cited 1×
“In terms of capability, some techniques face challenges with predictive capabilities, as they struggle to forecast anomalies [P18].”
BackgroundSafety Risk Monitoring of Cyber-Physical Power Systems Based on Ensemble Learning Algorithm
Li, Q., Meng, S., Zhang, S., Wu, M., Zhang, J., Ahvanooey, M. T., & Aslam, M. S. (2019) · IEEE Access · doi:10.1109/access.2019.2896129 · Cited by 55 · cited 1×
“This method involves training multiple models on the same dataset and combining their predictions to create a final prediction [P39].”
MethodAarohi: Making Real-Time Node Failure Prediction Feasible
Das, A., Mueller, F., & Rountree, B. (2020) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps47924.2020.00115 · Cited by 48
LogAssist: Assisting Log Analysis Through Log Summarization
Locke, S., Li, H., Chen, T.-H., Shang, W., & Liu, W. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3083715 · Cited by 45
Log-Based Anomaly Detection of CPS Using a Statistical Method
Harada, Y., Yamagata, Y., Mizuno, O., & Choi, E.-H. (2017) · International Workshop on Empirical Software Engineering in Practice (IWESEP) · doi:10.1109/iwesep.2017.12 · Cited by 44 · cited 1×
“By examining the outliers it found in the system log, LOF’s effectiveness at anomaly detection was assessed [P29].”
Smart-troubleshooting connected devices: Concept, challenges and opportunities
Caporuscio, M., Flammini, F., Khakpour, N., Singh, P., & Thornadtsson, J. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.09.004 · Cited by 43
Self-citationRobust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models
Ott, H., Bogatinovski, J., Acker, A., Nedelkoski, S., & Kao, O. (2021) · 2021 IEEE/ACM International Workshop on Cloud Intelligence (CloudIntelligence) · doi:10.1109/cloudintelligence52565.2021.00013 · Cited by 36
Logging Practices in Software Engineering: A Systematic Mapping Study
Gu, S., Rong, G., Zhang, H., & Shen, H. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3166924 · Cited by 36 · cited 1×
“Gu et al. provide a comprehensive understanding of the research state of logging practices in software engineering [39].”
BackgroundMulti-step attack detection in industrial control systems using causal analysis
Jadidi, Z., Hagemann, J., & Quevedo, D. E. (2022) · Computers in Industry · doi:10.1016/j.compind.2022.103741 · Cited by 35
Securing Manufacturing Using Blockchain
Jadidi, Z., Dorri, A., Jurdak, R., & Fidge, C. (2020) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom50675.2020.00262 · Cited by 32 · cited 1×
“For example, the logs of Industrial Control Systems devices (ICSs) were collected in a secure and distributed manner using blockchain technology and then analyzed for security purposes [P7].”
MethodUsing log analytics and process mining to enable self-healing in the Internet of Things
Singh, P., Azari, M. S., Vitale, F., Flammini, F., Mazzocca, N., Caporuscio, M., & Thornadtsson, J. (2022) · Environment Systems & Decisions · doi:10.1007/s10669-022-09859-x · Cited by 32
Self-citationGhosh, A., Qin, S., Lee, J., & Wang, G.-N. (2016) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2633392 · Cited by 31
Kim, C., Jang, M., Seo, S., Park, K., & Kang, P. (2021) · IEEE Access · doi:10.1109/access.2021.3071763 · Cited by 31 · cited 1×
“In some papers, limited data sources were employed for method evaluation [P6].”
MethodAutomated detection-in-depth in industrial control systems
Jadidi, Z., Foo, E., Hussain, M., & Fidge, C. (2022) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-021-08001-6 · Cited by 31
Insider Threat Detection using Deep Learning: A Review
Raut, M., Dhavale, S., Singh, A., & Mehra, A. (2020) · 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS) · doi:10.1109/iciss49785.2020.9315932 · Cited by 27 · cited 2×
“Such logs can be used for monitoring, auditing, and debugging purposes and contain a wide range of information about the system’s running status, including parameters, events, and process execution details [21].”
BackgroundQuantitative Narrative Analysis
Franzosi, R. (2014) · SAGE Publications Ltd eBooks · doi:10.4135/9781446268261.n23 · Cited by 26
Islam, M. N. A., Ma, Y., Granadeno, P. A. A., Chawla, N. V., & Cleland‐Huang, J. (2022) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re54965.2022.00020 · Cited by 25
Cinque, M., Corte, R. D., & Pecchia, A. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103515 · Cited by 24
Log-Based Anomaly Detection with Multi-Head Scaled Dot-Product Attention Mechanism
Du, Q., Zhao, L. Y., Xu, J., Han, Y., & Zhang, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86472-9_31 · Cited by 23
AD2: Anomaly detection on active directory log data for insider threat monitoring
Hsieh, C.-H., Lai, C.-M., Mao, C.-H., Kao, T.-C., & Lee, K.-C. (2015) · IEEE International Carnahan Conference on Security Technology (ICCST) · doi:10.1109/ccst.2015.7389698 · Cited by 22 · cited 2×
“There is a framework proposed that uses a Markov model as the kernel approach to summarizing the user’s behaviors [P21].”
MethodInfluentialWhat Makes Good Research in Software Engineering
Kalyani, V. (2022) · Journal of Science and Technology · doi:10.46243/jst.2022.v7.i08.pp24-35 · Cited by 22
Log Anomaly to Resolution: AI Based Proactive Incident Remediation
Mahindru, R., Kumar, H., & Bansal, S. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678815 · Cited by 21
A Real-Time Trace-Level Root-Cause Diagnosis System in Alibaba Datacenters
Cai, Z., Li, W., Zhu, W., Liu, L., & Yang, B. (2019) · IEEE Access · doi:10.1109/access.2019.2944456 · Cited by 20
A Convolutional Auto-Encoder Method for Anomaly Detection on System Logs
Cui, Y. J., Sun, Y., Hu, J., & Sheng, G. (2018) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2018.00519 · Cited by 19 · cited 1×
“SVMs have proven to be effective in handling high-dimensional data and handling both linearly separable and non-linearly separable problems [P13].”
BackgroundAnomaly Detection in Distributed Systems via Variational Autoencoders
Qian, Y., Ying, S., & Wang, B. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9283078 · Cited by 19
Behavior-based anomaly detection on big data
Kim, H., Kim, J., Kim, I., & Chung, T.-M. (2015) · Australasian Journal of Paramedicine · doi:10.4225/75/57b69d1ed938e · Cited by 18 · cited 1×
“For example, big data is used in the context of analyzing and processing large-scale behavior monitoring data and log data to detect and recognize cyber-targeted attacks [P70].”
MethodLog File Analysis Based on Machine Learning: A Survey
Abdalla, R. R., & Jumaa, A. K. (2022) · UHD Journal of Science and Technology · doi:10.21928/uhdjst.v6n2y2022.pp77-84 · Cited by 17 · cited 1×
“The authors also discuss the challenges and obstacles in this domain that require further improvements [42].”
BackgroundCorrelated Anomaly Detection from Large Streaming Data
Chen, Z., Yu, X., Yuan, L., Song, B., Quan, W., Hu, X., & Yan, E. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8622004 · Cited by 16
Network Log Anomaly Detection Based on GRU and SVDD
Liu, S., Chen, X., Peng, X., & Xiao, R. (2019) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-sustaincom-socialcom48970.2019.00177 · Cited by 16 · cited 1×
“They used a combination of GRU and SVM to detect anomalies in network logs, and their experiments show that their method outperforms classical GRU-MLP and LSTM algorithms [P25].”
MethodA Survey on Automatic Abnormalities Monitoring System for Log Files using Machine Learning
Ranga, S., Nageswara Guptha, M., & S, H. M. (2021) · Turkish Online Journal of Qualitative Inquiry · Cited by 16
LogAttn: Unsupervised Log Anomaly Detection with an AutoEncoder Based Attention Mechanism
Zhang, L., Li, W., Zhang, Z., Lu, Q., Hou, C., Hu, P. C., Gui, T., & Lu, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-82153-1_19 · Cited by 16 · cited 1×
“The decoder receives the importance weights from the hidden stats through the attention mechanism, enabling the model to focus only on the relevant portions of the input [P72].”
MethodRodgers, M., Sowden, A., Petticrew, M. P., Arai, L., Roberts, H. M., Britten, N., & Popay, J. (2009) · Lancaster EPrints (Lancaster University) · Cited by 16
Network troubleshooting: Survey, Taxonomy and Challenges
Tong, V., Tran, H. A., Souihi, S., & Mellouk, A. (2018) · International Conference on Smart Communications in Network Technologies (SaCoNeT) · doi:10.1109/saconet.2018.8585610 · Cited by 15
PinSQL: Pinpoint Root Cause SQLs to Resolve Performance Issues in Cloud Databases
Liu, X., Yin, Z., Zhao, C., Ge, C., Chen, L., Gao, Y., Li, D., Wang, Z., Liang, G., Tan, J. R., et al. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00236 · Cited by 15
Failure management strategies for IoT-based railways systems
Righetti, F., Vallati, C., Anastasi, G., Masetti, G., & Giandomenico, F. D. (2020) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp50058.2020.00082 · Cited by 14 · cited 1×
“In manufacturing, IoT sensors can be used to track machinery performance and detect potential maintenance issues before they cause downtime [17].”
BackgroundCinque, M., Esposito, C., & Pecchia, A. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2944477 · Cited by 13 · cited 2×
“Instead, they employ a batching approach, where log data is processed in discrete batches rather than in real time [P4].”
MethodChoi, S.-H., Youm, S., & Kang, Y.-S. (2019) · Applied Sciences · doi:10.3390/app9214502 · Cited by 13 · cited 1×
“It is a method used in manufacturing processes to monitor and control quality by analyzing and controlling the variation in a process [P60].”
MethodHussain, M., Foo, E., & Suriadi, S. (2019) · International Conference on Frontiers of Information Technology (FIT) · doi:10.1109/fit47737.2019.00037 · Cited by 12 · cited 2×
“For example,the proposed Petri Net-based method in [P10] for industrial control systems has lower precision due to suboptimal preprocessing and a lack of event context consideration.”
MethodMachines for Industry 4.0 in Higher Education
Calderón, R. R., & Izquierdo, R. B. (2020) · IEEE World Conference on Engineering Education (EDUNINE) · doi:10.1109/edunine48860.2020.9149501 · Cited by 12 · cited 1×
“This term has since gained significant attention as the fourth industrial revolution, with the potential to revolutionize traditional manufacturing processes through the integration of digital technologies [11].”
BackgroundThreshold based Technique to Detect Anomalies using Log Files
Akande, T. D., Kaur, B., Dadkhah, S., & Ghorbani, A. A. (2022) · International Conference on Machine Learning Technologies (ICMLT) · doi:10.1145/3529399.3529430 · Cited by 12 · cited 1×
“Unstructured log files are often used in large-scale distributed systems, where they play a critical role in monitoring system health, diagnosing errors, and detecting anomalies [7].”
BackgroundLeveraging Log Instructions in Log-based Anomaly Detection
Bogatinovski, J., Madjarov, G., Nedelkoski, S., Cardoso, J., & Kao, O. (2022) · IEEE International Conference on Services Computing · doi:10.1109/scc55611.2022.00053 · Cited by 12 · cited 2×
“This phenomenon poses a challenge for the model in accurately categorizing logs as either normal or abnormal [P16].”
BackgroundMethodProcess mining in industrial control systems
Xavier, M., Dubinin, V. N., Patil, S., & Vyatkin, V. V. (2022) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin51773.2022.9976111 · Cited by 12 · cited 1×
“Some anomaly detection method is not an automated system because it requires human involvement in several stages of the process [P31].”
MethodWhat Makes Good Research in Software Engineering?
Shaw, M. (2018) · doi:10.1184/r1/6626522 · Cited by 11
Ghosh, A., Qin, S., Lee, J., & Wang, G.-N. (2016) · Computational Intelligence and Neuroscience · doi:10.1155/2016/1652475 · Cited by 10 · cited 1×
“By analyzing the deviations from the nominal model, operational faults and behavioral anomalies in real-time can be detected [P69].”
BackgroundDetecting Anomalous Events on Distributed Systems Using Convolutional Neural Networks
Cheansunan, P., & Phunchongharn, P. (2019) · International Conference on Awareness Science and Technology (iCAST) · doi:10.1109/icawst.2019.8923357 · Cited by 10 · cited 1×
“The proposed framework for detecting anomalous events in distributed systems is a novel anomaly detection framework [P40].”
MethodCloudRCA: A Root Cause Analysis Framework for Cloud Computing PlatformsPreprint
Zhang, Y., Guan, Z., Qian, H., Xu, L., Liu, H., Wen, Q., Sun, L., Jiang, J., Fan, L., & Ke, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.03753 · Cited by 10
Anomaly Detection on Time-series Logs for Industrial Network
Chen, L., Kuang, X., Xu, A., Yang, Y., & Suo, S. (2020) · International Conference on Smart BlockChain (SmartBlock) · doi:10.1109/smartblock52591.2020.00022 · Cited by 9 · cited 2×
“For example, time series data can be used in the context of detecting abnormal nodes in an industrial control system’s network using a graph neural network (GNN) algorithm [P5].”
BackgroundMethodVirtual Knowledge Graphs for Federated Log Analysis
Kurniawan, K., Ekelhart, A., Kiesling, E., Winkler, D., Quirchmayr, G., & Tjoa, A. M. (2021) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3465481.3465767 · Cited by 9
Natural Language Processing-based Model for Log Anomaly Detection
Li, Z., Zhang, J., Zhang, X., Lin, F., Wang, C., & Cai, X. (2022) · IEEE International Conference on Software Engineering and Artificial Intelligence (SEAI) · doi:10.1109/seai55746.2022.9832400 · Cited by 9
Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language ModelsPreprint
Ott, H., Bogatinovski, J., Acker, A., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11570 · Cited by 8
Liu, X., Tong, Y., Xu, A., & Akkiraju, R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-76352-7_18 · Cited by 8 · cited 1×
“This can be a time-consuming and resource-intensive process, especially if the domain-specific data is limited or not readily available [P58].”
BackgroundCombining Log Files and Monitoring Data to Detect Anomaly Patterns in a Data Center
Viola, L., Ronchieri, E., & Cavallaro, C. (2022) · Computers · doi:10.3390/computers11080117 · Cited by 8
A Big Data solution for troubleshooting mobile network performance problems
Skračić, K., & Bodrusic, I. (2017) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro.2017.7973471 · Cited by 7
Converting Unstructured System Logs into Structured Event List for Anomaly Detection
Zongze, L., Davidson, M., Fu, S., Blanchard, S. P., & Lang, M. (2018) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3230833.3230855 · Cited by 7
Log Attention – Assessing Software Releases with Attention-Based Log Anomaly Detection
Munir, S., Ali, H., & Qureshi, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-14135-5_11 · Cited by 7
Li, Z., Davidson, M., Fu, S., Blanchard, S. P., & Lang, M. (2018) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc/smartcity/dss.2018.00132 · Cited by 6 · cited 1×
“These log files can be challenging to analyze, and feature selection techniques may be required to reduce the dimensionality of the data [P22].”
MethodUnstructured Log Analysis for System Anomaly Detection—A Study
Behera, A., Panigrahi, C. R., & Pati, B. (2022) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-16-5685-9_48 · Cited by 6 · cited 1×
“Behera et al. present various approaches for anomaly detection in log analysis [41].”
MethodMeasuring the forensic-ability of audit logs for nonrepudiation
King, J. (2013) · doi:10.5555/2486788.2487022 · Cited by 5
Lopper: An Efficient Method for Online Log Pattern Mining Based on Hybrid Clustering Tree
Liu, J., Hou, Z., & Li, Y. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27615-7_5 · Cited by 5 · cited 1×
“One of the commonly used machine learning algorithms is decision tree, for building an anomaly detection model [P61].”
MethodLog File Anomaly Detection Based on Process Mining Graphs
Luftensteiner, S., & Praher, P. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-14343-4_36 · Cited by 5 · cited 1×
“The graph can be constructed using various techniques, such as Process Mining [P55].”
MethodAn efficient scheme for log integrity check in security monitoring system
Zhang, R., Chen, Z., Yang, Y., & Li, Z. (2013) · IET International Conference on Smart and Sustainable City (ICSSC) · doi:10.1049/cp.2013.2026 · Cited by 4 · cited 1×
“The data integrity attribute refers to the assurance that the content of log entries remains unchanged and unaltered over time, ensuring their accuracy and reliability as valid evidence for digital investigations and security monitoring [38].”
BackgroundA Bayesian model for anomaly detection in SQL databases for security systems
Drugan, M. M. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7849905 · Cited by 4 · cited 3×
“To determine an anomaly score for each SQL query, basic and composed features were combined [P41].”
BackgroundMethodInfluentialA Parameter-Free Method for the Detection of Web Attacks
de la Torre-Abaitua, G., Lago-Fernández, L. F., & Arroyo, D. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-67180-2_64 · Cited by 4
Log and Execution Trace Analytics System
Abbasli, N., & Ganiz, M. C. (2021) · International Conference on Innovations in Intelligent Systems and Applications (INISTA) · doi:10.1109/inista52262.2021.9548437 · Cited by 4 · cited 1×
“Logs can be broadly categorized into three different types [22].”
BackgroundMeasuring the forensic-ability of audit logs for nonrepudiation
King, J. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606732 · Cited by 4 · cited 1×
“Log file attributes encompass both the content of log entries, such as usernames and timestamps, as well as a list of events that are meant to initiate the creation of these log entries [27].”
BackgroundCombining Log Files and Monitoring Data to Detect Anomaly Patterns in a Data CenterPreprint
Viola, L., Ronchieri, E., & Cavallaro, C. (2022) · Preprints.org · doi:10.20944/preprints202206.0205.v1 · Cited by 4
Machine Failure Diagnosis by Combining Software Log and Sensor Data
Onishi, T., & Kashima, H. (2021) · International Conference on Electrical, Control and Instrumentation Engineering (ICECIE) · doi:10.1109/icecie52348.2021.9664675 · Cited by 3 · cited 1×
“Structured log file has fixed format for example textual files that store records of software actions, with each log entry consisting of a timestamp and a corresponding text message in fixed format [P3].”
Supervised Learning for Detecting Cognitive Security Anomalies in Real-Time Log Data
Amin, M. A. (2022) · IEEE World Conference on Applied Intelligence and Computing (AIC) · doi:10.1109/aic55036.2022.9848922 · Cited by 3 · cited 2×
“Conversely, another group of techniques can identify anomalies but lacks the ability to pinpoint the root cause of the problem [P19].”
BackgroundMethodAnomaly Detection and Root Cause Analysis on Log Data
Pasha, D., Shah, A. H., Zadeh, E. H., & Konur, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21441-7_27 · Cited by 3 · cited 2×
“Small-scale log data refers to log files that contain a limited amount of data. for example, small-scale data can be used to train and test the root cause analysis (RCA) model [P53].”
BackgroundMethodLog Anomaly Detection Based on Bi-LSTM Feature Extraction
Zhang, Y., Zhang, D., Guo, F., Wang, X., Duan, Y., & Zhang, X. (2022) · International Conference on Data Science and Information Technology (DSIT) · doi:10.1109/dsit55514.2022.9943901 · Cited by 3 · cited 1×
“Conversely, certain research neglected to account for all relevant parameters [P8].”
BackgroundMining Patterns in Mobile Network Logs
Zargarian, G., Vassio, L., Munafò, M. M., & Mellia, M. (2019) · PORTO@Iris · Cited by 2
FARE: Schema-Agnostic Anomaly Detection in Social Event Logs
Shah, N. (2019) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2019.00049 · Cited by 2 · cited 1×
“Schema-agnostic techniques can detect anomalies in social event logs without relying on a predefined schema or structure for the logs [P26].”
MethodIslam, M. N. A., Ma, Y., Granadeno, P. A. A., Chawla, N. V., & Cleland‐Huang, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.08857 · Cited by 2
A Heuristic Approach Using Template Miners for Error Prediction in Telecommunication Networks
Marjai, P., Lehotay–Kéry, P., & Kiss, A. (2022) · IEEE Access · doi:10.1109/access.2022.3221427 · Cited by 2
Topology-Aware Event Sequence Mining for Understanding HPC System Behavior and Detecting Anomalies
Li, Z., Fu, S., Blanchard, S. P., & Lang, M. (2019) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc/smartcity/dss.2019.00315 · Cited by 1
Boot Log Anomaly Detection with K-Seen-Before
Garcia, J., & Vehkajarvi, T. (2020) · IEEE Annual Computers, Software, and Applications Conference (COMPSAC) · doi:10.1109/compsac48688.2020.0-140 · Cited by 1 · cited 1×
“They highlights the distinction between supervised anomaly detection, where ground truth labels are available, and the challenge of unsupervised anomaly detection, where the system needs to learn and adapt to the detection task without labeled data [P30].”
BackgroundConceptual Approach of Big Data Architecture Mozita Application in Industry 4.0
Widodo, A. P., Riyanto, D. E., & Rizal, M. F. (2020) · doi:10.2991/assehr.k.201010.005 · Cited by 1
HandyMann: An App based Smart Troubleshooting Assistant For A Deluge Valve Maintanence Problem
Sreehari, V. K., & Prajapati, P. P. (2018) · IEEE MIT Undergraduate Research Technology Conference (URTC) · doi:10.1109/urtc45901.2018.9244788 · Cited by 1 · cited 1×
“Numerous industries including IT, manufacturing, and healthcare, can benefit from smart-troubleshooting [15].”
BackgroundLeveraging Anomaly Detection for Proactive Application Monitoring
Zacharia, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-63799-6_29 · Cited by 1 · cited 1×
“There is the challenge of working with unlabeled data including the incorporation of a time window, to detect outliers and novel errors in the log data [P59].”
Background
Research works printed but not linked: 8
- Z. Jadidi, A. Dorri, R. Jurdak, and C. Fidge, "Securing man- ufacturing using blockchain," in 2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom), pp. 1920-1925, 2020.
- C. Zhang, X. Peng, C. Sha, K. Zhang, Z. Fu, X. Wu, Q. Lin, and D. Zhang, "DeepTraLog: Trace-log combined microservice anomaly detection through graph-based deep learning," in 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE), pp. 623-634, 2022.
- Y. Xie, K. Yang, and P. Luo, "LogM: Log analysis for multiple components of hadoop platform," IEEE Access, vol. 9, pp. 73522-73532, 2021.
- H. Hamooni, B. Debnath, J. Xu, H. Zhang, G. Jiang, and A. Mueen, "Logmine: Fast pattern recognition for log analytics," in Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, CIKM '16, (New York, NY, USA), p. 1573-1582, Association for Computing Machinery, 2016.
- S. Heda, "Case study in improving the health of a remote monitoring & diagnostics center," in Proceedings of the An- nual Conference of the Prognostics and Health Management Society, PHM, vol. 2016-October, pp. 147-153, 2016.
- H. Pérez García, J. Alfonso-Cendón, L. Sánchez González, H. Quintián, and E. Corchado, eds.), Advances in Intelligent Systems and Computing, pp. 661-671, Springer International Publishing, 2018.
- S. Daneshgadeh, N. Baykal, and S. Ertekin, "DDoS attack modeling and detection using SMO," in 2017 16th IEEE In- ternational Conference on Machine Learning and Applications (ICMLA), pp. 432-436, 2017.
- Q. Hou and J. Dong, "Distributed dynamic event-triggered consensus control for multiagent systems with guaranteed l2 performance and positive inter-event times," IEEE Transac- tions on Automation Science and Engineering, pp. 1-12, 2022.
Cited by
Machine Learning-Supported Designing of Human–Machine Interfaces
Bántay, L., & Abonyi, J. (2024) · Applied Sciences · doi:10.3390/app14041564 · Cited by 13
Microservice logs analysis employing AI: A systematic literature review
Uddin, A., Weerasinghe, S., Gajewski, D., Akbarsharifi, M., Akbarsharifi, R., Stoner, C., Cerny, T., & He, S. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.112786 · Cited by 11
LogGenST: A Framework for Synthetic Log Generation Using LLMs for Smart-Troubleshooting
Partovian, S., Flammini, F., Bucaioni, A., & Thornadtsson, J. (2025) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-031-84913-8_3 · Cited by 3
Self-citationLeveraging GANs to Generate Synthetic Log Files for Smart-Troubleshooting in Industry 4.0
Partovian, S., Flammini, F., & Bucaioni, A. (2024) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa64295.2024.00079 · Cited by 3
“Smart-troubleshooting is a method that involves collecting critical data from various interconnected devices, analyzing this data for anomaly detection and prediction, and integrating it with troubleshooting guidelines and software solutions [3].”
Self-citationZahid, M., Bucaioni, A., & Flammini, F. (2024) · IEEE International Conference on Cyber Security and Resilience (CSR) · doi:10.1109/csr61664.2024.10679385 · Cited by 2
“To the best of our knowledge, no specific ISO/IEC standard exists on the development, validation and verification, or risk assessment for ACPPS due to its relatively new domain [25], [20].”
BackgroundSelf-citation
Metadata
- Authors
- Partovian, S., Bucaioni, A., Flammini, F., & Thornadtsson, J.
- Affiliations
- Mälardalen University (SE)
- Sigma Technology Information, Stockholm, Sweden
- Venue
- IEEE Access
- Published
- 2024
- Volume
- 12
- Pages
- 147640-147658
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4389665063
- Cited by
- 16
- References
- 114
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 3
- FWCI
- 1.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Access (publishedVersion, cc-by-nc-nd)
- Florence Research (University of Florence) (acceptedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Swedish Knowledge Foundation through INDTECH and INDTECH+ Research Schools and the MoDEV Project (20200132, 20220132, 20200234)
- Vinnova through the project iSecure (202301899)
- KDT Joint Undertaking through the project MATISSE (101140216)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Digital Transformation in Industry
- Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
- Keywords
- log analysis, Industry 4.0, anomaly detection, real-time log analysis, fault diagnosis, smart devices, failure data collection, research trends
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.