Artificial intelligence in safety-critical systems: a systematic review
Open accessAbstract
Purpose: This study is a systematic literature review of the application of artificial intelligence (AI) in safety-critical systems. The authors aim to present the current application status according to different AI techniques and propose some research directions and insights to promote its wider application. Design/methodology/approach: A total of 92 articles were selected for this review through a systematic literature review along with a thematic analysis. Findings: The literature is divided into three themes: interpretable method, explain model behavior and reinforcement of safe learning. Among AI techniques, the most widely used are Bayesian networks (BNs) and deep neural networks. In addition, given the huge potential in this field, four future research directions were also proposed. Practical implications: This study is of vital interest to industry practitioners and regulators in safety-critical domain, as it provided a clear picture of the current status and pointed out that some AI techniques have great application potential. For those that are inherently appropriate for use in safety-critical systems, regulators can conduct in-depth studies to validate and encourage their use in the industry. Originality/value: This is the first review of the application of AI in safety-critical systems in the literature. It marks the first step toward advancing AI in safety-critical domain. The paper has potential values to promote the use of the term “safety-critical” and to improve the phenomenon of literature fragmentation.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Safety arguments/reliability safety are qualitative requirements; collection of various documentation for the development process and the final product is required.
“Safety arguments/Reliability safety: qualitative requirements.Collection of various documentation for the development process and the final product.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Numerous software development requirements must be met when using AI methods in safety-critical systems (SCS).
“Regardless of the possible combinations for controlling or monitoring machines with embedded AI methods, there are numerous software development requirements that need to be met.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Situation awareness is a key factor in performance improvement and error reduction.
“Situation awareness: a key factor in performance improvement and error reduction.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Coherence (guidelines for model development to ensure consistency) is a requirement for AI methods.
“Coherence: guidelines for model development to ensure consistency.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Performance level (PL): PLa -PLe.
“Performance level (PL): PLa -PLe.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Availability: the specific functions must be executed within a certain period of time.
“Availability: the specific functions must be executed within a certain period of time.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Part of the system: when the control and monitoring software is integrated into the machine, the requirements are different from those of the diverse monitoring.
“Part of the system: when the control and monitoring software is integrated into the machine, the requirements are different from those of the diverse monitoring.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Verification methods and formal verification (e.g., rule extraction), dynamic and static verification (tests) are critical in CSC with embedded AI.
“Verification: verification methods and formal verification (e.g., rule extraction), dynamic and static verification (tests) (critical in CSC with embedded AI).”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Handling or avoiding combinatorial explosions is critical on high-dimensional data.
“Handling or avoiding combinatorial explosions: critical on high-dimensional data.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Corner-case robustness (reaction to input in safety-critical autonomous systems) is a requirement for AI methods.
“Corner-case robustness: reaction to input in safety-critical autonomous systems.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
System diagnosis: less requirements if the method is used only for diagnosis.
“System diagnosis: less requirements if the method is used only for diagnosis.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Explanation: explanation of the results adapted to the stakeholder's expertise.
“Explanation: explanation of the results adapted to the stakeholder's expertise.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
System certainty: system trust building.
“System certainty: system trust building.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Not accessible for modification by user is an important SCS prerequisite.
“Not accessible for modification by user: important SCS prerequisite.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Method for reliability analysis: the probability that the application will satisfactorily fulfill its expected function without failure.
“Method for reliability analysis: the probability that the application will satisfactorily fulfill its expected function without failure.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Proper operation: testing the functional operation of safety-related systems.
“Proper operation: testing the functional operation of safety-related systems.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Adaptability (flexible structure adaptable to different accident scenarios) is a requirement for AI methods.
“Adaptability: flexible structure adaptable to different accident scenarios.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
No external access to the system is an important SCS prerequisite.
“No external access to the system: important SCS prerequisite.”
From A requirements model for AI algorithms in functional safety-critical systems with an explainable self-enforcing network from a developer perspective (2024) · cites this paper as [64]
Cites
Tranfield, D., Denyer, D., & Smart, P. (2003) · British Journal of Management · doi:10.1111/1467-8551.00375 · Cited by 15,386 · see citing works
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · see citing works
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · see citing works
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · see citing works
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611 · see citing works
Practical Black-Box Attacks against Machine Learning
Papernot, N., McDaniel, P., Goodfellow, I., Jha, S., Celik, Z. B., & Swami, A. (2017) · Proceedings of the 2017 ACM on Asia Conference on Computer and Communications Security · doi:10.1145/3052973.3053009 · Cited by 3,495 · see citing works
Deep learning for computer vision: A brief review
Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/7068349 · Cited by 3,403 · see citing works
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507 · see citing works
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · see citing works
Doing a thematic analysis: A practical, step-by-step guide for learning and teaching scholars.
Maguire, M., & Delahunt, B. (2017) · All Ireland Journal of Higher Education · doi:10.62707/aishej.v9i3.335 · Cited by 2,099 · see citing works
A Guide to Conducting a Systematic Literature Review of Information Systems Research
Okoli, C., & Schabram, K. (2011) · doi:10.2139/ssrn.1954824 · Cited by 1,849 · see citing works
Adversarial Examples: Attacks and Defenses for Deep Learning
Yuan, X., He, P., Zhu, Q., & Li, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2886017 · Cited by 1,733 · see citing works
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712 · see citing works
Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks
Katz, G., Barrett, C., Dill, D. L., Julian, K., & Kochenderfer, M. J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-63387-9_5 · Cited by 1,706 · see citing works
Artificial Intelligence in Dentistry: Chances and Challenges
Schwendicke, F., Samek, W., & Krois, J. (2020) · Journal of Dental Research · doi:10.1177/0022034520915714 · Cited by 1,446 · see citing works
A Guide to Conducting a Standalone Systematic Literature Review
Okoli, C. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03743 · Cited by 1,413 · see citing works
An introduction to decision tree modeling
Myles, A. J., Feudale, R. N., Liu, Y., Woody, N. A., & Brown, S. D. (2004) · Journal of Chemometrics · doi:10.1002/cem.873 · Cited by 1,370 · see citing works
Benchmarking Neural Network Robustness to Common Corruptions and Perturbations
Hendrycks, D., & Dietterich, T. (2019) · arXiv · doi:10.48550/arxiv.1903.12261 · Cited by 1,335 · see citing works
Pei, K., Cao, Y., Yang, J., & Jana, S. (2017) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3132747.3132785 · Cited by 1,296 · see citing works
Survey and critique of techniques for extracting rules from trained artificial neural networks
Andrews, R., Diederich, J., & Tickle, A. B. (1995) · Knowledge-Based Systems · doi:10.1016/0950-7051(96)81920-4 · Cited by 1,225 · see citing works
AI2: Safety and Robustness Certification of Neural Networks with Abstract Interpretation
Gehr, T., Mirman, M., Drachsler-Cohen, D., Tsankov, P., Chaudhuri, S., & Vechev, M. T. (2018) · IEEE Symposium on Security and Privacy · doi:10.1109/sp.2018.00058 · Cited by 1,038 · see citing works
Improving the analysis of dependable systems by mapping fault trees into Bayesian networks
Bobbio, A., Portinale, L., Minichino, M., & Ciancamerla, E. (2001) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(00)00077-6 · Cited by 938 · see citing works
The ethics of artificial intelligence
Bostrom, N., & Yudkowsky, E. (2014) · The Cambridge Handbook of Artificial Intelligence · doi:10.1017/cbo9781139046855.020 · Cited by 918 · see citing works
Machine Learning Testing: Survey, Landscapes and Horizons
Zhang, J. M., Harman, M., Ma, L., & Liu, Y. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2962027 · Cited by 897 · see citing works
Safety Verification of Deep Neural Networks
Huang, X., Kwiatkowska, M., Wang, S., & Wu, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-63387-9_1 · Cited by 859 · see citing works
Overview on Bayesian networks applications for dependability, risk analysis and maintenance areas
Weber, P., Medina-Oliva, G., Simon, C., & Iung, B. (2010) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2010.06.002 · Cited by 769 · see citing works
Safety analysis in process facilities: Comparison of fault tree and Bayesian network approaches
Khakzad, N., Khan, F., & Amyotte, P. R. (2011) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2011.03.012 · Cited by 769 · see citing works
Research Priorities for Robust and Beneficial Artificial Intelligence
Russell, S., Dewey, D., & Tegmark, M. (2015) · AI Magazine · doi:10.1609/aimag.v36i4.2577 · Cited by 637 · see citing works
Dynamic safety analysis of process systems by mapping bow-tie into Bayesian network
Khakzad, N., Khan, F. I., & Amyotte, P. R. (2012) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2012.01.005 · Cited by 605 · see citing works
Bayesian networks in reliability
Helge Langseth, A., & Portinale, L. (2006) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.11.037 · Cited by 572 · see citing works
Safe Model-based Reinforcement Learning with Stability GuaranteesPreprint
Berkenkamp, F., Turchetta, M., Schoellig, A. P., & Krause, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08551 · Cited by 555 · see citing works
Ethical governance is essential to building trust in robotics and artificial intelligence systems
Winfield, A. F. T., & Jirotka, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0085 · Cited by 493 · see citing works
Bayesian Networks in Fault Diagnosis
Cai, B., Huang, L., & Xie, M. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2695583 · Cited by 477 · see citing works
Hein, M., Andriushchenko, M., & Bitterwolf, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00013 · Cited by 444 · see citing works
Solving the Black Box Problem: A Normative Framework for Explainable Artificial Intelligence
Zednik, C. (2021) · Philosophy & Technology · doi:10.1007/s13347-019-00382-7 · Cited by 419 · see citing works
A discrete-time Bayesian network reliability modeling and analysis framework
Boudali, H., & Dugan, J. B. (2004) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2004.06.004 · Cited by 402 · see citing works
Kabir, S., & Papadopoulos, Y. I. (2019) · Safety Science · doi:10.1016/j.ssci.2019.02.009 · Cited by 391 · see citing works
DeepMutation: Mutation Testing of Deep Learning Systems
Ma, L., Zhang, F., Sun, J., Xue, M., Li, B., Juefei-Xu, F., Xie, C., Li, L., Liu, Y., Zhao, J., et al. (2018) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2018.00021 · Cited by 385 · see citing works
Self-citationA survey of approaches combining safety and security for industrial control systems
Kriaa, S., Pietre-Cambacedes, L., Bouissou, M., & Halgand, Y. (2015) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2015.02.008 · Cited by 375 · see citing works
Fuzzy Rule-Based Bayesian Reasoning Approach for Prioritization of Failures in FMEA
Yang, Z. L., Bonsall, S., & Wang, J. (2008) · IEEE Transactions on Reliability · doi:10.1109/tr.2008.928208 · Cited by 350 · see citing works
Concolic testing for deep neural networks
Sun, Y., Wu, M., Ruan, W., Huang, X., Kwiatkowska, M., & Kroening, D. (2018) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3238147.3238172 · Cited by 337 · see citing works
Safety critical systems: challenges and directions
Knight, J. C. (2003) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2002.1007998 · Cited by 317 · see citing works
An Abstraction-Refinement Approach to Verification of Artificial Neural Networks
Pulina, L., & Tacchella, A. (2010) · International Conference on Computer Aided Verification · doi:10.1007/978-3-642-14295-6_24 · Cited by 311 · see citing works
Safety-critical systems, formal methods and standards
Bowen, J. P., & Stavridou, V. (1993) · Software Engineering Journal · doi:10.1049/sej.1993.0025 · Cited by 303 · see citing works
Zhang, Z., Beck, M. W., Winkler, D. A., Huang, B., Sibanda, W., & Goyal, H. (2018) · Annals of Translational Medicine · doi:10.21037/atm.2018.05.32 · Cited by 293 · see citing works
Output Reachable Set Estimation and Verification for Multilayer Neural Networks
Xiang, W., Tran, H.-D., & Johnson, T. T. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2808470 · Cited by 274 · see citing works
Cai, B., Liu, Y., & Xie, M. (2016) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2016.2574875 · Cited by 268 · see citing works
Efficient Formal Safety Analysis of Neural NetworksPreprint
Wang, S., Pei, K., Whitehouse, J., Yang, J., & Jana, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.08098 · Cited by 264 · see citing works
DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous CarsPreprint
Tian, Y., Pei, K., Jana, S., & Ray, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.08559 · Cited by 259 · see citing works
Complex system reliability modelling with Dynamic Object Oriented Bayesian Networks (DOOBN)
Weber, P., & Jouffe, L. (2005) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.03.006 · Cited by 258 · see citing works
Reachability-based safe learning with Gaussian processes
Akametalu, A. K., Fisac, J. F., Gillula, J., Kaynama, S., Zeilinger, M. N., & Tomlin, C. J. (2014) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2014.7039601 · Cited by 255 · see citing works
Artificial Intelligence and its Application in Different Areas
Pannu, A., & Student, M. T. (2015) · Cited by 254 · see citing works
Adversarial Examples: Opportunities and Challenges
Zhang, J., & Li, C. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2933524 · Cited by 239 · see citing works
Maximum Resilience of Artificial Neural Networks
Cheng, C., Nührenberg, G., & Rueß, H. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68167-2_18 · Cited by 238 · see citing works
A review of data mining techniques
Lee, S. J., & Siau, K. L. (2001) · Industrial Management & Data Systems · doi:10.1108/02635570110365989 · Cited by 227 · see citing works
A Dual Approach to Scalable Verification of Deep NetworksPreprint
Krishnamurthy, Dvijotham, Stanforth, R., Gowal, S., Mann, T., & Kohli, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.06567 · Cited by 223 · see citing works
Feature-Guided Black-Box Safety Testing of Deep Neural Networks
Wicker, M., Huang, X., & Kwiatkowska, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-89960-2_22 · Cited by 223 · see citing works
Bayesian Networks for Reliability Analysis of Complex Systems
Torres-Toledano, J. G., & Sucar, L. E. (1998) · Lecture notes in computer science · doi:10.1007/3-540-49795-1_17 · Cited by 209 · see citing works
Safe learning of regions of attraction for uncertain, nonlinear systems with Gaussian processes
Berkenkamp, F., Moriconi, R., Schoellig, A. P., & Krause, A. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798979 · Cited by 189 · see citing works
AI and Its New Winter: from Myths to Realities
Floridi, L. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00396-6 · Cited by 179 · see citing works
Stefania Montani, B., Portinale, L., Bobbio, A., & Codetta‐Raiteri, D. (2007) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2007.03.013 · Cited by 178 · see citing works
Adversarial Sample Detection for Deep Neural Network through Model Mutation Testing
Wang, J., Dong, G., Sun, J., Wang, X., & Zhang, P. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00126 · Cited by 168 · see citing works
Using Bayesian networks in reliability evaluation for subsea blowout preventer control system
Cai, B., Liu, Y., Liu, Z., Tian, X., Dong, X., & Yu, S. (2012) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2012.07.006 · Cited by 167 · see citing works
The effect of “open access” on citation impact: An analysis of ArXiv's condensed matter section
Moed, H. F. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20663 · Cited by 164 · see citing works
Bayesian networks inference algorithm to implement Dempster Shafer theory in reliability analysis
Simon, C., Weber, P., & Evsukoff, A. G. (2007) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2007.03.012 · Cited by 154 · see citing works
A generic method for estimating system reliability using Bayesian networks
Doğuç, Ö., & Ramírez-Márquez, J. E. (2008) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2008.06.009 · Cited by 146 · see citing works
The Lyapunov Neural Network: Adaptive Stability Certification for Safe Learning of Dynamical SystemsPreprint
Richards, S. M., Berkenkamp, F., & Krause, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.00924 · Cited by 141 · see citing works
Dynamic availability assessment of safety critical systems using a dynamic Bayesian network
Amin, M. T., Khan, F. I., & Imtiaz, S. A. (2018) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2018.05.017 · Cited by 136 · see citing works
Ethical Implications of Bias in Machine Learning
Yapo, A., & Weiss, J. W. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.668 · Cited by 130 · see citing works
Mehta, N., & Devarakonda, M. V. (2018) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2018.02.025 · Cited by 118 · see citing works
PLATO: Policy learning using adaptive trajectory optimization
Kahn, G., Zhang, T., Levine, S., & Abbeel, P. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989379 · Cited by 108 · see citing works
An intelligent situation awareness support system for safety-critical environments
Naderpour, M., Jie Lu, B., & Zhang, G. (2014) · Decision Support Systems · doi:10.1016/j.dss.2014.01.004 · Cited by 106 · see citing works
A Systematic Approach to Safety Case Management
Kelly, T. (2004) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2004-01-1779 · Cited by 106 · see citing works
Provable Robustness of ReLU networks via Maximization of Linear RegionsPreprint
Croce, F., Andriushchenko, M., & Hein, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.07481 · Cited by 102 · see citing works
Reliability modelling with dynamic bayesian networks
Weber, P., & Jouffe, L. (2003) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)36470-4 · Cited by 90 · see citing works
The safety issues of medical robotics
Fei, B., Ng, W. S., Chauhan, S., & Kwoh, C. K. (2001) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(01)00037-0 · Cited by 86 · see citing works
Kohli, P., & Chadha, A. (2019) · Lecture notes in networks and systems · doi:10.1007/978-3-030-12388-8_19 · Cited by 79 · see citing works
Prioritising the safety management elements
Law, W.-S., Chan, A. H. S., & Pun, K. F. (2006) · Industrial Management & Data Systems · doi:10.1108/02635570610671470 · Cited by 77 · see citing works
Assessing dependability of safety critical systems using diverse evidence
Fenton, N., Bev Littlewood, A., Neil, M., Strigini, L., Sutcliffe, A., & Wright, D. M. (1998) · IEE Proceedings - Software · doi:10.1049/ip-sen:19984895 · Cited by 77 · see citing works
Rule Extraction Algorithm for Deep Neural Networks: A ReviewPreprint
Hailesilassie, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.05267 · Cited by 76 · see citing works
Rethinking the Maturity of Artificial Intelligence in Safety‐Critical Settings
Cummings, M. L. (2021) · AI Magazine · doi:10.1002/j.2371-9621.2021.tb00005.x · Cited by 76 · see citing works
Kang, C. (1999) · Expert Systems with Applications · doi:10.1016/s0957-4174(99)00018-4 · Cited by 76 · see citing works
Piecewise Linear Neural Network verification: A comparative studyPreprint
Bunel, R., Turkaslan, I., Torr, P. H. S., Kohli, P., & Kumar, M. (2017) · arXiv.org · doi:10.48550/arxiv.1711.00455 · Cited by 73 · see citing works
Bayesian Networks and Evidence Theory to Model Complex Systems Reliability
Simon, C., Weber, P., & Levrat, É. (2007) · Journal of Computers · doi:10.4304/jcp.2.1.33-43 · Cited by 71 · see citing works
Use of hybrid multiple uncertain attribute decision making techniques in safety management
Yang, Z., Bonsall, S., & Wang, J. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.11.054 · Cited by 69 · see citing works
Pasman, H. J., & Rogers, W. (2012) · Journal of Loss Prevention in the Process Industries · doi:10.1016/j.jlp.2012.07.016 · Cited by 67 · see citing works
A Survey on Formal Verification Techniques for Safety-Critical Systems-on-Chip
Grimm, T., Lettnin, D. V., & Hübner, M. (2018) · Electronics · doi:10.3390/electronics7060081 · Cited by 64 · see citing works
Bouissou, M., Martin, F., & Ourghanlian, A. (1999) · Annual Reliability and Maintainability Symposium (RAMS) · doi:10.1109/rams.1999.744110 · Cited by 59 · see citing works
Rejoinder on: A random forest guided tour
Gérard Biau, A., & Scornet, E. (2016) · Test · doi:10.1007/s11749-016-0488-0 · Cited by 57 · see citing works
Developing artificial neural networks for safety critical systems
Kurd, Z., Kelly, T., & Austin, J. (2006) · Neural Computing and Applications · doi:10.1007/s00521-006-0039-9 · Cited by 55 · see citing works
Unlocking causal relations of barriers to big data analytics in manufacturing firms
Raut, R. D., Narwane, V. S., Mangla, S. K., Yadav, V. S., Narkhede, B. E., & Luthra, S. (2021) · Industrial Management & Data Systems · doi:10.1108/imds-02-2020-0066 · Cited by 54 · see citing works
A review of fault management techniques used in safety-critical avionic systems
Johnson, D. (1996) · Progress in Aerospace Sciences · doi:10.1016/0376-0421(96)82785-0 · Cited by 53 · see citing works
Detecting adversarial examples via prediction difference for deep neural networks
Guo, F., Zhao, Q., Li, X., Kuang, X., Zhang, J., Han, Y., & Tan, Y. (2019) · Information Sciences · doi:10.1016/j.ins.2019.05.084 · Cited by 52 · see citing works
A Bayesian network based method for reliability analysis of subsea blowout preventer control system
Liu, Z., & Liu, Y. (2019) · Journal of Loss Prevention in the Process Industries · doi:10.1016/j.jlp.2019.03.004 · Cited by 50 · see citing works
Chiremsel, Z., Said, R. N., & Chiremsel, R. (2016) · Journal of Failure Analysis and Prevention · doi:10.1007/s11668-016-0140-z · Cited by 48 · see citing works
A risk interpretation of sociotechnical safety perspectives
Aven, T., & Ylönen, M. (2018) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2018.03.004 · Cited by 44 · see citing works
On Definition of Artificial Intelligence
Radchenko, A. N., & Yurevich, E. I. (1972) · Springer eBooks · doi:10.1007/978-3-662-40393-8_7 · Cited by 44 · see citing works
Verification and validation of neural networks: a sampling of research in progress
Taylor, B. J., Darrah, M., & Moats, C. D. (2003) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.487527 · Cited by 44 · see citing works
Wang, C., Liu, Y., Hou, W., Wang, G., & Zheng, Y. (2020) · Journal of Loss Prevention in the Process Industries · doi:10.1016/j.jlp.2020.104066 · Cited by 44 · see citing works
An abnormal situation modeling method to assist operators in safety-critical systems
Naderpour, M., Jie Lu, B., & Zhang, G. (2014) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2014.08.003 · Cited by 43 · see citing works
On-line failure prediction in safety-critical systems
Baldoni, R., Montanari, L., & Rizzuto, M. (2014) · Future Generation Computer Systems · doi:10.1016/j.future.2014.11.015 · Cited by 43 · see citing works
The International Electrotechnical Commission
Büthe, T., & Alshadafan, A. F. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009329408.021 · Cited by 42 · see citing works
Performance evaluation of safety-critical systems of nuclear power plant systems
Kumar, P., Singh, L. K., & Kumar, C. (2019) · Nuclear Engineering and Technology · doi:10.1016/j.net.2019.08.018 · Cited by 41 · see citing works
Mathematics, technology, and trust: formal verification, computer security, and the U.S. military
MacKenzie, D. A., & Pottinger, G. (1997) · IEEE Annals of the History of Computing · doi:10.1109/85.601735 · Cited by 39 · see citing works
Bayesian networks: Application in safety instrumentation and risk reduction
Kannan, P. R. (2007) · ISA Transactions · doi:10.1016/j.isatra.2006.11.003 · Cited by 38 · see citing works
Verification and validation of neural networks for safety-critical applications
Hull, J., Ward, D., & Zakrzewski, R. (2002) · Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301) · doi:10.1109/acc.2002.1025416 · Cited by 33 · see citing works
Assured Reinforcement Learning with Formally Verified Abstract Policies
Mason, G., Călinescu, R., Kudenko⋆, D., & Banks, A. (2017) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0006156001050117 · Cited by 32 · see citing works
Rule extraction as a formal method for the verification and validation of neural networks
Taylor, B. J., & Darrah, M. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2005.1556388 · Cited by 32 · see citing works
Gran, B. A. (2002) · International Journal of Systems Science · doi:10.1080/00207720210133589 · Cited by 32 · see citing works
Amrin, A., Zarikas, V., & Spitas, C. A. (2018) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2018.07.020 · Cited by 31 · see citing works
Establishing Safety Criteria for Artificial Neural Networks
Kurd, Z., & Kelly, T. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45224-9_24 · Cited by 30 · see citing works
Challenges in the Verification of Reinforcement Learning Algorithms
van Wesel, P., & Goodloe, A. E. (2017) · NASA STI Repository (National Aeronautics and Space Administration) · Cited by 30 · see citing works
Formal Verification of Critical Aerospace Software
Wiels, V., Delmas, R., Doose, D., Garoche, P.-L., Cazin, J., & Durrieu, G. (2012) · HAL · doi:10.12762/2012.al04-10 · Cited by 30 · see citing works
Simulation-based Verification of Automotive Safety-critical Systems Based on EAST-ADL
Weissnegger, R., Schuß, M., Kreiner, C., Pistauer, M., Römer, K., & Steger, C. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.04.122 · Cited by 27 · see citing works
Righetti, L., Madhavan, R., & Chatila, R. (2019) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2019.2926996 · Cited by 26 · see citing works
Model Checking Safety-Critical Systems Using Safecharts
Hsiung, P., Chen, Y.-R., & Lin, Y.-H. (2007) · IEEE Transactions on Computers · doi:10.1109/tc.2007.1021 · Cited by 26 · see citing works
An Abstraction-Refinement Approach to Formal Verification of Tree Ensembles
Törnblom, J., & Nadjm‐Tehrani, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-26250-1_24 · Cited by 26 · see citing works
Big data analytics – enabled cyber-physical system: model and applications
Luo, S., Liu, H., & Qi, E. (2019) · Industrial Management & Data Systems · doi:10.1108/imds-10-2018-0445 · Cited by 23 · see citing works
Safety Lifecycle for Developing Safety Critical Artificial Neural Networks
Kurd, Z., & Kelly, T. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39878-3_7 · Cited by 21 · see citing works
Using fuzzy self-organising maps for safety critical systems
Kurd, Z., & Kelly, T. (2007) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2006.10.005 · Cited by 21 · see citing works
Formal Verification of Random Forests in Safety-Critical Applications
Törnblom, J., & Nadjm‐Tehrani, S. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-12988-0_4 · Cited by 19 · see citing works
An Assurance Case Pattern for the Interpretability of Machine Learning in Safety-Critical Systems
Ward, F. R., & Habli, I. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-55583-2_30 · Cited by 18 · see citing works
Using Safety Critical Artificial Neural Networks in Gas Turbine Aero-Engine Control
Kurd, Z., & Kelly, T. (2005) · Lecture notes in computer science · doi:10.1007/11563228_11 · Cited by 17 · see citing works
Systematic Review of Statistical Process Control: An Experience Report
Baldassarre, M. T., Caivano, D., Kitchenham, B. A., & Visaggio, G. (2007) · Electronic workshops in computing · doi:10.14236/ewic/ease2007.10 · Cited by 17 · see citing works
[Algorithms of artificial neural networks--practical application in medical science].
Stefaniak, B., Cholewiński, W., & Tarkowska, A. (2005) · PubMed · Cited by 11 · see citing works
Hybrid Statistical Model Checking Technique for Reliable Safety Critical Systems
Kim, Y., & Kim, M. (2012) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2012.35 · Cited by 11 · see citing works
Whether Be New “Winter” of Artificial Intelligence?
Yasnitsky, L. N. (2019) · Lecture notes in networks and systems · doi:10.1007/978-3-030-22493-6_2 · Cited by 11 · see citing works
Safe Artificial Intelligence and Formal Methods
Vassev, E. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-47166-2_49 · Cited by 10 · see citing works
Darrah, M., Taylor, B. J., & Webb, M. J. (2005) · Cited by 7 · see citing works
System Safety Analysis for Critical System Applications Using Bayesian Networks
Prabhakaran, R., Krishnaprasad, R., Nanda, M., & Jayanthi, J. G. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.07.294 · Cited by 7 · see citing works
Analysis of safety‐critical software elements in offshore safety studies
Wang, J. (2000) · Disaster Prevention and Management An International Journal · doi:10.1108/09653560010351961 · Cited by 5 · see citing works
Establishing Verification and Validation Objectives for Safety-Critical Bayesian Networks
Douthwaite, M., & Kelly, T. (2017) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew.2017.60 · Cited by 5 · see citing works
Why Formal Methods Are Considered for Safety Critical Systems?
Singh, M., Sharma, A. K., & Saxena, R. (2015) · Journal of Software Engineering and Applications · doi:10.4236/jsea.2015.810050 · Cited by 4 · see citing works
An Effective Verification and Validation Strategy for Safety-Critical Embedded Systems
Nanda, M., Jayanthi, J. G., & Rao, S. (2013) · International Journal of Software Engineering & Applications · doi:10.5121/ijsea.2013.4209 · Cited by 4 · see citing works
Nusser, S. (2009) · Digitalen Hochschulbibliothek Sachsen-Anhalt (Universitäts- und Landesbibliothek Sachsen-Anhalt) · doi:10.25673/4997 · Cited by 3 · see citing works
Improving Automation Software Dependability: A Role for Formal Methods?
Johnson, T. (2004) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)36112-8 · Cited by 3 · see citing works
Flagged first, then by citations
1 of the 138 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Park, J., & Kang, D. (2024) · Applied Sciences · doi:10.3390/app142411934 · Cited by 117 · see citing works
Artificial Intelligence in Engineering
Khaleel, M., Ahmed, A. A., & Alsharif, A. (2023) · Brilliance Research of Artificial Intelligence · doi:10.47709/brilliance.v3i1.2170 · Cited by 67 · see citing works
ALADA: A lite automatic data augmentation framework for industrial defect detection
Wang, Y., Chung, S., Khan, W. A., Wang, T., & Xu, D. J. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102205 · Cited by 51 · see citing works
Self-citationMaritime Anomaly Detection for Vessel Traffic Services: A Survey
Stach, T., Kinkel, Y., Constapel, M., & Burmeister, H.-C. (2023) · Journal of Marine Science and Engineering · doi:10.3390/jmse11061174 · Cited by 49 · see citing works
Silva, A. V., Camargo, J., Almeida, J., & Cugnasca, P. (2022) · IEEE Access · doi:10.1109/access.2022.3229233 · Cited by 51 · see citing works
A Systematic Literature Review on AI Safety: Identifying Trends, Challenges, and Future Directions
Salhab, W., Ameyed, D., Jaafar, F., & Mcheick, H. (2024) · IEEE Access · doi:10.1109/access.2024.3440647 · Cited by 43 · see citing works
Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature Review
Bach, T. A., Kristiansen, J. K., Babić, A., & Jacovi, A. (2024) · IEEE Access · doi:10.1109/access.2024.3437190 · Cited by 43 · see citing works
The role of AI in detecting and mitigating human errors in safety-critical industries: A review
Gursel, E., Madadi, M., Coble, J. B., Agarwal, V., Yadav, V., Boring, R. L., & Khojandi, A. (2024) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2024.110682 · Cited by 39 · see citing works
Roundy, P. T., & Asllani, A. A. (2024) · Industrial Management & Data Systems · doi:10.1108/imds-08-2023-0551 · Cited by 40 · see citing works
Khan, M. A., & Park, H. (2024) · Electronics · doi:10.3390/electronics13020306 · Cited by 23 · see citing works
Wu, Q., Ding, X., Zhao, L., Liu, R., He, Q., & Shao, Y. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3269122 · Cited by 19 · see citing works
An Uncertainty-Aware Deep Learning Model for Reliable Detection of Steel Wire Rope Defects
Yi, W., Chan, W. K., Lee, H. H., Boles, S. T., & Zhang, X. (2023) · IEEE Transactions on Reliability · doi:10.1109/tr.2023.3335958 · Cited by 19 · see citing works
High-risk artificial intelligence
Sunyaev, A., Benlian, A., Pfeiffer, J., Jussupow, E., Thiebes, S., Maedche, A., & Gawlitza, J. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00942-6 · Cited by 16 · see citing works
The Role of Uncertainty Quantification for Trustworthy AI
Deuschel, J., Foltyn, A., Roscher, K., & Scheele, S. (2024) · Springer eBooks · doi:10.1007/978-3-031-64832-8_5 · Cited by 14 · see citing works
Singh, A., Nawayseh, N. K., & Rakheja, S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110174 · Cited by 13 · see citing works
Reloading Process Systems Engineering within Chemical Engineering
Vassiliadis, V. S., Mappas, V. K., Espaas, T. A., Dorneanu, B., Isafiade, A. J., Möller, K. P., & Arellano‐García, H. (2024) · Process Safety and Environmental Protection · doi:10.1016/j.cherd.2024.07.066 · Cited by 13 · see citing works
Matsumoto, K., Ishihara, K., Matsuda, K., Tokunaga, K., Yamashiro, S., Soejima, H., Nakashima, N., & Kamouchi, M. (2024) · Journal of the American Heart Association · doi:10.1161/jaha.124.036447 · Cited by 12 · see citing works
Bonakdeh, E. S., Sohal, A. S., Rajabkhah, K., Prajogo, D. I., Melder, A., Nguyen, D. Q., Bingham, G., & Tong, E. (2024) · Industrial Management & Data Systems · doi:10.1108/imds-08-2022-0484 · Cited by 13 · see citing works
Toward explainable deep learning in healthcare through transition matrix and user-friendly features
Barmak, O., Krak, I. V., Yakovlev, S., Manziuk, E., Radiuk, P., & Kuznetsov, V. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1482141 · Cited by 9 · see citing works
Klüver, C., Greisbach, A., Kindermann, M., & Püttmann, B. (2024) · Security and Safety · doi:10.1051/sands/2024020 · Cited by 8 · see citing works
“As mentioned above, many methods are sublimated under AI, which can generally be divided into three classes (Figure 7) in terms of their ability to be explainable or interpretable [45].”
Khan, W. A., Chung, S., Wang, Y., Eltoukhy, A. E. E., & Liu, S. Q. (2025) · Industrial Management & Data Systems · doi:10.1108/imds-02-2025-0133 · Cited by 6 · see citing works
Self-citationCartocci, G., Veyrié, A., Cavagnetto, N., Hurter, C., Degas, A., Ferreira, A., Ahmed, M. U., Begum, S., Barua, S., Inguscio, B. M. S., et al. (2026) · Brain Informatics · doi:10.1186/s40708-025-00287-6 · Cited by 6 · see citing works
Bousia, A. (2026) · Electronics · doi:10.3390/electronics15020366 · Cited by 7 · see citing works
Cankaya, B., Roberts, R., Douglas, S. K., Vigness, R., & Oztekin, A. (2024) · Journal of Marketing Analytics · doi:10.1057/s41270-024-00290-6 · Cited by 5 · see citing works
Jurado, R. D.-A., Plaza, V. O., Ye, X., María, Z. S., Moreno, F. P., & César, G. A. (2024) · IEEE Access · doi:10.1109/access.2024.3487591 · Cited by 4 · see citing works
On Explanations for Hybrid Artificial Intelligence
Nolle, L., Stahl, F. T., & El-Mihoub, T. A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47994-6_1 · Cited by 4 · see citing works
Ensemble Learning Applications in Multiple Industries: A Review
Lin, K.-Y., & Huang, C. (2022) · Information Dynamics and Applications · doi:10.56578/ida010106 · Cited by 4 · see citing works
Machine Learning-based Aircraft Conflict Prediction: A Systematic Literature ReviewPreprint
Jamal, M., Ashraf, H., & Jhanjhi, N. Z. (2023) · Preprints.org · doi:10.20944/preprints202312.1600.v1 · Cited by 4 · see citing works
Zhou, J., Li, Z., Shi, Z., Mao, X., & Gao, C. (2025) · Sustainability · doi:10.3390/su17219395 · Cited by 3 · see citing works
AI-Driven Log Analysis: Advances and Challenges
Wang, Y., Gan, W., & Yu, P. S. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401507 · Cited by 3 · see citing works
Self-citationYu, X., He, L., Qin, J., & Liu, T. (2026) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2026.103942 · Cited by 3 · see citing works
Porcayo, A., Pang, Y., Thomas, M., & Clarke, J.-P. (2026) · Journal of Air Transport Management · doi:10.1016/j.jairtraman.2026.103063 · Cited by 3 · see citing works
Regulation and Ethical Issues of Artificial Intelligence in Ghana
Yin, E. T. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3384-7.ch005 · Cited by 3 · see citing works
Extension of Regression Tsetlin Machine for Interpretable Uncertainty Assessment
Abeyrathna, K. D., Mekkaoui, S. E., Edward, L. Y., Hafver, A., & Granmo, O. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-45072-3_2 · Cited by 3 · see citing works
Resilience in emerging complex intelligent systems: A case study of search and rescue
Yu, Y., Lakemond, N., & Holmberg, G. (2024) · Journal of Contingencies and Crisis Management · doi:10.1111/1468-5973.12626 · Cited by 3 · see citing works
Reciprocal trust and distrust in artificial intelligence systems: the hard problem of regulation
Maggetti, M. (2026) · AI & SOCIETY · doi:10.1007/s00146-026-02966-2 · Cited by 2 · see citing works
AlZoubi, W. A., Mohsin, S., Hashim, A. M., Radhi, A. D., Alrashid, Z. G., Az-Zo’bi, E. A., & Tashtoush, M. A. (2025) · International Conference on Cybersecurity and AI-Based Systems (Cyber-AI) · doi:10.1109/cyber-ai66431.2025.11233720 · Cited by 2 · see citing works
ML Based Ammonia Converter Leakage Detector and Trip Predictor for Improving Safety
Sarker, M., Rahman, M. M., Ahammed, M. S., Sarker, S., Jahan, Z., & Uddin, M. S. F. (2024) · International Conference on Recent Progresses in Science, Engineering and Technology (ICRPSET) · doi:10.1109/icrpset64863.2024.10955943 · Cited by 2 · see citing works
Explainable Artificial Intelligence to Improve Interpretability in Predictive Mutation Testing
Guerrero-Contreras, G., Balderas-Díaz, S., Delgado‐Pérez, P., & Medina‐Bulo, I. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6005-6_22 · Cited by 1 · see citing works
Design of a Universal Safety Control Computer for Aerostats
Hao, Y. S., Li, Z., Yang, Y., Du, Q., & Wang, B. (2025) · Electronics · doi:10.3390/electronics14091880 · Cited by 1 · see citing works
Expanding ML-Documentation Standards For Better Security
Appel, C. E. (2025) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew66121.2025.00041 · Cited by 1 · see citing works
From ConOps to an Operational Domain Model: Harnessing LLMs for Conceptual Model Design
Gupta, S., Rezayat, S., Burmester, G., Durak, U., Ma, H., & Hartmann, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-08620-4_9 · Cited by 1 · see citing works
Boundary objects in the development of complex cyber-physical systems: A scoping review
Ramli, M. R., & Asplund, F. (2026) · Heliyon · doi:10.1016/j.heliyon.2026.e44633 · Cited by 1 · see citing works
Qin, R., Huang, J., Zhang, Z., & Wen, G. (2026) · Journal of Manufacturing Processes · doi:10.1016/j.jmapro.2026.03.016 · Cited by 1 · see citing works
Vahan Samvedak: a comprehensive real-time college bus tracking and safety system
Chauhan, Y., Dhiman, S., Negi, S., Bamola, J., Pandey, K., Tripathi, N., Goyal, S., Gupta, S., & Kumar, M. (2026) · Scientific Reports · doi:10.1038/s41598-026-48862-z · Cited by 1 · see citing works
Generative Artificial Intelligence-driven orthodontic education practices
Zhang, M., Yang, Y., Lv, Y., Yu, Y., Hu, S., Yang, Z., Wang, Z., & Wu, M. T. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09276-7 · Cited by 1 · see citing works
Attia, M. S. (2026) · Journal of Quality in Maintenance Engineering · doi:10.1108/jqme-12-2025-0151 · Cited by 1 · see citing works
Aârab, H. (2026) · International Conference on Human Centric Artificial Intelligence (ICHCAI) · doi:10.1109/ichcai70183.2026.11607581 · Cited by 1 · see citing works
Time-Triggered Inference on FPGAs
Bebawy, Y., Schmidt, M.-C., Ahmadian, H., Ezekiel, A. M., & Obermaisser, R. (2024) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa61755.2024.10710675 · Cited by 1 · see citing works
Flehmig, N., Lundteigen, M. A., & Yin, S. (2024) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon55916.2024.10906021 · Cited by 1 · see citing works
Bayesian Parametric Matrix Models: Principled Uncertainty Quantification for Spectral LearningPreprint
Nooraiepour, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5625491 · Cited by 1 · see citing works
Das, A., Mishra, S., Bauri, K. P., & Tripathy, B. (2026) · Discover Environment · doi:10.1007/s44274-026-00897-9 · Cited by 1 · see citing works
Safety of technology with machine intelligence
Szpytko, J. (2024) · Journal of Konbin · doi:10.5604/01.3001.0054.6490
Neuro-Symbolic Artificial Intelligence for Safety Engineering
Carnevali, L., & Lippi, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-68738-9_35
A Need to Balance Between Human Behaviour & Artificial Intelligence
Priyanka (2024) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2024.v06i06.34018
Vernon, E. M., Masuyama, N., & Nojima, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5092350
Jurado, R. D.-A., Plaza, V. O., Ye, X., Suárez, M. Z., Moreno, F. P., & Arnaldo, C. G. (2025) · doi:10.3390/engproc2025090083
Anatomy of Medical Devices: From Theory to Practice
Suhail, H. R. F., Obaid, A. S. K., Faraj, A. N. O., Ahmed, H. S. M., & Jasim, M. A. (2025) · Bright Sky Publications eBooks · doi:10.62906/bs.book.400
A Fine-Tuned Multi-classifier Optimization Framework Towards Safety-Critical Classes
Wu, J., & Zhang, B. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-7036-9_12
Moselhy, N., Hassan, M. J., & Mamdouh, M. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-04288-0_13
Kumar, R., Sharma, P., & Gudur, V. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4460-7.ch001
A Benchmark Suite to Evaluate DNN’s Resilience
Bolchini, C., Bosio, A., Cassano, L., Miele, A., Pappalardo, S., Passariello, D., Ruospo, A., Sánchez, E., Reorda, M. S., & Turco, V. (2025) · IEEE International Test Conference (ITC) · doi:10.1109/itc58126.2025.00090
Comprehensive review on women safety technologies: Indian perspective
Naaz, A. S., & Basthikodi, M. (2025) · Women s Studies International Forum · doi:10.1016/j.wsif.2025.103241
Leveraging artificial intelligence to support the application of quality improvement in healthcare
Sorlie, C., Preston, C., Aurelio, M. G., Glynn, E., Miller, L., Purani, A., Chitewe, A., McAllister, S., Moore, J., & Shah, A. (2025) · British Journal of Healthcare Management · doi:10.12968/bjhc.2025.0027
Methodological Pathways for Safety and Risk Mitigation in Reduced Crew Aviation Operations
Zolghadri, A. (2025) · International Conference on Control and Fault-Tolerant Systems (SysTol) · doi:10.1109/systol66549.2025.11267337
Artificial intelligence for the energy sector/industry
Sharshir, S. W., Joseph, A., & Elsayad, M. M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-34019-2.00003-1
Artificial Intelligence on the Shop Floor: A Comprehensive Review of LiteraturePreprint
Dieterle, D. J., & Mäkiö, E. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6098259
Data-Driven and Scenario-Based Risk Analysis Considering Uncertainty in Machine Learning Systems
Okubo, T., Washizaki, H., Ubayashi, N., Yoshioka, N., Takeuchi, H., & Duy, T. V. T. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6032-5_6
User Centric Escalation Policies for Adaptive Women Safety Orchestration
Divya, P., Kumaresan, M., & Manikandan, P. (2025) · International Conference on NexGen Networks and Cybernetics (IC2NC) · doi:10.1109/ic2nc67409.2025.11376405
Mirabelli, G., Padovano, A., Sammarco, C., & Solina, V. (2026) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2026.101098
Rawat, A., Sharma, A., Awasthi, A. K., Sharma, A., Tiang, S. S., & Lim, W. H. (2026) · International Journal of Mathematical Engineering and Management Sciences · doi:10.33889/ijmems.2026.11.2.024
VisiPrint: Previewing 3D-Print Appearance from Real Material Samples
Perroni-Scharf, M., Faruqi, F., Ahn, S., Hernandez, R., Rusinkiewicz, S. M., Freeman, W. T., & Mueller, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790851
Akhai, S., Kaur, P., & Abbass, M. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/407389
Talel, L., Khelil, S., Drihem, E., Ali, M. M., & Taboubi, F. (2026) · IEEE International Conference on Complex Systems and Intelligent Computing (ICCSIC) · doi:10.1109/iccsic69301.2026.11521370
Physics-grounded optimization via interpretable process mapping
Safarpour, M. H. (2026) · Royal Society Open Science · doi:10.1098/rsos.251929
Towards a Domain-Agnostic Safety-by-Design AI Engineering Pipeline
Hoemann, E., Girija, A. A., Christensen, J. M., Kees, Y., Krone, F., Liebert, T., Mut, R., Sauter, G., Stefani, T., Köster, F., et al. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-28160-9_24
Moubayed, A. (2026) · Energy and AI · doi:10.1016/j.egyai.2026.100804
Kishnani, H., Wang, X. A., Muhammad, S., Yi, S. H., Khurram, M., Garnica, G. J., Abeywardena, K. G., Chadha, U., Srivastava, D., & Kumar, S. (2026) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-026-18427-5
Run-Time Assurance for Onboard COTS-Based AI in Safety-Critical LEO Small-Satellite Systems
Khalid, O., Gamazo-Real, J.-C., & Roibás-Millán, E. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30491-9_28
Radiuk, P., Barmak, O., Manziuk, E., & Krak, I. V. (2024) · International Workshop of IT-professionals on Artificial Intelligence (ProfIT AI) · doi:10.55056/ceur-ws.org/vol-3777/paper12.pdf
A model-based diagnosis method and application in controllable pitch propellers
Lu, S., Tang, J., Xia, C., Zhang, X., Xu, W., & Li, Z. (2026) · Ocean Engineering · doi:10.1016/j.oceaneng.2026.126869
Index policy for condition-based maintenance scheduling of aircraft fleet with limited technicians
Zhu, Y., Li, D., Hu, S., Xia, T., Pan, E., & Xi, L. (2026) · European Journal of Operational Research · doi:10.1016/j.ejor.2026.07.020
Real-Time Vibration Monitoring for Intelligent Vehicles
Aravind, D., & Suresh, N. V. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8954-7.ch006
Adaptive switching optimization for heterogeneous decision modules under operational uncertainty
Shin, H. K., Lee, C., Cha, J., Kil, M., Choi, J., & C6 (Command, C. (2026) · Journal of Industrial and Management Optimization · doi:10.3934/jimo.2026144
Fault Detectability for Learning-Augmented LPV Systems
Zolghadri, A. (2026) · International Conference on Control, Automation and Diagnosis (ICCAD) · doi:10.1109/iccad69956.2026.11643205
Kumar, S., Verma, P., Khan, U. R., Lakshman, K. N., Nema, P., & Mannepalli, P. K. (2026) · International Conference on Emerging Trends in Information, Communication & Systems (ICETICS) · doi:10.1109/icetics69505.2026.11651305
Utility-grade safety intelligence for thermal power: knowledge graph-augmented multimodal monitoring
Yan, X., Zhou, C., Qian, J., & Ding, Z. (2026) · Journal of Zhejiang University. Science A · doi:10.1631/jzus.a2500399
A Review of TinyML for Human Activity Recognition on Edge Devices
Lamaakal, I., Yahyati, C., Maleh, Y., Makkaoui, K. E., & Ouahbi, I. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8090271 · Cited by 1 · see citing works
AI-enabled dependability diagnostics for industrial product lifecycle management
Rutkowski, I. P., & Nowak, D. W. (2026) · Eksploatacja i Niezawodnosc - Maintenance and Reliability · doi:10.17531/ein/235768
What SEs Need to Know about AI and Safety‐Critical Systems
Sheard, S. (2026) · INCOSE International Symposium · doi:10.1002/iis2.70125
Shinde, R., Chachad, A. M., & Bhosale, S. S. (2026) · ACS Chemical Health & Safety · doi:10.1021/acs.chas.6c00094
Fault Prediction of Safety Critical Systems using Artificial Intelligence – A Review
Singh, P., Thennarasu, P. N., & Singh, L. K. (2026) · IEEE International Conference on Sustainable Energy and Future Electric Transportation (SEFET) · doi:10.1109/sefet69291.2026.11687697
Craioveanu, M. G., Calofir, V., & Stâmâtescu, G. (2026) · Scientific Data · doi:10.1038/s41597-026-07818-8
Sulaima, M. F., Arora, S., Krejcar, O., Herout, L., & Namazi, H. (2026) · Energy Nexus · doi:10.1016/j.nexus.2026.100869
Wojda, T. R., & Stawicki, S. P. (2026) · Artificial intelligence · doi:10.5772/intechopen.1016859
- Authors
- Wang, Y., & Chung, S. H.
- Affiliations
- Hong Kong Polytechnic University (HK)
- Venue
- Industrial Management & Data Systems
- Publisher
- Emerald
- Published
- 2021-12-07
- Volume
- 122
- Issue
- 2
- Pages
- 442-470
- ISSN
- 0263-5577 (ISSN-L)
- OpenAlex
- W4200024486
- Cited by
- 96
- References
- 138
- Citations by year
- 2026: 40 · 2025: 24 · 2024: 22 · 2023: 8 · 2022: 2
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Industrial Management & Data Systems (publishedVersion)
- PolyU Institutional Research Archive (Hong Kong Polytechnic University) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- artificial intelligence, safety-critical systems, explainable AI, safe learning, Bayesian networks, deep neural network, AI regulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review