Application of Monte Carlo Simulation to Study the Probability of Confidence Level under the PFMEA’s Action Priority
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index; 1 of the 42 sources its claims cite were checked for support.
Abstract
Failure mode and effects analysis (FMEA) is the most commonly used risk evaluation tool in industry and academia. After four revisions, the US Automotive Industry Action Groups (AIAG) and German Association of the Automotive Industry (VDA) issued the latest FMEA manual, called AIAG and VDA FMEA Handbook Edition 1, in June 2019. Risk priority number (RPN) in the old-edition FMEA is replaced with action priority (AP), where the numerical evaluation of severity (S), occurrence (O), and detection (D) are referred to in the AP form for judging high (H), medium (M), and low (L) priority in order to ensure appropriate actions for improving prevention or detection control. When evaluating design (D) or process (P) in FMEA, the FMEA team has to refer to the evaluation criteria for S, O, and D, so as to reduce the difference in the evaluation reference and fairness. Since the criteria evaluation form is the qualitative rating standard with semantic judgment, evaluation errors are likely to occur when the team judges S, O, and D. The FMEA cases in this study are preceded by the confidence level (CL) of the S, O, and D evaluation standards and the setting of a confidence interval (CI) for the actual evaluation events. With discrete nonuniform distribution as the simulation setting, Monte Carlo simulation is applied several times to evaluate the probability before and after the evaluation, which is compared with the AP form to confirm the probability values of high, medium, and low priority. It provides reference for the FMEA cross-functional team, improving the originally non-AP events. Finally, the AP calculated in the simulation is compared and analyzed with the RPN sequence to verify the judgment of better actions with AP.
Overview
CoChat Summary
TL;DR
This paper applies Monte Carlo simulation with a 95% confidence level/interval to PFMEA severity, occurrence, and detection ratings, then maps simulated S/O/D combinations to action priority (AP) H/M/L probabilities. Using two semiconductor-plant PFMEA cases, it shows AP judgments can contradict old-edition RPN-based improvement decisions.
Key findings
- Case 1: simulated AP probabilities were H = 95.243%, M = 4.757%, L = 0.000%; the old-edition RPN was 96, which would normally suggest no improvement, but AP H >95% and L = 0% indicated improvement was reasonable.
- Case 2: simulated AP probabilities were H = 2.335%, M = 5.291%, L = 92.374%; the old-edition RPN was 108, which would normally suggest high risk and improvement, but AP L was 92.374%, the opposite conclusion.
- Under the RPN criterion of 100, Case 1 had RPN ≥100 probability 44.444% and <100 probability 55.556%; Case 2 had RPN ≥100 probability 51.851% and <100 probability 48.149%.
- The paper argues RPN weights S, O, and D equally, while AP prioritizes severity first, then frequency, then detection; examples include S=9, O=6, D=1 giving AP H with RPN 54, and S=9, O=2, D=2 giving AP L.
Methods
- A cross-functional team evaluates PFMEA process steps according to the AIAG and VDA FMEA Handbook, rating S, O, and D and judging H/M/L from the AP form.
- CL 95% is set for each FMEA rating: professional scoring is assumed to fall within the 95% CL, using ±1.96σ and a ±1 cutoff; S, O, and D are simulated with discrete nonuniform distributions in Crystal Ball (CB) software over 1000-time individual evaluations, with adjacent ratings at 2.5%, the main rating at 95%, and the other adjacent rating at 2.5%.
- The simulation generates 27 S/O/D combinations (3 × 3 × 3), multiplies their probabilities, maps each to AP H/M/L, verifies the probability sum is 100%, and compares results with old-edition RPN. Two PFMEA cases from a semiconductor plant equipment FMEA are used, with original S/O/D of 8, 6, 2 (Case 1) and 9, 3, 4 (Case 2).
Limitations
- The paper states no dedicated limitations section; it acknowledges that AP research is scant, the study is initial, qualitative S/O/D ratings may produce evaluation errors, and AP H/M/L is judged as a single result.
- Evident from the text: the method assumes expert scores fall within the 95% CL and treats S/O/D evaluation as based on a normal distribution; the simulation uses 1000 trials and restricts S/O/D to 1–10.
- Evident from the text: only two PFMEA cases from one semiconductor plant are analyzed, with no external validation or comparison to actual failure outcomes stated.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Evolution of the approach to FMEA. Data source: Dariusz et al . [21] Figure 1. Evolution of the approach to FMEA. Data source: Dariusz et al. [21].](https://figures.cochat.ai/paper-figures/42d611c1e6bf43109d154d9099b4c3d9/application-of-monte-carlo-simulation-to-study-the-probability-of-confidence-figure-1.png)
![Figure 2 Outputting reliability, tolerance, and confidence interval with simulation. Data source: Wittwer [31].](https://figures.cochat.ai/paper-figures/81e65119adbb4e7a9ce88216bb222644/application-of-monte-carlo-simulation-to-study-the-probability-of-confidence-figure-2.png)
![Figure 3 Construct of a CI percentile. Data source: Glen [44]. Figure 3. Construct of a CI percentile. Data source: Glen [44]. Values of 90%, 95%, or 99% are generally used as the CL indicator in normal distri-](https://figures.cochat.ai/paper-figures/803d46c3fc4f4abaa7b3782435016f3c/application-of-monte-carlo-simulation-to-study-the-probability-of-confidence-figure-3.png)
![Figure 4 N (0,1) 90%, 95%, 99% cutoff values. Data source: Heumann and Schomaker [45]. Figure 4. N(0,1) 90%, 95%, 99% cutoff values. Data source: Heumann and Schomaker [45].](https://figures.cochat.ai/paper-figures/fc5cf7fd28a8499ba29729536ddcf397/application-of-monte-carlo-simulation-to-study-the-probability-of-confidence-figure-4.png)
![Figure 5 The histogram of PMF discrete nonuniform distribution. Data source: Cross Validated Figure 5. The histogram of PMF discrete nonuniform distribution. Data source: Cross Validated [48].](https://figures.cochat.ai/paper-figures/dc4c80ac69ba4765bc8c748d3f433785/application-of-monte-carlo-simulation-to-study-the-probability-of-confidence-figure-5.png)
![Figure 6 Graph showing േ 1.96 σ and 95% CI for the mean . Data source: Altman et al. [49]. Figure 6. Graph showing ± 1.96 σ and 95% CI for the mean. Data source: Altman et al. [49].](https://figures.cochat.ai/paper-figures/c6d1321288af4f8f8be75f5f1133efd1/application-of-monte-carlo-simulation-to-study-the-probability-of-confidence-figure-6.png)











Verification
Claims the paper makes
1 Valid · 2 Not valid · 32 Not checked · 32 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For instance, the evaluation rating of the original S is 4, after Monte Carlo simulation, the data show 3 for 27 times (2.7%), 4 for 949 times (94.9%), and 5 for 24 times (2.4%), Figure 8.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, the L probability of AP is 0% while RPN in the old-edition FMEA reveals 96.”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After the simulation and operation, the H, M, L probability of AP is 95.243%, 4.757%, and 0%, respectively, Table 5.”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, L probability in AP is 92.374%, while the old-edition FMEA RPN is 108.”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Therefore, the RPN may have similar risk numbers for different combinations of S, O, and D.”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
10 more claims
Create a free account to see all 67 claims and to verify the 22 references still open.
- Probably not a substantial claim. 43
- It may state two separate claims as one. 25
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For instance, Sun et al. show that incorporating Monte Carlo simulation into the FMEA framework makes it possible to quantify the uncertainty associated with S-O-D ratings and compare the outcomes with the AP matrix [19].”
From An Intelligent Framework for Implementing AIAG–VDA FMEA and Action Priority (AP) Assessment (2026) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ 4.5. Analysis Results for Case 2 4.5. Analysis Results for Case 2
“| 5 | 10 | 3.100% | 3 | 95.300% | 4 | 95.800% | M | 2.830% | 120 | | 6 | 10 | 3.100% | 3 | 95.300% | 3 | 1.800% | M | 0.053% | 90 |”
§ 2.1. Failure Mode and Effects Analysis (FMEA)
“| 9-10 | 2-3 | 2-4 | L |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4.3. Analysis Results for Case 1
“| 9 | 9 | 1.800% | 5 | 1.800% | 1 | 3.100% | H | 0.001% | 45 |”
§ 2.1. Failure Mode and Effects Analysis (FMEA)
“| 9-10 | 4-5 | 1 | M |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4.5. Analysis Results for Case 2 4.5. Analysis Results for Case 2
“Nevertheless, the old-edition FMEA suggests adopting actions when S > 9, while the new-edition FMEA mentions potential severity for 9~10.”
§ 3.3. Setting the Output Model of the Monte Carlo Simulation 3.3. Setting the Output Model of the Monte Carlo Simulation
“For the previous criterion, enterprises normally used to set the improvement sequence of FMEA as S ≥ 9.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“each evaluation shows three probability distributions to generate 27 combinations (3 × 3).”
Reported 27 · recomputed 9
Citations
Cites
Random number generators: good ones are hard to find
Park, S. K., & Miller, K. W. (1988) · Communications of the ACM · doi:10.1145/63039.63042 · Cited by 1,262
Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability
Neyman, J. (1937) · Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences · doi:10.1098/rsta.1937.0005 · Cited by 1,087
Statistical power in two-level models: A tutorial based on Monte Carlo simulation
Arend, M. G., & Schäfer, T. (2019) · Psychological Methods · doi:10.1037/met0000195 · Cited by 693
Modified failure mode and effects analysis using approximate reasoning
Pillay, A., & Wang, J. (2003) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(02)00179-5 · Cited by 581
Mathematical Methods in Large-scale Computing Units
Lehmer, D. H. (1951) · Cited by 455
Using the confidence interval confidently
Hazra, A. (2017) · Journal of Thoracic Disease · doi:10.21037/jtd.2017.09.14 · Cited by 450
Robust misinterpretation of confidence intervals
Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0572-3 · Cited by 425
Fuzzy assessment of FMEA for engine systems
Xu, K., Tang, L. C., Xie, M., Ho, S. L., & Zhu, M. L. (2002) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(01)00101-6 · Cited by 380
Risk Management in the Construction Industry Using Combined Fuzzy FMEA and Fuzzy AHP
Abdelgawad, M., & Fayek, A. R. (2010) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0000210 · Cited by 340
Introduction to Statistics and Data Analysis
Heumann, C., Schomaker, M., & Shalabh (2016) · doi:10.1007/978-3-319-46162-5 · Cited by 281
Confidence sets for persistence diagrams
Fasy, B. T., Lecci, F., Rinaldo, A., Wasserman, L., Balakrishnan, S., & Singh, A. (2014) · The Annals of Statistics · doi:10.1214/14-aos1252 · Cited by 243
Subriadi, A. P., & Najwa, N. F. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e03161 · Cited by 148
Tong, L.-I., Wang, C.-H., & Chen, H.-C. (2005) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-004-2157-9 · Cited by 142
Failure Mode and Effect Analysis (FMEA) Implementation: A Literature Review
Sharma, K. D., & Srivastava, S. (2018) · Journal of Advance Research in Aeronautics and Space Science · Cited by 123
Zhou, J. P., Aghili, N., Ghaleini, E. N., et al. (2019) · Engineering With Computers · doi:10.1007/s00366-019-00726-z · Cited by 116
An ontology approach to support FMEA studies
Ebrahimipour, V., Rezaie, K., & Shokravi, S. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.06.033 · Cited by 102
Wealer, B., Bauer, S., Hirschhausen, C. V., Kemfert, C., & Göke, L. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.110836 · Cited by 99
Why we need confidence intervals
Altman, D. G. (2005) · World Journal of Surgery · doi:10.1007/s00268-005-7911-0 · Cited by 88
Monte Carlo Simulation approach for economic risk analysis of an emergency energy generation system
ZARONI, H. W. P., Maciel, L. B., Carvalho, D. B., et al. (2019) · Energy · doi:10.1016/j.energy.2019.01.145 · Cited by 68
Hassan, S., Wang, J., Kontovas, C., & Bashir, M. (2022) · Journal of Loss Prevention in the Process Industries · doi:10.1016/j.jlp.2021.104616 · Cited by 67
Modeling Failure Modes and Effects Analysis
Gilchrist, W. G. (1993) · International Journal of Quality & Reliability Management · Cited by 65
Uncertainty evaluation from Monte-Carlo simulations by using Crystal-Ball software
González, A. G., Herrador, M. Á., & Asuero, A. G. (2004) · Accreditation and Quality Assurance · doi:10.1007/s00769-004-0896-9 · Cited by 42
Yeh, T.-M., & Sun, J.-J. (2013) · Journal of Applied Research and Technology · doi:10.1016/s1665-6423(13)71585-2 · Cited by 39
Self-citationUncertainty evaluation from Monte-Carlo simulations by using Crystal-Ball software
González, A. G., Herrador, M. Á., & Asuero, A. G. (2005) · Accreditation and Quality Assurance · doi:10.1007/s00769-005-0934-2 · Cited by 39
Robust Misinterpretation of Confidence Intervals
Hoekstra, R., Morey, R. D., Rouder, J. N., et al. (2013) · PsycEXTRA Dataset · doi:10.1037/e633262013-897 · Cited by 39
Life Cost-Based FMEA Incorporating Data Uncertainty
Rhee, S. J., & Ishii, K. (2002) · doi:10.1115/detc2002/dfm-34185 · Cited by 20
The new IATF 16949:2016 standard in the automotive supply chain
Gruszka, J., & Misztal, A. (2017) · Research in Logistics & Production · doi:10.21008/j.2083-4950.2017.7.4.3 · Cited by 20
Zuniawan, A. (2020) · IJIEM - Indonesian Journal of Industrial Engineering and Management · doi:10.22441/ijiem.v1i2.9862 · Cited by 20
Razouk, H., & Kern, R. (2022) · Applied Sciences · doi:10.3390/app12041840 · Cited by 19
Practical Application of the New Approach To FMEA Method according to AIAG and VDA Reference Manual
Plinta, D., Golińska, E., & Dulina, Ľ. (2021) · Communications - Scientific letters of the University of Zilina · doi:10.26552/com.c.2021.4.b325-b335 · Cited by 11
Rezaie, K., Gereie, A., Ostadi, B., et al. (2008) · Computers & Industrial Engineering · doi:10.1016/j.cie.2008.04.009 · Cited by 9
AN APPROACH TO STRUCTURING A TECHNOLOGY BASE
He, H., Ying, M.-Y., Zhang, L., et al. (2007) · Journal of the Chinese Institute of Industrial Engineers · doi:10.1080/10170660709509020 · Cited by 2
Hui-qi, T. (2015) · Journal of Bengbu Medical College · Cited by 1
An Approach to Structuring a Technology Base
He, H., Ying, M.-Y., Zhang, L.-N., et al. (2007) · Journal of the Chinese Institute of Industrial Engineers · doi:10.29977/jciie.200701.0004 · Cited by 1
An ontology approach to support FMEA studies
Ebrahimipour, V., Rezaie, K., & Shokravi, S. (2009) · 2009 Annual Reliability and Maintainability Symposium · doi:10.1109/rams.2009.4914711
Research works printed but not linked: 10
- Yang, 2009, Dose FMEA try hard to get rid of RPN constraint?, Qual. Mag., 45, 37
- Hsu, 2013, How to determine a sample size in survey research, J. Taiwan Sport Pedagog., 8, 89
- Lin, 2008, Establishing E-service quality model based on FMEA: An example of 3g mobile-communication industry, Logist. Manag. Rev., 3, 47
- Frunza, 2020, Study regarding the application of the FMEA (failure modes and effects analysis) method to improve food safety in food services, Sci. Pap. Ser. D Anim. Sci.—Int. Sess. Sci. Commun. Fac. Anim. Sci., 63, 360
- Anackovski, 2021, Action priority in new FMEA as factor for resources management in risk reduction, Int. J. Sci. Eng. Res., 12, 59
- Malvin, H.K., and Paula, A.W. (2008). Monte Carlo Methods, Wiley. [2nd ed.].
- Law, A.M., and Kelton, W.D. (2000). Simulation Modeling and Analysis, McGraw-Hill.
- Eduardo, 2017, Stochastic risk analysis: Monte Carlo simulation and FMEA (Failure Mode and Effect Analysis), Rev. Espac., 38, 26
- Weiss, N.A. (2016). Introductory Statistics, Pearson & Addison Wesley. [10th ed.].
- Altman, D., Machin, D., Bryant, T., and Gardner, M. (2013). Statistics with Confidence: Confidence Intervals and Statistical Guidelines, John Wiley & Sons.
Cited by
Kornek, D., & Bert, C. (2024) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2024.02.002 · Cited by 11
Chen, Y., Da, Q., Liang, W., et al. (2022) · Mathematics · doi:10.3390/math10183382 · Cited by 7
Risk Assessment of Lift-Jacking Accidents Using FFTA-FMEA
Xu, N., Di, K., Liu, F., et al. (2023) · Applied Sciences · doi:10.3390/app13127312 · Cited by 5
“Sun found that the AP method is reasonable and appropriate by performing a differential analysis of the old RPN and the new AP in the case [22].”
MethodAn Intelligent Framework for Implementing AIAG–VDA FMEA and Action Priority (AP) Assessment
Oancea, A.-V., Ionescu, L.-M., Rontescu, C., Ionescu, N., Misztal, A., Bogatu, A.-M., Știrbu, C., Cicic, D.-T., & Stanciu, E.-M. (2026) · Applied Sciences · doi:10.3390/app16052591 · Cited by 1
Silva-Aravena, F., & Morales, J. (2025) · Health Policy and Technology · doi:10.1016/j.hlpt.2025.101036 · Cited by 2
Metadata
- Authors
- Sun, J.-J., Yeh, T.-M., & Pai, F.-Y.
- Affiliations
- IBM (United States) (US)
- National Quemoy University (TW)
- National Changhua University of Education (TW)
- Corresponding author
- Yeh, Tsu-Ming
- Pai, Fan-Yun
- Venue
- Mathematics
- Publisher
- MDPI AG
- Published
- 2022-07-25
- Volume
- 10
- Issue
- 15
- Pages
- 2596
- ISSN
- 2227-7390 (ISSN-L)
- OpenAlex
- W4287838586
- Cited by
- 10
- References
- 34
- Citations by year
- 2026: 4 · 2025: 1 · 2024: 3 · 2023: 1 · 2022: 1
- FWCI
- 0.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Mathematics (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Science and Technology of Taiwan (MOST 108-2221-E-507-004-MY3)
- Topics
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
- Social Sciences › Business, Management and Accounting › Strategy and Management › Management Systems and Quality Improvement
- Keywords
- failure mode and effects analysis, action priorities, risk priority number, confidence level, confidence intervals, evaluation criteria, risk assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.