CoChat

Assurance Equations: A Cost and Criticality Model for Optimizing Quality Assurance Surveillance

Cornford, Steven L., Wheeler, Alex, Feather, Martin S., Plante, Jeannette F. · 2022 · 2022 IEEE Aerospace Conference (AERO)

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

The cost of quality vs cost of failure correction has been a long-running topic of discussion within the Aerospace community. It leads directly to concepts of “risk tolerance”, and risk-based decision-making. It would be valuable if there was a way to compute the optimal investment in customer-executed quality assurance activities using defect significance with respect to performance objectives, the activities' defect detection effectiveness, and the cost-penalty for late discovery of impactful defects. This optimization is particularly of interest to projects whose budget constraints significantly limit their risk management options. The cost to fix defects (i.e., failure correction) escalates as the project matures. There have been studies attempting to determine the relative cost of fixing defects discovered during various phases of a project life cycle with important implications, all of which suggest growth factors are large. The commonly referred to 1:10:100 rule represents a cost multiplier for repair/rework across the Design to Fab to Test hardware development phases. Cost premiums for Quality Assurance (QA) activities also accumulate when they are treated as mandatory (due to schedule drag) or are performed later than their assigned phase. This paper describes the modeling of development phase dependencies in the conduct of typical customer-executed quality assurance activities. Our initial modeling encompasses: •Distinct phases of the production lifecycle •Multiple kinds of defects, each with some a-priori likelihood of being present •Each defect's impact on performance objectives for a type of hardware •The cost and efficacy of assurance techniques at detecting such defects •The costs of fixing those defects detected in a given phase of the production lifecycle The model captures assurance activities' abilities to detect defects. Upon detection it is assumed that the defect is immediately fixed. Defects that “escape” detection by some activity may thereafter be detected by a later activity, but by then the cost of fixing the defect may have escalated. Defects are related to the performance objectives they would detract from, were those defects to remain present in the operating system. We have constructed and are exploring a model that relates the importance of hardware system elements to mission objectives, the impact of types of defects on those hardware types, the cost of customer-executed assurance activities (i.e., supplier controls) and their effectiveness towards reducing an impactful quality escape, and the cost of defect correction across the production lifecycle. We describe the approach taken to select the key model aspects, why they are relevant to our NASA mission, and our efforts to populate it with relevant and contemporary data. We use a notional example to illustrate model design and function.

Overview

Integrity signals

Registry

Crossref · 10.1109/aero53065.2022.9843807

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 9 references

Research works printed but not linked: 3

  1. cornford, 0, Managing Risk as a Resource using the Defect Detection and Prevention process, 4th International Conference on Probabilistic Safety and Management International Association for Probabilistic Safety Assessment and Management, 1609
  2. 2021, Hardware Quality Assurance Program Requirements for Programs and Projects, NASA Procedural Requirements, npr 8735 2c
  3. feather, 2005, Applications of tool support for risk-informed requirements reasoning, Computer Systems Science and Engineering, 20, 5

Cited by

See all 3

Metadata

Authors
Cornford, S. L., Wheeler, A., Feather, M. S., & Plante, J. F.
Affiliations
  • California Institute of Technology (US)
  • National Aeronautics and Space Administration (US)
Venue
2022 IEEE Aerospace Conference (AERO)
Publisher
IEEE
Published
2022-03-05
Pages
1-13
ISSN
1095-323X (ISSN-L)
OpenAlex
W4300633767
Cited by
2
References
9
Citations by year
2025: 2
FWCI
1.32
Type
conference paper
Language
en
Open access
closed
Locations
IEEE Aerospace Conference (AERO) (publishedVersion)
Topics
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
  • Social Sciences › Business, Management and Accounting › Strategy and Management › Management Systems and Quality Improvement
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
Keywords
quality assurance, failure costs, defect detection, criticality analysis, supplier control, risk-based decision making, quality costs, cost escalation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Assurance Equations: A Cost and Criticality Model for Optimizing Quality Assurance Surveillance. https://app.cochat.ai/papers/10.1109/aero53065.2022.9843807
The paper
Cornford, S. L., Wheeler, A., Feather, M. S., & Plante, J. F. (2022). Assurance Equations: A Cost and Criticality Model for Optimizing Quality Assurance Surveillance. 2022 IEEE Aerospace Conference (AERO). https://doi.org/10.1109/aero53065.2022.9843807

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.