Assurance Equations: A Cost and Criticality Model for Optimizing Quality Assurance Surveillance
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
The cost of quality vs cost of failure correction has been a long-running topic of discussion within the Aerospace community. It leads directly to concepts of “risk tolerance”, and risk-based decision-making. It would be valuable if there was a way to compute the optimal investment in customer-executed quality assurance activities using defect significance with respect to performance objectives, the activities' defect detection effectiveness, and the cost-penalty for late discovery of impactful defects. This optimization is particularly of interest to projects whose budget constraints significantly limit their risk management options. The cost to fix defects (i.e., failure correction) escalates as the project matures. There have been studies attempting to determine the relative cost of fixing defects discovered during various phases of a project life cycle with important implications, all of which suggest growth factors are large. The commonly referred to 1:10:100 rule represents a cost multiplier for repair/rework across the Design to Fab to Test hardware development phases. Cost premiums for Quality Assurance (QA) activities also accumulate when they are treated as mandatory (due to schedule drag) or are performed later than their assigned phase. This paper describes the modeling of development phase dependencies in the conduct of typical customer-executed quality assurance activities. Our initial modeling encompasses: •Distinct phases of the production lifecycle •Multiple kinds of defects, each with some a-priori likelihood of being present •Each defect's impact on performance objectives for a type of hardware •The cost and efficacy of assurance techniques at detecting such defects •The costs of fixing those defects detected in a given phase of the production lifecycle The model captures assurance activities' abilities to detect defects. Upon detection it is assumed that the defect is immediately fixed. Defects that “escape” detection by some activity may thereafter be detected by a later activity, but by then the cost of fixing the defect may have escalated. Defects are related to the performance objectives they would detract from, were those defects to remain present in the operating system. We have constructed and are exploring a model that relates the importance of hardware system elements to mission objectives, the impact of types of defects on those hardware types, the cost of customer-executed assurance activities (i.e., supplier controls) and their effectiveness towards reducing an impactful quality escape, and the cost of defect correction across the production lifecycle. We describe the approach taken to select the key model aspects, why they are relevant to our NASA mission, and our efforts to populate it with relevant and contemporary data. We use a notional example to illustrate model design and function.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Gartner estimates annual losses of USD 12.9 million per organization, while IBM reports that U.S. businesses lose over USD 3.1 trillion annually[67-70].”
From Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles (2025) · cites this paper as [68]
Citations
Cites
Software Engineering Economics
Boehm, B. W. (2001) · Pioneers and Their Contributions to Software Engineering · doi:10.1007/978-3-642-48354-7_5 · Cited by 5,981
8.4.2 Error Cost Escalation Through the Project Life Cycle
Haskins, B., Stecklein, J., Dick, B., Moroney, G., Lovell, R., & Dabney, J. B. (2004) · INCOSE International Symposium · doi:10.1002/j.2334-5837.2004.tb00608.x · Cited by 129
Quantitative risk-based requirements reasoning
Feather, M. S., & Cornford, S. L. (2003) · Requirements Engineering · doi:10.1007/s00766-002-0160-y · Cited by 95
Self-citationDDP-a tool for life-cycle risk management
Cornford, S. L., Feather, M. S., & Hicks, K. A. (2002) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2001.931736 · Cited by 71
Self-citationModeling the effects of combining diverse software fault detection techniques
Littlewood, B., Popov, P. T., Strigini, L., & Shryane, N. M. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.888629 · Cited by 70
A systematic literature review of software quality cost research
Karg, L. M., Grottke, M., & Beckhaus, A. (2010) · Journal of Systems and Software · doi:10.1016/j.jss.2010.11.904 · Cited by 58
Feather, M. S., Kiper, J. D., & Kalafat, S. (2004) · INCOSE International Symposium · doi:10.1002/j.2334-5837.2004.tb00536.x · Cited by 14
Self-citationAn Approach to Optimize the Cost of Software Quality Assurance Analysis
Lata, M., & Kumar, R. (2010) · International Journal of Computer Applications · doi:10.5120/936-1314 · Cited by 5
Planning a Large-Scale Progression of R&D - a Pilot Study in the Aerospace Domain
Shapiro, A. A., Cornford, S. L., Feather, M. S., Price, G., Gawdiak, Y. O., & Ricks, W. R. (2006) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2006.1656015 · Cited by 2
Self-citation
Research works printed but not linked: 3
- cornford, 0, Managing Risk as a Resource using the Defect Detection and Prevention process, 4th International Conference on Probabilistic Safety and Management International Association for Probabilistic Safety Assessment and Management, 1609
- 2021, Hardware Quality Assurance Program Requirements for Programs and Projects, NASA Procedural Requirements, npr 8735 2c
- feather, 2005, Applications of tool support for risk-informed requirements reasoning, Computer Systems Science and Engineering, 20, 5
Cited by
Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles
Guillen-Aguinaga, M., Aguinaga-Ontoso, E., Guillen-Aguinaga, L., Guillen-Grima, F., & Aguinaga-Ontoso, I. (2025) · Data · doi:10.3390/data10120201 · Cited by 37
“Such issues often require costly cleansing and manual intervention—costs that exponentially exceed those of prevention [64–68].”
Alabastro, Z. M., Cordova, R. M., Ilagan, J. B., & Ilagan, J. R. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.02.092 · Cited by 3
A Nightly Feedback-Driven Strategy for Quality Control in Safety-Critical Software Development
Sun, S., Nemeth, P., Johansson, S., Wiik, T., Friberg, D., Fotrousi, F., & Staron, M. (2026) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.esem.2026.81
Metadata
- Authors
- Cornford, S. L., Wheeler, A., Feather, M. S., & Plante, J. F.
- Affiliations
- California Institute of Technology (US)
- National Aeronautics and Space Administration (US)
- ORCID
- Feather, Martin S.
- Venue
- 2022 IEEE Aerospace Conference (AERO)
- Publisher
- IEEE
- Published
- 2022-03-05
- Pages
- 1-13
- ISSN
- 1095-323X (ISSN-L)
- OpenAlex
- W4300633767
- Cited by
- 2
- References
- 9
- Citations by year
- 2025: 2
- FWCI
- 1.32
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Aerospace Conference (AERO) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
- Social Sciences › Business, Management and Accounting › Strategy and Management › Management Systems and Quality Improvement
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- quality assurance, failure costs, defect detection, criticality analysis, supplier control, risk-based decision making, quality costs, cost escalation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assurance Equations: A Cost and Criticality Model for Optimizing Quality Assurance Surveillance. https://app.cochat.ai/papers/10.1109/aero53065.2022.9843807
- The paper
- Cornford, S. L., Wheeler, A., Feather, M. S., & Plante, J. F. (2022). Assurance Equations: A Cost and Criticality Model for Optimizing Quality Assurance Surveillance. 2022 IEEE Aerospace Conference (AERO). https://doi.org/10.1109/aero53065.2022.9843807
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.