The DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index.
NASA Standard for Models and Simulations: Philosophy and Requirements Overview
Open accessAbstract
Following the Columbia Accident Investigation Board report, the NASA Administrator chartered an executive team (known as the Diaz Team) to identify those report elements with NASA-wide applicability and to develop corrective measures to address each element. One such measure was the development of a standard for the development, documentation, and operation of models and simulations. The resulting standard attempts to develop a general framework for communicating information to decision makers by including programmatic, documentation, and reporting requirements. It also includes a scale intended to measure the credibility associated with model and simulation results. This report describes the philosophy and requirements overview of the resulting NASA Standard for Models and Simulations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The misuse of an existing model and the reliance on engineers' judgment led to the false conclusion that shuttle reentry would not be affected by a small hole in the heat shield caused by a debris strike during takeoff.
“The misuse of an existing model and the reliance on engineers’ judgment led to the false conclusion that shuttle reentry would not be affected by a small hole in the heat shield caused by a debris strike during takeoff [57, 58].”
From Adapting modeling and simulation credibility standards to computational systems biology (2023) · cites this paper as [57]
The CAS can be useful in measuring model development progress or in identifying areas where improvement is most needed.
“Additionally, it can be useful in measuring model development progress or in identifying areas where improvement is most needed [57].”
From Adapting modeling and simulation credibility standards to computational systems biology (2023) · cites this paper as [57]
Citations
Cites
Verification and Validation in Scientific Computing
Oberkampf, W. L., & Roy, C. J. (2010) · doi:10.1017/cbo9780511760396 · Cited by 1,556
Verification and validation in computational fluid dynamics
Oberkampf, W. L., & Trucano, T. G. (2002) · Progress in Aerospace Sciences · doi:10.1016/s0376-0421(02)00005-2 · Cited by 1,165
Jackson, S. (2016) · Routledge eBooks · doi:10.4324/9781315611716-18 · Cited by 804
Guide for Verification and Validation in Computational Solid Mechanics
Schwer, L. E. (2009) · NCSU Libraries Repository (North Carolina State University Libraries) · Cited by 391
Robert Grosseteste and the Origins of Experimental Science, 1100-1700.
Carre, M. H., & Crombie, A. C. (1954) · The Philosophical Quarterly · doi:10.2307/2217281 · Cited by 280
The Optics of Ibn Al-Haytham: Books I-III, on Direct Vision
Saliba, G. A., & Sabra, A. I. (1992) · Journal of the American Oriental Society · doi:10.2307/603118 · Cited by 172
A methodology for certification of modeling and simulation applications
Balcı, O. (2001) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/508366.508369 · Cited by 119
An Unedited Part of Roger Bacon's ‘Opus Maius’: ‘de Signis’
Fredborg, K. M., Nielsen, L. O., & Pinborg, J. (1978) · Traditio · doi:10.1017/s0362152900016093 · Cited by 118
A Proposed Model for Simulation Validation Process Maturity
Harmon, S. Y., & Youngblood, S. (2005) · The Journal of Defense Modeling and Simulation Applications Methodology Technology · doi:10.1177/154851290500200402 · Cited by 46
Design and execution of validation experiments
Oberkampf, W. L., & Roy, C. J. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511760396.016 · Cited by 13
NASA Standard for Models and Simulations: Credibility Assessment Scale
Babula, M., Bertch, W. J., Green, L. L., Hale, J. P., Mosier, G. E., Steele, M., & Woods, J. L. (2009) · AIAA Aerospace Sciences Meeting · doi:10.2514/6.2009-1011 · Cited by 11
The NASA standard for models and simulations
Steele, M. J. (2007) · Summer Computer Simulation Conference · doi:10.5555/1357910.1357912 · Cited by 8
Development of NASA's Models and Simulations Standard
Bertch, W. J., Zang, T. A., & Steele, M. J. (2008) · NASA Technical Reports Server (NASA) · Cited by 4
Self-citation
Flagged first, then by citations
1 of the 15 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Bertch W. J., 2008, 2008 SISO Spring Simulation Interoperability Workshop
- Bacon R., 1879, Opus Maius
Cited by
Sorted by citations
CFD Vision 2030 Study: A Path to Revolutionary Computational Aerosciences
Slotnick, J. P., Khodadoust, A., Alonso, J. J., Darmofal, D., Gropp, W., Lurie, E. A., & Mavriplis, D. J. (2014) · NASA Technical Reports Server (NASA) · Cited by 673
Adapting modeling and simulation credibility standards to computational systems biology
Tatka, L. T., Smith, L. P., Hellerstein, J. L., & Sauro, H. M. (2023) · Journal of Translational Medicine · doi:10.1186/s12967-023-04290-5 · Cited by 27
Maré, J. (2018) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2018.07.015 · Cited by 18
Establishing Confidence in Safety Assessment Evidence
Sun, L. (2012) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 16
Role of Computational Fluid Dynamics and Wind Tunnels in Aeronautics R and D
Malik, M. R., & Bushnell, D. M. (2012) · NASA Technical Reports Server (NASA) · Cited by 15
NASA Standard for Models and Simulations: Credibility Assessment Scale
Babula, M., Bertch, W. J., Green, L. L., Hale, J. P., Mosier, G. E., Steele, M., & Woods, J. L. (2009) · AIAA Aerospace Sciences Meeting · doi:10.2514/6.2009-1011 · Cited by 11
Fundamental Theory of Scientific Computer Simulation Review
Kaizer, J. S. (2013) · University Libraries (University of Maryland) · Cited by 5
Optimal Selection of Model Validation Experiments: Guided by Coverage
Hällqvist, R., Braun, R., Eek, M., & Krus, P. (2021) · Journal of Verification Validation and Uncertainty Quantification · doi:10.1115/1.4051497 · Cited by 4
Assurance Guidance for Space Mission use of Data-Driven Machine Learning
Feather, M. S., Guerrini, S., Slingerland, P. C., & Spolaor, M. (2023) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero55745.2023.10115571 · Cited by 3
Gao, H., Meng, L., & Wang, J. (2014) · Science China Technological Sciences · doi:10.1007/s11431-013-5450-8 · Cited by 2
Efficient Interval-Based Uncertainty Quantification for Model Validation and Predictive Capability
Chen, Y. (., Ioannou, I., & Ferson, S. A. (2026) · AIAA SciTech Forum · doi:10.2514/6.2026-0296
Enhancing Student Learning Using SPs: Collaborative Relationships Between Faculty and SPs
Meyer, S. A., Moceri, J. T., Short, N. A., de Oliveria, C. R., Sideras, S. A., & Burton, C. W. (2026) · Journal of Nursing Education · doi:10.3928/01484834-20251031-01
Metadata
- Authors
- Blattnig, S. R., Luckring, J. M., Morrison, J. H., Sylvester, A. J., Tripathi, R. K., & Zang, T. A.
- Affiliations
- Langley Research Center (US)
- Johnson Space Center (US)
- ORCID
- Blattnig, Steve R.
- Venue
- Journal of Aircraft
- Published
- 2013-01
- Volume
- 50
- Issue
- 1
- Pages
- 20-28
- ISSN
- 0021-8669 (ISSN-L)
- 1533-3868
- OpenAlex
- W2107426725
- Cited by
- 12
- References
- 15
- Citations by year
- 2026: 2 · 2023: 2 · 2021: 1 · 2018: 1 · 2014: 2 · 2013: 1
- FWCI
- 2.32
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Aircraft (publishedVersion)
- NASA STI Repository (National Aeronautics and Space Administration) (submittedVersion)
- Funders
- U.S. Department of Defense
- National Aeronautics and Space Administration
- Glenn Research Center
- Kennedy Space Center
- Jet Propulsion Laboratory
- Marshall Space Flight Center
- Goddard Space Flight Center
- Langley Research Center
- Stennis Space Center
- NASA Engineering and Safety Center
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Systems Engineering Methodologies and Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Simulation Techniques and Applications
- Physical Sciences › Mathematics › Modeling and Simulation › Modeling and Simulation Systems
- Keywords
- model documentation, model credibility, Columbia Accident Investigation Board, reporting requirements
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review