The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Combining Quantitative and Qualitative Measures of Uncertainty in Model‐Based Environmental Assessment: The NUSAP System
Open accessAbstract
This article discusses recent experiences with the Numeral Unit Spread Assessment Pedigree (NUSAP) system for multidimensional uncertainty assessment, based on four case studies that vary in complexity. We show that the NUSAP method is applicable not only to relatively simple calculation schemes but also to complex models in a meaningful way and that NUSAP is useful to assess not only parameter uncertainty but also (model) assumptions. A diagnostic diagram can be used to synthesize results of quantitative analysis of parameter sensitivity and qualitative review (pedigree analysis) of parameter strength. It provides an analytic tool to prioritize uncertainties according to quantitative and qualitative insights in the limitations of available knowledge. We show that extension of the pedigree scheme to include societal dimensions of uncertainty, such as problem framing and value‐laden assumptions, further promotes reflexivity and collective learning. When used in a deliberative setting, NUSAP pedigree assessment has the potential to foster a deeper social debate and a negotiated management of complex environmental problems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Tools of post-normal-science inspiration for knowledge and modelling quality assessment could be adapted to the analysis of algorithms, such as the NUSAP (Numeral Unit Spread Assessment Pedigree) notation system for the management and communication of uncertainty (Funtowicz and Ravetz, 1990;Van Der Sluijs, 2005) and sensitivity auditing (Saltelli and Funtowicz, 2014), respectively.”
From Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward (2020) · cites this paper as Van Der Sluijs, 2005
Citations
Cites
Toulmin, S. E. (2003) · doi:10.1017/cbo9780511840005 · Cited by 7,101
Factorial Sampling Plans for Preliminary Computational Experiments
Morris, M. D. (1991) · Technometrics · doi:10.1080/00401706.1991.10484804 · Cited by 4,943
Science for the post-normal age
Funtowicz, S., & Ravetz, J. R. (1993) · Futures · doi:10.1016/0016-3287(93)90022-l · Cited by 4,639
Self-citationVerification, Validation, and Confirmation of Numerical Models in the Earth Sciences
Орескес, Н., Shrader‐Frechette, K., & Belitz, K. (1994) · Science · doi:10.1126/science.263.5147.641 · Cited by 3,026
Factorial Sampling Plans for Preliminary Computational Experiments
Morris, M. D. (1991) · Technometrics · doi:10.2307/1269043 · Cited by 2,648
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
McCulloch, A. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2005.358_16.x · Cited by 1,866
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2004) · Cited by 1,797
Uncertainty and Quality in Science for Policy
Funtowicz, S. O., & Ravetz, J. R. (1990) · doi:10.1007/978-94-009-0621-1 · Cited by 1,575
Self-citationSensitivity Analysis in Practice
Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2002) · Wiley eBooks · doi:10.1002/0470870958 · Cited by 526
On the Relative Importance of Input Factors in Mathematical Models
Saltelli, A., & Tarantola, S. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618447 · Cited by 448
Research works printed but not linked: 11
- Craye M., 2001, Milieu en gezondheid in Vlaanderen: naar en adequate dialoog tussen overheid, bevolking en wetenschap
- Van der Sluijs J. P., 1997, Anchoring amid uncertainty; On the management of uncertainties in risk assessment of anthropogenic climate change
- Van der Sluijs J. P. Risbey J. S. &Ravetz J. R.(in press).Uncertainty assessment of VOC emissions from paint in the Netherlands.Environmental Monitoring and Assessment.
- EEA, 2003, EMEP/CORINAIR Emission Inventory Guidebook
- Kloprogge P., 2005, A Method for the Analysis of Assumptions in Assessments Applied to Two Indicators in the Fifth Dutch Environmental Outlook
- Aelvoet W., 1998, Risico op gezondheidsschade bij kinderen van de Neerlandwijk te Wilrijk
- Schoeters G., 1998, Studie van gezondheidsaspecten en gezondheidsrisico's ten gevolge van milieuverontreiniging in de Neerlandwijk te Wilrijk
- Koppen G., 2001, Biomonitoringsonderzoek 50‐65j vrouwen en 21‐40j mannen: evaluatie van de relatie milieu‐gezondheid op basis van meting van biomerkers
- Staessen J., 2001, Koepeltekst biomonitoring bij adolescenten: een gevoelige nieuwe methode voor het inschatten van verontreiniging van het leefmilieu en geassocieerde gezondheidsrisico's
- Van de Graaf H., 2000, Beleid en Politiek
- Von Schomberg R., 1997, Argumentatie in de context van een wetenschappelijke controverse
Cited by
Sorted by citations
Items 401–426 of 426
Аккредитационный мониторинг программ высшего образования: показатели и методика их расчета
Zernov, V. A., Владимирович, Д. И., & Жидков, А. А. (2023) · Higher education today · doi:10.18137/rnu.het.23.01.p.010
Дебаты на занятиях по иностранному языку: формат и оценка
Титова, О. К., & Ерёменко, А. В. (2023) · Higher education today · doi:10.18137/rnu.het.23.01.p.056
Образовательные программы по психологии для вузов: проблемы и решения
Токтамысовна, Ш. Х., & Kassymova, G. (2023) · Higher education today · doi:10.18137/rnu.het.23.01.p.064
Влияние неопределенностей информационного пространства на состояние безопасности человека
Boyarov, E. N., Абрамова, С. В., & Stankevich, P. V. (2023) · Higher education today · doi:10.18137/rnu.het.23.01.p.002
Изучение взаимосвязи между чертами личности и тяжестью интернет - зависимости у взрослых
Судакова-Зотова, Ю. А. (2023) · Higher education today · doi:10.18137/rnu.het.23.01.p.108
Об исходных условиях разработки методики контроля и коррекции двигательных действий в гиревом спорте
Shul'gin, G., & Tambovskij, A. N. (2023) · Higher education today · doi:10.18137/rnu.het.23.01.p.123
Креативные индустрии моды как ориентир развития профессионально - педагогического образования
Тарасюк, О. В., Краюхина, О. Е., & Шмакова, Л. Е. (2023) · Higher education today · doi:10.18137/rnu.het.23.01.p.050
Data Quality Analysis as Part of Interpretation
Kölsch, D., & Giebeler, S. (2023) · LCA compendium · doi:10.1007/978-3-031-35727-5_3
Uncertainty, Risk and Decisions
Heijungs, R. (2024) · Springer eBooks · doi:10.1007/978-3-031-49317-1_8
Towards a Methodological Framework to Facilitate More Efficient Collaboration between FuturistsPreprint
McNelis, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4900259
Reid, K., Adão, A. C., Soszynski, A., Moore, P., Lomonico, S., Hurd, F., Bellquist, L. F., & Harford, W. J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5220251
Boone, I., der Stede, Y. V., Bollaerts, K., Vose, D., Daube, G., Aerts, M., & Mintiens, K. (2007) · International Conference on the Epidemiology and Control of Biological, Chemical and Physical Hazards in Pigs and Pork · doi:10.31274/safepork-180809-11
Systemic Risk Governance for Disaster Risk Management and Climate Change Adaptation
Schweizer, P.-J., Hofbauer, B., & Einhäupl, P. (2025) · Springer eBooks · doi:10.1007/978-3-032-07136-1_3 · Cited by 2
Making the Implicit Explicit: Documenting the Hidden Assumptions in Conceptual Models
Noorduijn, S. L., Peeters, L. J. M., Marshall, S. K., Jazayeri, A., & Batelaan, O. (2026) · Hydrological Processes · doi:10.1002/hyp.70485
Les controverses climatiques : une analyse socioépistémique
d’Apollonia, L. S. (2014) · doi:10.70675/2ba03342z183dz434cz8119zf5d957a5b302
Multi-Hazards Risk Aggregation Considering the Trustworthiness of the Risk Assessment
Bani-Mustafa, T. (2019) · theses.fr (ABES) · doi:10.70675/54626d48zba04z4ac5zb6fcze26902341f4b · Cited by 1
European climate change : co-development of local climate services and clustering approaches
Breton, F. (2021) · theses.fr (ABES) · doi:10.70675/ee9b0270z445fz4e62z9692zb61526440987
A framework to characterize the balance between risk science quality and usefulness
Thekdi, S., & Aven, T. (2026) · Journal of Risk Research · doi:10.1080/13669877.2026.2674655
Cappellari, D., Tonucci, R., Piccinini, L., Braidot, A., Cisotto, A., Libera, N. D., & Fabbri, P. (2026) · Groundwater for Sustainable Development · doi:10.1016/j.gsd.2026.101641
Liu, M., Hamilton, S. H., Jakeman, A. J., Robson, B., Zare, F., Lerat, J., & Croke, B. (2026) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2026.107108
Applying strength of knowledge schemes in practice: insights from risk professionals
Lorentzen-Styr, E., Bjørnsen, K., & Aven, T. (2026) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2026.113301
Taming the Leviathan - A New Approach to Risk for the Military LeaderPreprint
Bowen, C. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2182321
Hany, A., & Hossny, M. (2014)
Metadata
- Authors
- Van Der Sluijs, J. P., Craye, M., Funtowicz, S., Kloprogge, P., Ravetz, J., & Risbey, J.
- Affiliations
- Joint Research Centre (IT)
- Utrecht University (NL)
- European Commission (BE)
- Monash University (AU)
- Venue
- Risk Analysis
- Publisher
- Wiley
- Published
- 2005-04
- Volume
- 25
- Issue
- 2
- Pages
- 481-492
- ISSN
- 0272-4332 (ISSN-L)
- 1539-6924
- OpenAlex
- W2119214313
- Cited by
- 426
- References
- 19
- Citations by year
- 2026: 13 · 2025: 4 · 2024: 15 · 2023: 38 · 2022: 11 · 2021: 19 · 2020: 22 · 2019: 21 · 2018: 26 · 2017: 35 · 2016: 15 · 2015: 25 · 2014: 21 · 2013: 23 · 2012: 23
- FWCI
- 65.98
- Type
- journal article
- Language
- en
- Open access
- green
- dspace.library.uu.nl
- Licence
- Locations
- Risk Analysis (publishedVersion)
- PubMed (publishedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Environmental and Social Impact Assessments
- Physical Sciences › Engineering › Computational Mechanics › Probabilistic and Robust Engineering Design
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Keywords
- uncertainty analysis, multidimensional uncertainty, pedigree analysis, parameter sensitivity, model assumptions, diagnostic diagrams, problem framing, deliberative decision-making, collective learning, environmental assessment, model-based evaluation
- MeSH terms
- Vehicle Emissions, Computer Simulation, Environment, Environmental Monitoring, Environmental Pollutants, Models, Theoretical, Public Health, Software, Systems Theory, Models, Statistical, Risk Assessment, Uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review