The DOI matches its Crossref record.
Some Limitations of Qualitative Risk Rating Systems
Abstract
Qualitative systems for rating animal antimicrobial risks using ordered categorical labels such as “high,”“medium,” and “low” can potentially simplify risk assessment input requirements used to inform risk management decisions. But do they improve decisions? This article compares the results of qualitative and quantitative risk assessment systems and establishes some theoretical limitations on the extent to which they are compatible. In general, qualitative risk rating systems satisfying conditions found in real‐world rating systems and guidance documents and proposed as reasonable make two types of errors: (1) Reversed rankings, i.e., assigning higher qualitative risk ratings to situations that have lower quantitative risks; and (2) Uninformative ratings, e.g., frequently assigning the most severe qualitative risk label (such as “high”) to situations with arbitrarily small quantitative risks and assigning the same ratings to risks that differ by many orders of magnitude. Therefore, despite their appealing consensus‐building properties, flexibility, and appearance of thoughtful process in input requirements, qualitative rating systems as currently proposed often do not provide sufficient information to discriminate accurately between quantitatively small and quantitatively large risks. The value of information (VOI) that they provide for improving risk management decisions can be zero if most risks are small but a few are large, since qualitative ratings may then be unable to confidently distinguish the large risks from the small. These limitations suggest that it is important to continue to develop and apply practical quantitative risk assessment methods, since qualitative ones are often unreliable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
What's Wrong with Risk Matrices?
Anthony (Tony)Cox, L. (2008) · Risk Analysis · doi:10.1111/j.1539-6924.2008.01030.x · Cited by 704
Improving risk matrices: the advantages of logarithmically scaled axes
Levine, E. S. (2012) · Journal of Risk Research · doi:10.1080/13669877.2011.634514 · Cited by 100
Acebes, F., González-Varona, J. M., López-Paredes, A., & Pajares, J. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03180-5 · Cited by 74
Problems with Risk Matrices Using Ordinal Scales
Krisper, M. (2021) · arXiv · doi:10.48550/arxiv.2103.05440 · Cited by 26
Metadata
- Authors
- Cox, L. A. (., Babayev, D., & Huber, W.
- Venue
- Risk Analysis
- Publisher
- Wiley
- Published
- 2005-06
- Volume
- 25
- Issue
- 3
- Pages
- 651-662
- ISSN
- 0272-4332 (ISSN-L)
- 1539-6924
- OpenAlex
- W1964834584
- Cited by
- 192
- References
- 0
- FWCI
- 18.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Some Limitations of Qualitative Risk Rating Systems. https://app.cochat.ai/papers/10.1111/j.1539-6924.2005.00615.x
- The paper
- Cox, L. A. (., Babayev, D., & Huber, W. (2005). Some Limitations of Qualitative Risk Rating Systems. Risk Analysis. https://doi.org/10.1111/j.1539-6924.2005.00615.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.