The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Visualizing Multiple Measures of Forecast Quality
Open accessAbstract
A method for visually representing multiple measures of dichotomous (yes–no) forecast quality (probability of detection, false alarm ratio, bias, and critical success index) in a single diagram is presented. Illustration of the method is provided using performance statistics from two previously published forecast verification studies (snowfall density and convective initiation) and a verification of several new forecast datasets: Storm Prediction Center forecasts of severe storms (nontornadic and tornadic), Hydrometeorological Prediction Center forecasts of heavy precipitation (greater than 12.5 mm in a 6-h period), National Weather Service Forecast Office terminal aviation forecasts (ceiling and visibility), and medium-range ensemble forecasts of 500-hPa height anomalies. The use of such verification metrics in concert with more detailed investigations to advance forecasting is briefly discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Summarizing multiple aspects of model performance in a single diagram
Taylor, K. E. (2001) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2000jd900719 · Cited by 8,477
Statistical Methods in the Atmospheric Sciences
Ramsey, P. H. (1996) · Technometrics · doi:10.1080/00401706.1996.10484553 · Cited by 7,601
Statistical Methods in the Atmospheric Sciences
Briggs, W. (. (2007) · Journal of the American Statistical Association · doi:10.1198/jasa.2007.s163 · Cited by 1,531
Forecast Verification: A Practitioner's Guide in Atmospheric Science
(2011) · Wiley eBooks · doi:10.1002/9781119960003 · Cited by 1,267
Statistical methods in the atmospheric sciences
Wilks, D. S. (2006) · Cited by 1,046
The Critical Success Index as an Indicator of Warning Skill
Schaefer, J. T. (1990) · Weather and Forecasting · doi:10.1175/1520-0434(1990)005<0570:tcsiaa>2.0.co;2 · Cited by 867
Human Judgment and Social Policy: Irreducible Uncertainty, Inevitable Error, Unavoidable Injustice
Hammond, K. R. (1996) · doi:10.1093/oso/9780195097344.001.0001 · Cited by 851
What Is a Good Forecast? An Essay on the Nature of Goodness in Weather Forecasting
Murphy, A. H. (1993) · Weather and Forecasting · doi:10.1175/1520-0434(1993)008<0281:wiagfa>2.0.co;2 · Cited by 833
A General Framework for Forecast Verification
Murphy, A. H., & Winkler, R. L. (1987) · Monthly Weather Review · doi:10.1175/1520-0493(1987)115<1330:agfffv>2.0.co;2 · Cited by 667
On Summary Measures of Skill in Rare Event Forecasting Based on Contingency Tables
Doswell, C. A., Davies-Jones, R., & Keller, D. L. (1990) · Weather and Forecasting · doi:10.1175/1520-0434(1990)005<0576:osmosi>2.0.co;2 · Cited by 477
Cited by
Wilks, D. S. (2011) · International Geophysics · doi:10.1016/b978-0-12-385022-5.00008-7 · Cited by 727
Tang, G., Clark, M. P., Papalexiou, S. M., Ma, Z., & Hong, Y. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111697 · Cited by 647
Using Artificial Intelligence to Improve Real-Time Decision-Making for High-Impact Weather
McGovern, A., Elmore, K. L., Gagne, D. J., Haupt, S. E., Karstens, C. D., Lagerquist, R., Smith, T., & Williams, J. K. (2017) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-16-0123.1 · Cited by 443
A review of operational, regional-scale, chemical weather forecasting models in Europe
Kukkonen, J., Olsson, T., Schultz, D. M., Baklanov, A., Klein, T., Miranda, A. I., Monteiro, A., Hirtl, M., Tarvainen, V., Boy, M., et al. (2012) · Atmospheric Chemistry and Physics · doi:10.5194/acp-12-1-2012 · Cited by 337
Zhang, L., Li, X., Zheng, D., Zhang, K., Ma, Q., Zhao, Y., & Ge, Y. (2021) · Journal of Hydrology · doi:10.1016/j.jhydrol.2021.125969 · Cited by 280
Metadata
- Authors
- Roebber, P. J.
- Venue
- Weather and Forecasting
- Publisher
- American Meteorological Society
- Published
- 2009-04-01
- Volume
- 24
- Issue
- 2
- Pages
- 601-608
- ISSN
- 0882-8156 (ISSN-L)
- 1520-0434
- OpenAlex
- W2030386161
- Cited by
- 574
- References
- 21
- FWCI
- 1.48
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Visualizing Multiple Measures of Forecast Quality. https://app.cochat.ai/papers/10.1175/2008waf2222159.1
- The paper
- Roebber, P. J. (2009). Visualizing Multiple Measures of Forecast Quality. Weather and Forecasting. https://doi.org/10.1175/2008waf2222159.1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.