Uncertainty forecasts improve weather-related decisions and attenuate the effects of forecast error.
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Although uncertainty is inherent in weather forecasts, explicit numeric uncertainty estimates are rarely included in public forecasts for fear that they will be misunderstood. Of particular concern are situations in which precautionary action is required at low probabilities, often the case with severe events. At present, a categorical weather warning system is used. The work reported here tested the relative benefits of several forecast formats, comparing decisions made with and without uncertainty forecasts. In three experiments, participants assumed the role of a manager of a road maintenance company in charge of deciding whether to pay to salt the roads and avoid a potential penalty associated with icy conditions. Participants used overnight low temperature forecasts accompanied in some conditions by uncertainty estimates and in others by decision advice comparable to categorical warnings. Results suggested that uncertainty information improved decision quality overall and increased trust in the forecast. Participants with uncertainty forecasts took appropriate precautionary action and withheld unnecessary action more often than did participants using deterministic forecasts. When error in the forecast increased, participants with conventional forecasts were reluctant to act. However, this effect was attenuated by uncertainty forecasts. Providing categorical decision advice alone did not improve decisions. However, combining decision advice with uncertainty estimates resulted in the best performance overall. The results reported here have important implications for the development of forecast formats to increase compliance with severe weather warnings as well as other domains in which one must act in the face of uncertainty.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in prospect theory: Cumulative representation of uncertainty
Tversky, A., & Kahneman, D. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122574 · Cited by 15,467 · cited 1×
“…of the relevant information is provided to the participant, this error, referred to as “risk seeking,” and the opposite “risk averse” error, preferring a sure option to a risky option with equal or greater expected value, can be explained by cumulative prospect theory (Tversky & Kahneman, 1992).”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“However, other evidence from a number of domains suggests that false alarms lead to distrust (Gupta, Bisantz, & Singh, 2001; Kahn & Luce, 2003), ignoring future alarms (Lees & Lee, 2007; Parasuraman & Riley, 1997; Nohre, 2001), and delayed response to alarms (Kerstholt, 1995).”
BackgroundWeather Forecasting with Ensemble Methods
Gneiting, T., & Raftery, A. E. (2005) · Science · doi:10.1126/science.1115255 · Cited by 636
Budescu, D. V., Broomell, S., & Por, H.-H. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02284.x · Cited by 402 · cited 1×
“Residents often regard evacuation as costly (Blendon, 2008; Cutter & Smith, 2009), fitting the profile of choices that elicit such errors.”
BackgroundUncertainty Forecasts Improve Decision Making Among Nonexperts
Nadav-Greenberg, L., & Joslyn, S. L. (2009) · Journal of Cognitive Engineering and Decision Making · doi:10.1518/155534309x474460 · Cited by 87 · cited 3×
“In one study (Nadav-Greenberg & Joslyn, 2009), participants used weather forecasts to make decisions about treating the roads to prevent icing.”
BackgroundResultInfluentialSelf-citation
Cited by
Communicating uncertainty about facts, numbers and science
van der Bles, A. M., van der Linden, S., Freeman, A. L. J., Mitchell, J., Galvao, A. B., Zaval, L., & Spiegelhalter, D. J. (2019) · Royal Society Open Science · doi:10.1098/rsos.181870 · Cited by 456
The Science of Visual Data Communication: What Works
Franconeri, S. L., Padilla, L. M., Shah, P., Zacks, J. M., & Hullman, J. (2021) · Psychological Science in the Public Interest · doi:10.1177/15291006211051956 · Cited by 360
Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making
Fernandes, M., Walls, L., Munson, S., Hullman, J., & Kay, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173718 · Cited by 175
In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation
Hullman, J., Qiao, X., Correll, M., Kale, A., & Kay, M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864889 · Cited by 187
Hypothetical Outcome Plots Help Untrained Observers Judge Trends in Ambiguous Data
Kale, A., Nguyen, F., Kay, M., & Hullman, J. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864909 · Cited by 122
Metadata
- Authors
- Joslyn, S. L., & LeClerc, J. E.
- Venue
- Journal of Experimental Psychology: Applied
- Published
- 2012
- Volume
- 18
- Issue
- 1
- Pages
- 126-140
- ISSN
- 1076-898X (ISSN-L)
- 1939-2192
- OpenAlex
- W2161506256
- Cited by
- 180
- References
- 5
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.