Uncertainty Forecasts Improve Decision Making Among Nonexperts
The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.
Abstract
The objective of this research was to evaluate the impact of weather uncertainty information on decision making in naturalistic settings. Traditional research often reveals deficits in human decision making under uncertainty as compared with normative models of rational choice. However, little research has addressed the question of whether people in naturalistic settings make better decisions when they have uncertainty information as compared with when they have only a deterministic forecast. Two studies investigated the effect of several types of weather uncertainty information on the quality of decisions to protect roads against icing and on temperature predictions and compared them with a control condition that provided deterministic forecast only. Experiment 1 was a Web-based questionnaire that included a single trial. Experiment 2, conducted in lab, included 120 trials and provided outcome feedback and a reward based on performance. Both studies indicated enhanced performance with uncertainty information. The best kind of uncertainty information tested here was the one that provided the probability at the threshold for the task at hand. We conclude that uncertainty information can be used advantageously, even when it does not result in perfectly rational performance, and that uncertainty can be communicated effectively to nonexpert end users, resulting in improved decision making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474 · cited 5×
“Moreover, most traditional research on decision making (e.g., Kahneman & Tversky, 1973, 1979) has been preoccupied with comparing human decision making under uncertainty with normative models of decision making under uncertainty.”
BackgroundResultInfluentialTversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810 · cited 1×
“This may well be evidence of an anchoring effect, in which estimates are affected by previously considered standards (Nadav-Greenberg, 224 Journal of Cognitive Engineering and Decision Making / Fall 2009 Joslyn, & Taing, 2008; Tversky & Kahneman, 1974).”
ResultJudgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Kahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544 · cited 2×
“Risk seeking is often observed in decisions such as these, in which one must choose between a sure cost ($1,000 to salt) and the risk of a loss (Kahneman & Tversky, 1984).”
BackgroundResultOn the psychology of prediction.
Kahneman, D., & Tversky, A. (1973) · Psychological Review · doi:10.1037/h0034747 · Cited by 6,202 · cited 4×
“Moreover, most traditional research on decision making (e.g., Kahneman & Tversky, 1973, 1979) has been preoccupied with comparing human decision making under uncertainty with normative models of decision making under uncertainty.”
BackgroundResultInfluentialKahneman, D., & Tversky, A. (2013) · World Scientific Handbook in Financial Economics Series · doi:10.1142/9789814417358_0016 · Cited by 5,320
Deciding advantageously before knowing the advantageous strategy
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997) · Science · doi:10.1126/science.275.5304.1293 · Cited by 3,547
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T., Griffin, D., & Kahneman, D. (2004) · The Academy of Management Review · doi:10.2307/20159081 · Cited by 3,536
Exposition of a New Theory on the Measurement of Risk
Bernoulli, D. (1954) · Econometrica · doi:10.2307/1909829 · Cited by 2,736 · cited 3×
“Because the cost of treating the roads was $1,000 and the penalty for failing to treat them when freezing temperatures occurred was $6,000, the correct decision from the perspective of expected value theory (Bernoulli, 1954) is to treat the roads whenever the probability of freezing (PoF) is greater than 16.”
BackgroundInfluential
Research works printed but not linked: 6
- 10.1175/1520-0477(1995)076 · doi:10.1175/1520-0477(1995)076
- 10.1037/0033-295x.102.4.684 · doi:10.1037/0033-295x.102.4.684 · Paper page
- National Research Council., 2006, Completing the forecast: Characterizing and communicating uncertainty for better decisions using weather and climate forecasts.
- 10.1175/1520-0477(1997)078 · doi:10.1175/1520-0477(1997)078
- 10.1037/0033-2909.115.2.228 · doi:10.1037/0033-2909.115.2.228 · Paper page
- 10.1037/0278-7393.25.6.1514 · doi:10.1037/0278-7393.25.6.1514 · Paper page
Cited by
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757
“Second, displaying uncertainty in predictions can help users can make more optimal decisions [19, 22, 25, 37, 60].”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
“Second, displaying uncertainty in predictions can help users can make more optimal decisions [19, 22, 25, 37, 60].”
BackgroundUncertainty forecasts improve weather-related decisions and attenuate the effects of forecast error.
Joslyn, S. L., & LeClerc, J. E. (2012) · Journal of Experimental Psychology: Applied · doi:10.1037/a0025185 · Cited by 180
“In one study (Nadav-Greenberg & Joslyn, 2009), participants used weather forecasts to make decisions about treating the roads to prevent icing.”
BackgroundResultInfluentialSelf-citationThe Cry Wolf Effect and Weather‐Related Decision Making
LeClerc, J., & Joslyn, S. (2015) · Risk Analysis · doi:10.1111/risa.12336 · Cited by 170
Self-citationIn Pursuit of Error: A Survey of Uncertainty Visualization Evaluation
Hullman, J., Qiao, X., Correll, M., Kale, A., & Kay, M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864889 · Cited by 187
“More sophisticated strategies for explaining uncertainty visualization including analyzing results for evidence of heuristic use [11, 12, 40, 70] or prospect theory [47, 48, 68].”
BackgroundInfluential
Metadata
- Authors
- Nadav-Greenberg, L., & Joslyn, S. L.
- Affiliations
- University of Washington
- University of Washington (US)
- Corresponding author
- Joslyn, Susan L.
- ORCID
- Joslyn, Susan L.
- Venue
- Journal of Cognitive Engineering and Decision Making
- Publisher
- SAGE Publications
- Published
- 2009-09
- Volume
- 3
- Issue
- 3
- Pages
- 209-227
- ISSN
- 1555-3434 (ISSN-L)
- OpenAlex
- W2071536232
- Cited by
- 87
- References
- 43
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 4 · 2023: 14 · 2022: 8 · 2021: 7 · 2020: 2 · 2019: 4 · 2018: 8 · 2017: 5 · 2016: 5 · 2015: 4 · 2014: 6 · 2013: 3 · 2012: 3
- FWCI
- 1.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Cognitive Engineering and Decision Making (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Decision Sciences › Management Science and Operations Research › Leadership, Behavior, and Decision-Making Studies
- Keywords
- uncertainty information, weather forecasting, decision making under uncertainty, temperature prediction, probabilistic forecasting, deterministic forecasts, reward, uncertainty communication, naturalistic settings
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Uncertainty Forecasts Improve Decision Making Among Nonexperts. https://app.cochat.ai/papers/10.1518/155534309x474460
- The paper
- Nadav-Greenberg, L., & Joslyn, S. L. (2009). Uncertainty Forecasts Improve Decision Making Among Nonexperts. Journal of Cognitive Engineering and Decision Making. https://doi.org/10.1518/155534309x474460
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.