Weather Forecasting by Humans—Heuristics and Decision Making
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
The decision-making literature contains considerable information about how humans approach tasks involving uncertainty using heuristics. Although there is some reason to believe that weather forecasters are not identical in all respects to the typical subjects used in judgment and decision-making studies, there also is evidence that weather forecasters are not so different that the existing understanding of human cognition as it relates to making decisions is entirely inapplicable to weather forecasters. Accordingly, some aspects of cognition and decision making are reviewed and considered in terms of how they apply to human weather forecasters, including biases introduced by heuristics. Considerable insight into human forecasting could be gained by applying available studies of the cognitive psychology of decision making. What few studies exist that have used weather forecasters as subjects suggest that further work might well be productive in terms of helping to guide the improvement of weather forecasts by humans. It is concluded that a multidisciplinary approach, involving disciplines outside of meteorology, needs to be developed and supported if there is to be a future role for humans in forecasting the weather.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“AI's data-centric approach often clashes with human decision-making, which relies on personal understanding, logic, heuristics, and creativity [31, 36, 46, 110, 111].”
From Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making (2025) · cites this paper as [31]
In the citing paper
“data patterns may not match AI explanations precisely, and users often rely on subjective reasoning [31, 46].”
From Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making (2025) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On the psychology of prediction.
Kahneman, D., & Tversky, A. (1973) · Psychological Review · doi:10.1037/h0034747 · Cited by 6,202 · cited 1×
“Moreover, Kahneman and Tversky (1973) have shown that people (including forecasters) do not generally apply the quantitative methods of statistical analysis to make decisions, either.”
BackgroundCalibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
Stochastic representation of model uncertainties in the ECMWF ensemble prediction system
Buizza, R., Milleer, M., & Palmer, T. N. (1999) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712556006 · Cited by 1,103
Research works printed but not linked: 39
- Brooks, 2004, Tornado-warning performance in the past and the future: A perspective from signal detection theory., Bull. Amer. Meteor. Soc, 85, 837, 10.1175/BAMS-85-6-837 · doi:10.1175/bams-85-6-837
- Brooks, 1996, A comparison of measures-oriented and distributions-oriented approaches to forecast verification., Wea. Forecasting, 11, 288, 10.1175/1520-0434(1996)011<0288:ACOMOA>2.0.CO;2 · DOI
- Buizza, 1998, Impact of ensemble size on the skill and the potential skill of an ensemble prediction system., Mon. Wea. Rev, 126, 2503, 10.1175/1520-0493(1998)126<2503:IOESOE>2.0.CO;2 · DOI · Paper page
- Charba, 1980, Skill in precipitation forecasting in the National Weather Service., Bull. Amer. Meteor. Soc, 61, 1546, 10.1175/1520-0477(1980)061<1546:SIPFIT>2.0.CO;2 · DOI
- Doswell, 1986, Short range forecasting., 10.1007/978-1-935704-20-1_29 · doi:10.1007/978-1-935704-20-1_29
- Doswell, 1986, The human element in weather forecasting., Natl. Wea. Dig, 11, 6
- Doswell, 1996, A review of student performance on pretests given at the flash flood forecasting course.
- Doswell, 1990, On summary measures of skill in rare event forecasting based on contingency tables., Wea. Forecasting, 5, 576, 10.1175/1520-0434(1990)005<0576:OSMOSI>2.0.CO;2 · DOI · Paper page
- Doswell, 2002, Recognition of negative mesoscale factors for severe weather potential: A case study., Wea. Forecasting, 17, 937, 10.1175/1520-0434(2002)017<0937:RONMFF>2.0.CO;2 · doi:10.1175/1520-0434(2002)017<0937:ronmff>2.0.co;2
- Evans, 2001, Examination of derecho environments using proximity soundings., Wea. Forecasting, 16, 329, 10.1175/1520-0434(2001)016<0329:EODEUP>2.0.CO;2 · doi:10.1175/1520-0434(2001)016<0329:eodeup>2.0.co;2
- Fischhoff, 1982, For those condemned to study the past: Heuristics and biases in hindsight., 10.1017/CBO9780511809477.024 · DOI · Paper page
- Fischhoff, 1982, Debiasing., 10.1017/CBO9780511809477.032 · DOI · Paper page
- Hammond, 1996, Human Judgment and Social Policy., 10.1093/oso/9780195097344.001.0001 · DOI · Paper page
- Johns, 1992, Severe local storms forecasting., Wea. Forecasting, 7, 588, 10.1175/1520-0434(1992)007<0588:SLSF>2.0.CO;2 · DOI · Paper page
- Kahneman, 1972, Subjective probability: A judgment of representativeness., Cognit. Psychol, 3, 430, 10.1016/0010-0285(72)90016-3 · DOI · Paper page
- Kahneman, 1982, Judgment Under Uncertainty: Heuristics and Biases., 10.1017/CBO9780511809477 · DOI · Paper page
- Lorenz, 1963, Deterministic nonperiodic flow., J. Atmos. Sci, 20, 130, 10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2 · DOI · Paper page
- Lusk, 1990, Judgment and decision making in dynamic tasks: The case of forecasting the microburst., Wea. Forecasting, 5, 627, 10.1175/1520-0434(1990)005<0627:JADMID>2.0.CO;2 · doi:10.1175/1520-0434(1990)005<0627:jadmid>2.0.co;2
- Mason, 1982, A model for assessment of weather forecasts., Aust. Meteor. Mag, 30, 291
- Mass, 1991, Synoptic frontal analysis. Time for a reassessment?, Bull. Amer. Meteor. Soc, 72, 348, 10.1175/1520-0477(1991)072<0348:SFATFA>2.0.CO;2 · doi:10.1175/1520-0477(1991)072<0348:sfatfa>2.0.co;2
- Moller, 2001, Severe local storms forecasting., 10.1007/978-1-935704-06-5_11 · DOI
- Murphy, 1991, Probabilities, odds, and forecasting rare events., Wea. Forecasting, 6, 302, 10.1175/1520-0434(1991)006<0302:POAFOR>2.0.CO;2 · DOI
- Murphy, 1991, Forecast verification: Its complexity and dimensionality., Mon. Wea. Rev, 119, 1590, 10.1175/1520-0493(1991)119<1590:FVICAD>2.0.CO;2 · doi:10.1175/1520-0493(1991)119<1590:fvicad>2.0.co;2
- Murphy, 1993, What is a good forecast? An essay on the nature of goodness in weather forecasting., Wea. Forecasting, 8, 281, 10.1175/1520-0434(1993)008<0281:WIAGFA>2.0.CO;2 · DOI · Paper page
- Murphy, 1997, Forecast verification., 10.1017/CBO9780511608278.003 · DOI
- Murphy, 1977, Can weather forecasters formulate reliable probability forecasts of precipitation and temperature?, Natl. Wea. Dig, 2, 2
- Murphy, 1982, Subjective probabilistic tornado forecasts: Some experimental results., Mon. Wea. Rev, 110, 1288, 10.1175/1520-0493(1982)110<1288:SPTFSE>2.0.CO;2 · doi:10.1175/1520-0493(1982)110<1288:sptfse>2.0.co;2
- Murphy, 1987, A general framework for forecast verification., Mon. Wea. Rev, 115, 1330, 10.1175/1520-0493(1987)115<1330:AGFFFV>2.0.CO;2 · DOI · Paper page
- Oskamp, 1965, Overconfidence in case-study judgments., J. Consult. Psychol, 29, 261, 10.1037/h0022125 · DOI · Paper page
- Roebber, 1996, The contributions of education and experience to forecast skill., Wea. Forecasting, 11, 21, 10.1175/1520-0434(1996)011<0021:TCOEAE>2.0.CO;2 · doi:10.1175/1520-0434(1996)011<0021:tcoeae>2.0.co;2
- Rouse, 1986, On looking into the black box: Prospects and limits in the search for mental models., Psychol. Bull, 100, 349, 10.1037/0033-2909.100.3.349 · DOI · Paper page
- Sanders, 1963, On subjective probability forecasting., J. Appl. Meteor, 2, 191, 10.1175/1520-0450(1963)002<0191:OSPF>2.0.CO;2 · doi:10.1175/1520-0450(1963)002<0191:ospf>2.0.co;2
- Schwerdtfeger, 1981, Comments on Tor Bergeron's contributions to synoptic meteorology., Pure Appl. Geophys, 119, 501, 10.1007/BF00878155 · doi:10.1007/bf00878155
- Stensrud, 1999, Using ensembles for short-range forecasting., Mon. Wea. Rev, 127, 433, 10.1175/1520-0493(1999)127<0433:UEFSRF>2.0.CO;2 · DOI · Paper page
- Stewart, 2001, Improving reliability of judgmental forecasts., 10.1007/978-0-306-47630-3_5 · DOI
- Stewart, 1992, Effect of improved information on the components of skill in weather forecasting., Organiz. Behav. Hum. Decis. Proc, 53, 107, 10.1016/0749-5978(92)90058-F · DOI
- Stewart, 1997, The importance of the task in analyzing expert judgment., Organiz. Behav. Hum. Decis. Proc, 69, 205, 10.1006/obhd.1997.2682 · DOI · Paper page
- Uccellini, 1992, Report on the surface analysis workshop at the National Meteorological Center 25–28 March 1991., Bull. Amer. Meteor. Soc, 73, 459
- Vescio, 2001, Subjective tornado probability forecasts in severe weather watches., Wea. Forecasting, 16, 192, 10.1175/1520-0434(2001)016<0192:FSFSTP>2.0.CO;2 · doi:10.1175/1520-0434(2001)016<0192:fsfstp>2.0.co;2
Cited by
Visualizing Multiple Measures of Forecast Quality
Roebber, P. J. (2009) · Weather and Forecasting · doi:10.1175/2008waf2222159.1 · Cited by 574
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713423 · Cited by 48
“Most importantly, future designs should prioritize transparency in the AI updating mechanism to help users fully comprehend the principles governing AI updates and effectively manage their expectations.”
Metadata
- Authors
- Doswell, C. A.
- Affiliations
- CIMMS, University of Oklahoma, Norman, Oklahoma
- Venue
- Weather and Forecasting
- Publisher
- American Meteorological Society
- Published
- 2004-12-01
- Volume
- 19
- Issue
- 6
- Pages
- 1115-1126
- ISSN
- 1520-0434
- 0882-8156
- Cited by
- 66
- References
- 3
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.