A comparative evaluation of objective and subjective weather forecasts in the united states
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
This paper is concerned primarily with the evaluation and comparison of objective and subjective weather forecasts. Operational forecasts of three weather elements are considered: (1) probability forecasts of precipitation occurrence, (2) categorical (i.e. non‐probabilistic) forecasts of maximum and minimum temperatures and (3) categorical forecasts of cloud amount. The objective forecasts are prepared by numerical‐statistical procedures, whereas the subjective forecasts are based on the judgements of individual forecasters. In formulating the latter, the forecasters consult information from a variety of sources, including the objective forecasts themselves. The precipitation probability forecasts are found to be both reliable and skilful, and evaluation of the temperature/cloud amount forecasts reveals that they are quite accurate/skilful. Comparison of the objective and subjective forecasts of precipitation occurrence indicates that the latter are generally more skilful than the former for shorter lead times (e.g. 12–24 hours), whereas the two types of forecasts are of approximately equal skill for longer lead times (e.g. 36–48 hours). Similar results are obtained for the maximum and minimum temperature forecasts. Objective cloud amount forecasts are more skilful than subjective cloud amount forecasts for all lead times. Examination of trends in performance over the last decade reveals that both types of forecasts for all three elements increased in skill (or accuracy) over the period, with improvements in objective forecasts equalling or exceeding improvements in subjective forecasts. The role and impact of the objective forecasts in the subjective weather forecasting process are discussed in some detail. The need to conduct controlled experiments and other studies of this process, with particular reference to the assimilation of information from different sources, is emphasized. Important characteristics of the forecasting system in meteorology are identified, and they are used to describe similarities and differences between weather forecasting and forecasting in other fields. Acquisition of some of these characteristics may be beneficial to other forecasting systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
(1982) · doi:10.1017/cbo9780511809477 · Cited by 8,240
Verification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2 · cited 1×
“In the case of POP forecasts, accuracy generally is measured by the average Brier score (1JS) (Brier, 1950), a strictly proper quadratic scoring rule.”
Method
Cited by
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Tversky, A., & Kahneman, D. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.293 · Cited by 3,991
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T., Griffin, D., & Kahneman, D. (2004) · The Academy of Management Review · doi:10.2307/20159081 · Cited by 3,536
Representativeness revisited: Attribute substitution in intuitive judgment.
Kahneman, D., & Frederick, S. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.004 · Cited by 3,476
Norm theory: Comparing reality to its alternatives.
Kahneman, D., & Miller, D. T. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.136 · Cited by 3,024
Slovic, P., Finucane, M., Peters, E., & MacGregor, D. G. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.025 · Cited by 2,349
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298
Heuristics and Biases: The Psychology of Intuitive Judgment
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098 · Cited by 2,192
The weighing of evidence and the determinants of confidence
Griffin, D., & Tversky, A. (1992) · Cognitive Psychology · doi:10.1016/0010-0285(92)90013-r · Cited by 1,841
The Hot Hand in Basketball: On the Misperception of Random Sequences
Gilovich, T., Vallone, R., & Tversky, A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90010-6 · Cited by 1,649
Support theory: a nonextensional representation of subjective probability
Tversky, A., & Koehler, D. J. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.547 · Cited by 1,167
The use of statistical heuristics in everyday inductive reasoning.
Nisbett, R. E., Krantz, D. H., Jepson, C., & Kunda, Z. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.339 · Cited by 811
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.6.1082 · Cited by 758
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.020 · Cited by 678
Database Models and Managerial Intuition: 50% Model + 50% Manager
Blattberg, R. C., & Hoch, S. J. (1990) · Management Science · doi:10.1287/mnsc.36.8.887 · Cited by 472
Unpacking, repacking, and anchoring: Advances in support theory.
Rottenstreich, Y., & Tversky, A. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.406 · Cited by 425
Incorporating the Irrelevant: Anchors in Judgments of Belief and Value
Chapman, G. B., & Johnson, E. J. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.008 · Cited by 410
Sloman, S. A. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.024 · Cited by 395
Sherman, S. J., Cialdini, R. B., Schwartzman, D. F., & Reynolds, K. D. (1985) · Personality and Social Psychology Bulletin · doi:10.1177/0146167285111011 · Cited by 382
Assessing uncertainty in physical constants
Henrion, M., & Fischhoff, B. (1986) · American Journal of Physics · doi:10.1119/1.14447 · Cited by 316
Introduction – Heuristics and Biases: Then and Now
Gilovich, T., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.002 · Cited by 305
Probability Forecasting in Meteorology
Murphy, A. H., & Winkler, R. L. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478075 · Cited by 300
Self-citationJuslin, P., Olsson, N., & Winman, A. (1996) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.22.5.1304 · Cited by 293
Norm Theory: Comparing Reality to Its Alternatives
Kahneman, D., & Miller, D. T. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.022 · Cited by 289
Communicating Uncertainty in Weather Forecasts: A Survey of the U.S. Public
Morss, R. E., Demuth, J. L., & Lazo, J. K. (2008) · Weather and Forecasting · doi:10.1175/2008waf2007088.1 · Cited by 283
Intuitive evaluation of likelihood judgment producers: evidence for a confidence heuristic
Price, P. C., & Stone, E. R. (2004) · Journal of Behavioral Decision Making · doi:10.1002/bdm.460 · Cited by 272
Diagnostic verification of probability forecasts
Murphy, A. H., & Winkler, R. L. (1992) · International Journal of Forecasting · doi:10.1016/0169-2070(92)90028-8 · Cited by 279
Self-citationDifferences in Expert and Lay Judgments of Risk: Myth or Reality?
Rowe, G., & Wright, G. (2001) · Risk Analysis · doi:10.1111/0272-4332.212116 · Cited by 252
Mental Contamination and the Debiasing Problem
Wilson, T. D., Centerbar, D. B., & Brekke, N. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.012 · Cited by 160
The calibration of expert judgment: heuristics and biases beyond the laboratory
Koehler, D. J., Brenner, L., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.041 · Cited by 146
Metadata
- Authors
- Murphy, A. H., & Brown, B. G.
- Venue
- Journal of Forecasting
- Publisher
- Wiley
- Published
- 1984-10
- Volume
- 3
- Issue
- 4
- Pages
- 369-393
- ISSN
- 0277-6693 (ISSN-L)
- 1099-131X
- OpenAlex
- W1976853796
- Cited by
- 134
- References
- 3
- FWCI
- 4.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.