CoChat

Scoring Rules and the Evaluation of Probability Assessors

Winkler, Robert L. · 1969 · Journal of the American Statistical Association

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

The personalistic theory of probability prescribes that personal probability assessments to be used in decision-making situations should correspond with the assessor's judgments. A payoff function which depends on the assessor's stated probabilities and on the event which actually occurs may be used (1) to keep the assessor honest or (2) to evaluate the assessor. It is shown that with the exception of a logarithmic payoff function, these two uses of payoff functions for assessors are not compatible. This conflict is explained in terms of the differences in the situations facing the assessor and the evaluator (the user of the probabilistic predictions).

Overview

Integrity signals

Registry

Crossref · 10.1080/01621459.1969.10501037

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 10 references

Research works printed but not linked: 4

  1. de Finetti Bruno, 1963, “The elicitation of personal probabilities,”
  2. Murphy Allan H., 1968, “The evaluation of probabilistic predictions in meteorology,”
  3. Roberts, Harry V. “On the meaning of the probability of rain,”. Proceedings of the First National Conference on Statistical Meteorology. pp.133–41. Boston: American Meteorological Society.
  4. Winkler, Robert L. and Murphy, Allan H. “Evaluation of subjective precipitation probability forecasts,”. Proceedings of the First National Conference on Statistical Meteorology. pp.148–57. Boston: American Meteorological Society.

Cited by

See all 271

Metadata

Authors
Winkler, R. L.
Affiliations
Indiana University (US)
Corresponding author
Winkler, Robert L.
Venue
Journal of the American Statistical Association
Published
1969-09
Volume
64
Issue
327
Pages
1073-1078
ISSN
  • 0162-1459 (ISSN-L)
  • 1537-274X
OpenAlex
W2002471330
Cited by
271
References
9
Citations by year
2026: 1 · 2025: 5 · 2024: 4 · 2023: 6 · 2022: 7 · 2021: 17 · 2020: 9 · 2019: 7 · 2018: 9 · 2017: 9 · 2016: 9 · 2015: 9 · 2014: 7 · 2013: 9 · 2012: 12
FWCI
11.06
Type
journal article
Language
en
Open access
closed
Locations
Journal of the American Statistical Association (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
  • Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
  • Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
Keywords
scoring rules, probability assessment, payoff functions, logarithmic scoring rule, decision making under uncertainty, probabilistic forecasting

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Scoring Rules and the Evaluation of Probability Assessors. https://app.cochat.ai/papers/10.1080/01621459.1969.10501037
The paper
Winkler, R. L. (1969). Scoring Rules and the Evaluation of Probability Assessors. Journal of the American Statistical Association. https://doi.org/10.1080/01621459.1969.10501037

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.