Measures of discrimination skill in probabilistic judgment.

Yaniv, Ilan, Yates, J. Frank, Smith, J. Keith·1991·Psychological Bulletin

Abstract

People's ability to assess probabilities of various events has been the topic of much interest in the areas of judgment, prediction, decision making, and memory. The evaluation of probabilistic judgments, however, raises interesting logical questions as to what it means to be agood judge. In this article, we focus on a normative concept of probabilistic accuracy that we call discrimination and present a measure of a judge's discrimination skill. This measure builds on an earlier index (Murphy, 1973) and has the advantages that (a) it can be interpreted as the percentage of variance accounted for by the judge and (b) it is unbiased. By way of deriving this new discrimination measure, we also show that it is related to Pearson's chi-square statistic, a result which may be useful in the future development of hypothesis testing and estimation procedures.

Cites (2)

  1. Calibration of probabilities: the state of the art to 1980
    Lichtenstein, Sarah, Fischhoff, Baruch, Phillips, Lawrence D. · 1982 · Judgment under Uncertainty
  2. Verification of forecasts expressed in terms of probability
    BRIER, GLENN W. · 1950 · Monthly Weather Review

Show all 2 references

Cited by (12)

  1. How to measure metacognition
    Fleming, Stephen M., Lau, Hakwan C. · 2014 · Frontiers in Human Neuroscience
  2. Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning
    Koriat, Asher · 1997 · Journal of Experimental Psychology: General
  3. Monitoring and control processes in the strategic regulation of memory accuracy.
    Asher Koriat, Morris Goldsmith · 1996 · Psychological Review
  4. Individual differences in rational thought.
    Keith E. Stanovich, Richard F. West · 1998 · Journal of Experimental Psychology General
  5. Judgmental forecasting: A review of progress over the last 25years
    Lawrence, Michael, Goodwin, Paul, O'Connor, Marcus, Önkal, Dilek · 2006 · International Journal of Forecasting

See all 178

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Measures of discrimination skill in probabilistic judgment. https://app.cochat.ai/papers/10.1037//0033-2909.110.3.611
The paper
Yaniv, I., Yates, J. F., & Smith, J. K. (1991). Measures of discrimination skill in probabilistic judgment. Psychological Bulletin. https://doi.org/10.1037//0033-2909.110.3.611

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.