Measures of discrimination skill in probabilistic judgment.
Abstract
People's ability to assess probabilities of various events has been the topic of much interest in the areas of judgment, prediction, decision making, and memory. The evaluation of probabilistic judgments, however, raises interesting logical questions as to what it means to be agood judge. In this article, we focus on a normative concept of probabilistic accuracy that we call discrimination and present a measure of a judge's discrimination skill. This measure builds on an earlier index (Murphy, 1973) and has the advantages that (a) it can be interpreted as the percentage of variance accounted for by the judge and (b) it is unbiased. By way of deriving this new discrimination measure, we also show that it is related to Pearson's chi-square statistic, a result which may be useful in the future development of hypothesis testing and estimation procedures.
Cites (2)
- Calibration of probabilities: the state of the art to 1980Lichtenstein, Sarah, Fischhoff, Baruch, Phillips, Lawrence D. · 1982 · Judgment under Uncertainty
- Verification of forecasts expressed in terms of probabilityBRIER, GLENN W. · 1950 · Monthly Weather Review
Cited by (12)
- How to measure metacognitionFleming, Stephen M., Lau, Hakwan C. · 2014 · Frontiers in Human Neuroscience
- Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learningKoriat, Asher · 1997 · Journal of Experimental Psychology: General
- Monitoring and control processes in the strategic regulation of memory accuracy.Asher Koriat, Morris Goldsmith · 1996 · Psychological Review
- Individual differences in rational thought.Keith E. Stanovich, Richard F. West · 1998 · Journal of Experimental Psychology General
- Judgmental forecasting: A review of progress over the last 25yearsLawrence, Michael, Goodwin, Paul, O'Connor, Marcus, Önkal, Dilek · 2006 · International Journal of Forecasting
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measures of discrimination skill in probabilistic judgment. https://app.cochat.ai/papers/10.1037//0033-2909.110.3.611
- The paper
- Yaniv, I., Yates, J. F., & Smith, J. K. (1991). Measures of discrimination skill in probabilistic judgment. Psychological Bulletin. https://doi.org/10.1037//0033-2909.110.3.611
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.