Testing models of decision making using confidence ratings in classification.
Abstract
Classification implies decision making (or response selection) of some kind. Studying the decision process using a traditional signal detection theory analysis is difficult for two reasons: (a) The model makes a strong assumption about the encoding process (normal noise), and (b) the two most popular decision models, optimal and distance-from-criterion models, can mimic each other's predictions about performance level. In this article, the authors show that by analyzing certain distributional properties of confidence ratings, a researcher can determine whether the decision process is optimal, without knowing the form of the encoding distributions. Empirical results are reported for three types of experiments: recognition memory, perceptual discrimination, and perceptual categorization. In each case, the data strongly favored the distance-from-criterion model over the optimal model.
Cited by (9)
- A neuropsychological theory of multiple systems in category learning.Ashby, F. Gregory, Alfonso-Reese, Leola A., Turken, And U., Waldron, Elliott M. · 1998 · Psychological Review
- Remember-Know: A Matter of Confidence.Dunn, John C. · 2004 · Psychological Review
- Choice Certainty Is Informed by Both Evidence and Decision TimeKiani, Roozbeh, Corthell, Leah, Shadlen, Michael N. · 2014 · Neuron
- Familiarity breeds differentiation: A subjective-likelihood approach to the effects of experience in recognition memory.McClelland, James L., Chappell, Mark · 1998 · Psychological Review
- The Confidence DatabaseRahnev, Dobromir, Desender, Kobe, Lee, Alan L. F., Adler, William T., Aguilar-Lleyda, David, Akdoğan, Başak, Arbuzova, Polina, Atlas, Lauren Y., Balcı, Fuat, Bang, Ji Won et al. · 2020 · Nature Human Behaviour
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Testing models of decision making using confidence ratings in classification. https://app.cochat.ai/papers/10.1037//0096-1523.22.3.615
- The paper
- Balakrishnan, J. D., & Ratcliff, R. (1996). Testing models of decision making using confidence ratings in classification. Journal of Experimental Psychology: Human Perception and Performance. https://doi.org/10.1037//0096-1523.22.3.615
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.