Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions
Open accessThe DOI matches its Crossref record; 44 of the 46 references it cites were found in a registry or an index.
Abstract
It has been known for over 40 years that there are two fundamentally different kinds of detection tasks in the theory of signal detectability. The Type 1 task is to distinguish between events defined independently of the observer; the Type 2 task is to distinguish between one's own correct and incorrect decisions about those Type 1 events. For the Type 1 task, the behavior of the detector can be summarized by the traditional receiver operating characteristic (ROC) curve. This curve can be compared with a theoretical ROC curve, which can be generated from overlapping probability functions conditional on the Type 1 events on an appropriate decision axis. We show how to derive the probability functions underlying Type 2 decisions from those for the Type 1 task. ROC curves and the usual measures of performance are readily obtained from those Type 2 functions, and some relationships among various Type 1 and Type 2 performance measures are presented. We discuss the relationship between Type 1 and Type 2 confidence ratings and caution against the practice of presenting transformed Type 2 ratings as empirical Type 1 ratings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Specifically, given a particular type 1 variance structure and bias, the form of the type 2 ROC is completely determined (Galvin et al., 2003).”
From How to measure metacognition (2014) · cites this paper as Galvin et al., 2003
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Because such a family of type 2 ROC curves are all non-overlapping (Galvin et al., 2003), we can determine the curve from this family with just a single point, i.e., a single criterion.”
From How to measure metacognition (2014) · cites this paper as Galvin et al., 2003
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, type 2 d′ turns out to be problematic because SDT assumes that the distribution of internal signals for “correct” and “incorrect” trials are Gaussian with equal variances. While this assumption is usually more or less acceptable at the type 1 level (especially for 2-alternative forced-choice tasks), it is highly problematic for type 2 analysis.”
From How to measure metacognition (2014) · cites this paper as Galvin et al. (2003)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Galvin et al. (2003) showed that these distributions are of different variance and highly non-Gaussian if the equal variance assumption holds at the type 1 level.”
From How to measure metacognition (2014) · cites this paper as Galvin et al. (2003)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The recently developed meta-d′ measure (Maniscalco and Lau, 2012, 2014) exploits the fact that given Gaussian variance assumptions at the type 1 level, the shapes of the type 2 distributions are known even if they are not themselves Gaussian (Galvin et al., 2003).”
From How to measure metacognition (2014) · cites this paper as Galvin et al., 2003
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1966) · Medical Entomology and Zoology · Cited by 10,293
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Detection Theory: A User's Guide
Macmillan, N. A., & Creelman, C. D. (1991) · Cited by 5,415
An Introduction to the Theory of Statistics
(1911) · Nature · doi:10.1038/087345a0 · Cited by 4,394
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
Signal detection theory and ROC analysis
Egan, J. P. (1975) · Academic Press eBooks · Cited by 1,659
Probabilistic mental models: a Brunswikian theory of confidence
Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991) · Psychological Review · doi:10.1037/0033-295x.98.4.506 · Cited by 1,506
An Introduction to the Theory of Statistics
Dempster, A. P., & Plackett, R. L. (1973) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1402858 · Cited by 1,447
Decision Processes In Perception.
Swets, J. A., Tanner, W. P., Jr., & Birdsall, T. G. (1961) · Psychological Review · doi:10.1037/0033-295x.68.5.301 · Cited by 1,329
Introduction to the Theory of Statistics, 3rd ed.
Kass, G. V., Mood, A. M., Graybill, F. A., & Boes, D. C. (1974) · Journal of the American Statistical Association · doi:10.2307/2286195 · Cited by 975
Research works printed but not linked: 5
- Galvin, S. J. (1988). The theory of Type II ROC analysis. Unpublished master's thesis, Victoria University, Wellington, New Zealand.
- Galvin, S. J., Beuke, C. J., Keogh, D., & Robinson, T. (2000).Can utroc- ular discrimination be subliminal? Investigative Ophthalmology& Vi- sual Science, 41(Suppl.), S732.
- Macmillan, N. A., & Creelman, C. D. (1991). Detection theory: A user9s guide. Cambridge: Cambridge University Press.
- Podd, J. V. (1975). Type I and Type II ROC analysis of change in human decision axis. Unpublished master's thesis, Victoria University, Welling- ton, New Zealand.
- Weiskrantz, L. (1986). Blindsight: A case study and its implications. Oxford: Oxford University Press.
Cited by
Items 401–469 of 469
Otsuka, S., Miura, Y., & Saiki, J. (2023) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001275.supp
Self-associated stimuli do not show a metacognitive advantagePreprint
Lo, C. M., & Duncan, N. W. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/d267r
Meunier-Duperray, L., Souchay, C., Angel, L., Salmon, É., & Bastin, C. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/yekbw
Drevet, J. (2022) · theses.fr (ABES) · doi:10.70675/072159bdz23bdz4a13z91c8za1621e3bd7ef
A rodent paradigm for studying perceptual decisions under asymmetric reward
Zhu, X., & Erlich, J. C. (2025) · Neurons Behavior Data analysis and Theory · doi:10.51628/001c.129626
Soto, D., Lallier, M., Desender, K., & Elosegi, P. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/8u7b5_v1
WITHDRAWNPreprint
(2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/a5ykj_v1
Green, M. L., & Pratte, M. S. (2024) · Cognition · doi:10.1016/j.cognition.2025.106347
Confidence in Consciousness Science
Morales, J. (2025) · Journal of Consciousness Studies · doi:10.53765/20512201.32.11.206
KUSANAGI, K. (2018) · Institutional Repositories DataBase (IRDB) · doi:10.15027/45308
Lakhlifi, C., Lejeune, F., Rouault, M., Khamassi, M., & Rohaut, B. (2024) · Figshare · doi:10.6084/m9.figshare.26583951
Metacomprehension Accuracy of Health-Related Information
Chadwick, S. (2023) · Lancaster EPrints (Lancaster University) · doi:10.17635/lancaster/thesis/2213
A Quantum Approach to Human Decision Making
Waddup, O. J. (2022) · City Research Online (City University London)
Ceja, V. (2025) · eScholarship (California Digital Library)
Constructing the Self in Adolescence: Learning What We Like and What We're Like
Moses-Payne, M. E. (2024) · UCL Discovery (University College London)
Perjons, A. (2024) · DiVA (Linkoping University)
Bayesian Categorization in Touch
Gauder, K. A. (2024) · MacSphere (McMaster University) · doi:10.71548/8953
Low confidence for perceptual completion of partially occluded objects
Baykan, C., Mamassian, P., & Schütz, A. C. (2026) · Journal of Vision · doi:10.1167/jov.26.1.4
Fleur, D. S. (2026) · UvA-DARE (University of Amsterdam)
Visual confidence accurately tracks increasing internal noise with eccentricity in peripheral visionPreprint
Li, L., & Landy, M. S. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.28.702447
Metacognition in decision making: Exploring age-related changes in confidence
Overhoff, H. (2022) · Kölner Universitäts PublikationsServer (Universität zu Köln)
Neuroéconomie et instabilité des préférences
Abitbol, R. (2014) · theses.fr (ABES) · doi:10.70675/9bcf0b1dz9ab0z4925zbae9z6f7c32c4ac6c
On metacognition and the dynamics of selective attention
Recht, S. (2019) · theses.fr (ABES) · doi:10.70675/9091ccaez90a4z489fz8603z56a8a1538875
From neural coding to decision-making
Berlemont, K. (2020) · theses.fr (ABES) · doi:10.70675/98ad90cazb967z4ef3zb51az8213de1b171f
Martin-Gomez, F. J. (2023) · theses.fr (ABES) · doi:10.70675/8827e91ezc1e6z41b9zb5cezaad6817446ed
Rôle de la mémoire dans la métacognition : Utilisation des informations épisodiques et sémantiques
Devaluez, M. (2023) · theses.fr (ABES) · doi:10.70675/52ec55aaz3d81z4866zb4edzc46bbbd17e8a
Does visual frequency discrimination require attentional amplification?
Daniel, S., Andrillon, T., Tsuchiya, N., & van Boxtel, J. J. A. (2026) · Royal Society Open Science · doi:10.1098/rsos.251385
The Role of Metacognition in Occupational Pursuits : Evidence from Laboratory Experiments
Cavalan, Q. (2023) · theses.fr (ABES) · doi:10.70675/7fb86a89zd36fz4d73zae75zb74f435a571f
Sanchez, R. (2023) · theses.fr (ABES) · doi:10.70675/5502e145z7be0z4855za34bz425051aad5cb
The Memory Superiority Effect of Induced Insight in Semantic Versus Perceptual Levels
Zhang, Z., Zeng, Y., Yu, W., & Zheng, Z. (2026) · Journal of Intelligence · doi:10.3390/jintelligence14050084
A Bundle of Mysteries: Approaching Phenomenal Consciousness
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0002
Losing Your Religion: Ethics After Illusionism
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0010
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0001
Approaching the House of Mirrors: The Illusion Problem
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0005
Mapping the House of Mirrors: Introducing Meta-Cartesianism
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0006
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0004
The Science of Sirens: Illusionism and Consciousness Science
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0009
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.002.0006
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0008
Leaving the House of Mirrors: Solving the Illusion Problem
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0007
Coda: Consciousness, Illusion, and Reality
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0012
Illusionism About Phenomenal Consciousness
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0003
Shedding Our Cartesian Scales: Illusionism and Epistemology
Kammerer, F. (2026) · Oxford University Press eBooks · doi:10.1093/9780197840283.003.0011
Metacognition and consciousness
Peters, M. A. K. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-29258-3.00052-5
The many faces of confidence: sensitivity and meta-confidence in economic decision-making
Cavalan, Q. (2026) · Theory and Decision · doi:10.1007/s11238-026-10144-5
Building worlds of your own: the functional role of metacognitive bias in metacognition
Romanazzi, D., Pasini, A., Tarasi, L., & Romei, V. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1792782
Groh, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7072802
Sociolinguistic Context Constrains Bilingual Advantages in Metacognition
Polyanskaya, L., & Ordin, M. (2026) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.70350
Chen, J., Zhang, Q., Yin, Y., Turner, J. E., Luo, L., & Yang, C. (2026) · Journal of Intelligence · doi:10.3390/jintelligence14080178
Lee, R. (2026) · eScholarship (California Digital Library)
Ma, R., Feldman, M. J., Bonar, A. S., Frye, N. G., İmamoğlu, A., Giovanello, K. S., & Lindquist, K. A. (2026) · Affective Science · doi:10.1007/s42761-026-00409-1
Kim, Y.-H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7525142
Thinking Before Thinking: Scaling Agentic Inference Through Meta-ReasoningPreprint
Dahal, P., Bakhtin, A., Cohen, T., Chen, Z., Wu, C.-J., Fergus, R., Yih, S., Synnaeve, G., Salakhutdinov, R., Arora, S., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.38147
The role of visual feedback in metacognitive judgments of motor performance
Brun, L., Porte, P., Cottin, M., Guinet, É., Chalabaev, A., Palluel, E., Faivre, N., & Souchay, C. (2026) · Consciousness and Cognition · doi:10.1016/j.concog.2026.104138
McLeod-Edwards, E. (2024) · Otago University Research Archive (University of Otago)
Tang, Z., Dowsett, J., Taylor, P. H., Ferreiro, D. N., & Pecka, M. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.08.757585
Takada, K. (2026) · Institutional Repositories DataBase (IRDB) · doi:10.15102/0002001432
Metacognition: Using Confidence Ratings for Type 2 and Type 1 ROC Curves
Klein, S. A. (2015) · Purdue e-Pubs (Purdue University System)
Sensibilidade metacognitiva : mecanismos de monitorização e reversão de falsas memórias
Mendes, D. V. D. K. (2008) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Metadata
- Authors
- Galvin, S. J., Podd, J. V., Drga, V., & Whitmore, J.
- Affiliations
- University of Otago (NZ)
- Massey University (NZ)
- Victoria University of Wellington (NZ)
- Corresponding author
- Galvin, Susan J.
- ORCID
- Drga, Vit
- Venue
- Psychonomic Bulletin & Review
- Published
- 2003-12
- Volume
- 10
- Issue
- 4
- Pages
- 843-876
- ISSN
- 1069-9384 (ISSN-L)
- 1531-5320
- OpenAlex
- W1965187591
- Cited by
- 405
- References
- 46
- Citations by year
- 2026: 35 · 2025: 19 · 2024: 25 · 2023: 30 · 2022: 32 · 2021: 27 · 2020: 22 · 2019: 22 · 2018: 24 · 2017: 24 · 2016: 24 · 2015: 32 · 2014: 23 · 2013: 12 · 2012: 14
- FWCI
- 0.65
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Psychonomic Bulletin & Review (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- receiver operating characteristic, confidence ratings, decision errors, probability functions
- MeSH terms
- Cues, Decision Making, Discrimination Learning, Humans, Probability Learning, Problem Solving, ROC Curve, Models, Statistical, Observer Variation, Likelihood Functions, Signal Detection, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.