The DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
Measures of metacognition on signal-detection theoretic models
Open accessAbstract
Analyzing metacognition, specifically knowledge of accuracy of internal perceptual, memorial, or other knowledge states, is vital for many strands of psychology, including determining the accuracy of feelings of knowing and discriminating conscious from unconscious cognition. Quantifying metacognitive sensitivity is however more challenging than quantifying basic stimulus sensitivity. Under popular signal-detection theory (SDT) models for stimulus classification tasks, approaches based on Type II receiver-operating characteristic (ROC) curves or Type II d-prime risk confounding metacognition with response biases in either the Type I (classification) or Type II (metacognitive) tasks. A new approach introduces meta-d': The Type I d-prime that would have led to the observed Type II data had the subject used all the Type I information. Here, we (a) further establish the inconsistency of the Type II d-prime and ROC approaches with new explicit analyses of the standard SDT model and (b) analyze, for the first time, the behavior of meta-d' under nontrivial scenarios, such as when metacognitive judgments utilize enhanced or degraded versions of the Type I evidence. Analytically, meta-d' values typically reflect the underlying model well and are stable under changes in decision criteria; however, in relatively extreme cases, meta-d' can become unstable. We explore bias and variance of in-sample measurements of meta-d' and supply MATLAB code for estimation in general cases. Our results support meta-d' as a useful measure of metacognition and provide rigorous methodology for its application. Our recommendations are useful for any researchers interested in assessing metacognitive accuracy.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 2×
“An important future challenge lies in integrating SDT with the increasingly influential framework of 'predictive coding' or the so-called 'Bayesian Brain' hypothesis (Rao & Ballard, 1999; Bubic, Cramon, & Schubotz, 2010; Friston, 2010; Clark, in press).”
BackgroundWhatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“An important future challenge lies in integrating SDT with the increasingly influential framework of 'predictive coding' or the so-called 'Bayesian Brain' hypothesis (Rao & Ballard, 1999; Bubic, Cramon, & Schubotz, 2010; Friston, 2010; Clark, in press).”
BackgroundApproximate is Better than “Exact” for Interval Estimation of Binomial Proportions
Agresti, A., & Coull, B. A. (1998) · The American Statistician · doi:10.1080/00031305.1998.10480550 · Cited by 3,223 · cited 1×
“6 Such a prior, though vague, adds some information and can increase the accuracy of estimates when data are limited (Agresti & Coull, 1998; Greenland, 2006).”
BackgroundPragmatics of measuring recognition memory: Applications to dementia and amnesia.
Snodgrass, J. G., & Corwin, J. (1988) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.117.1.34 · Cited by 3,089 · cited 1×
“An alternative way of dealing with outlying subjects is to add 0.5, i.e. a 'flattening constant', to every data cell for every subject (Snodgrass & Corwin, 1988).”
BackgroundInfluentialDetection theory: A user's guide
Lories, G. (1993) · Behavioural Processes · doi:10.1016/0376-6357(93)90083-4 · Cited by 2,835
A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
Kass, R. E., & Wasserman, L. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476592 · Cited by 1,253 · cited 1×
“…one observation for each of the hit and false alarm rates and corresponding miss and correct rejection rates, i.e. it is a unit information prior (Kass & Wasserman, 1995), corresponding to the belief that with approximately 95% probability all of the hit and false alarm rates lie between 0.05…”
BackgroundInfluentialRosenthal, D. M. (2005) · doi:10.1093/oso/9780198236979.001.0001 · Cited by 993
A comparison of current measures of the accuracy of feeling-of-knowing predictions
Nelson, T. O. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.109 · Cited by 976
Approximate Is Better than "Exact" for Interval Estimation of Binomial Proportions
Agresti, A., & Coull, B. A. (1998) · The American Statistician · doi:10.2307/2685469 · Cited by 972
Cited by
Knowing your own heart: Distinguishing interoceptive accuracy from interoceptive awareness
Garfinkel, S. N., Seth, A. K., Barrett, A. B., Suzuki, K., & Critchley, H. D. (2015) · Biological Psychology · doi:10.1016/j.biopsycho.2014.11.004 · Cited by 1,624
“…of the degree to which accuracy of (objective) heartbeat detection is predicted by subjective confidence in the task judgement, e.g. using area under an ROC curve (Barrett et al., 2013; Fleming, Weil, Nagy, Dolan, & Rees, 2010; Galvin, Podd, Drga, & Whitmore, 2003; Garfinkel & Critchley, 2013).”
Self-citationFleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
“Barrett et al. (2013) have conducted extensive normative tests of meta-d′, finding that it is robust to changes in bias and that it recovers simulated changes in metacognitive sensitivity (see also Maniscalco and Lau, 2014).”
BackgroundSelf-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
“Suboptimal or hypo-metacognitive sensitivity re-sults in values of meta-d = / d = (cid:5) 1 (Barrett, Dienes, & Seth, 2013; Maniscalco & Lau, 2014).”
Domain-specific impairment in metacognitive accuracy following anterior prefrontal lesions
Fleming, S. M., Ryu, J., Golfinos, J. G., & Blackmon, K. E. (2014) · Brain · doi:10.1093/brain/awu221 · Cited by 312
“Using this ratio as a measure of metacognitive accuracy effectively eliminates performance and response bias confounds typically affecting other measures (Barrett et al., 2013).”
BackgroundHMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings
Fleming, S. M. (2017) · Neuroscience of Consciousness · doi:10.1093/nc/nix007 · Cited by 309
“The properties of the meta -d’ model have been thoroughly explored in previous articles (Maniscalco and Lau 2012; Barrett et al. 2013; Fleming and Lau 2014;Maniscalco and Lau 2014).”
MethodConsciousness in humans and non-human animals: recent advances and future directions
Boly, M., Seth, A. K., Wilke, M., Ingmundson, P., Baars, B., Laureys, S., Edelman, D. B., & Tsuchiya, N. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00625 · Cited by 291
“Studies taking this approach have benefited from the application of “signal detection theory” (SDT), which provides robust methods for distinguishing objective performance from subjective performance (Maniscalco and Lau, 2012; Barrett et al., 2013), independently of response biases.”
BackgroundMethodSelf-citationDomain-general enhancements of metacognitive ability through adaptive training.
Carpenter, J., Sherman, M. T., Kievit, R. A., Seth, A. K., Lau, H., & Fleming, S. M. (2019) · Journal of Experimental Psychology: General · doi:10.1037/xge0000505 · Cited by 174
“Using this ratio as a measure of metacognition effectively eliminates performance and response bias confounds typically affecting other measures (Barrett et al., 2013; Fleming & Lau, 2014).”
BackgroundSelf-citationPredictive processing as a systematic basis for identifying the neural correlates of consciousness
Hohwy, J., & Seth, A. (2020) · Philosophy and the Mind Sciences · doi:10.33735/phimisci.2020.ii.64 · Cited by 170
Self-citationNorman, E., Pfuhl, G., Sæle, R. G., Svartdal, F., Låg, T., & Dahl, T. I. (2019) · Review of General Psychology · doi:10.1177/1089268019883821 · Cited by 193
The methodological puzzle of phenomenal consciousness
Phillips, I. B. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0347 · Cited by 162
Mamassian, P. (2016) · Annual Review of Vision Science · doi:10.1146/annurev-vision-111815-114630 · Cited by 165
“A similar issue arises if one is tempted to compute a Type 2 d ′ (Barrett et al. 2013).”
BackgroundConfidence controls perceptual evidence accumulation
Balsdon, T., Wyart, V., & Mamassian, P. (2020) · Nature Communications · doi:10.1038/s41467-020-15561-w · Cited by 137
Domain-specific enhancement of metacognitive ability following meditation training.
Baird, B., Mrazek, M. D., Phillips, D. T., & Schooler, J. W. (2014) · Journal of Experimental Psychology General · doi:10.1037/a0036882 · Cited by 163
Behavioral, Modeling, and Electrophysiological Evidence for Supramodality in Human Metacognition
Faivre, N., Filevich, E., Solovey, G., Kühn, S., & Blanke, O. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0322-17.2017 · Cited by 129
“…estimates. some progress has been made regarding the statistical analysis of confidence judgments (Galvin et al., 2003; Maniscalco and Lau, 2012; Barrett et al., 2013) and more evidence has been gathered regarding the brain areas involved in metacognitive monitoring (Grimaldi et al., 2015), the…”
BackgroundMurayama, K., Sakaki, M., Yan, V. X., & Smith, G. M. (2014) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0036914 · Cited by 74
Consciousness: The last 50 years (and the next)
Seth, A. K. (2018) · Brain and Neuroscience Advances · doi:10.1177/2398212818816019 · Cited by 147
“At the same time, advances in analysis methods like signal detection theory (Green and Swets, 1966) are enabling researchers to draw more rigorous distinctions between objective and subjective aspects of perception, as well as to quantify individual differences in metacognition (cognition about cognition) that may be…”
BackgroundSelf-citationTuning alpha rhythms to shape conscious visual perception
Gregorio, F. D., Trajkovic, J., Roperti, C., Marcantoni, E., Luzio, P. D., Avenanti, A., Thut, G., & Romei, V. (2022) · Current Biology · doi:10.1016/j.cub.2022.01.003 · Cited by 138
“In this way, meta-d ’ estimates, for instance, the relative likelihood to report a high confidence rating after a correct response 29,90 .”
BackgroundMethodInfluentialSources of Metacognitive Inefficiency
Shekhar, M., & Rahnev, D. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.10.007 · Cited by 137
How Bayesian statistics are needed to determine whether mental states are unconscious
Dienes, Z. P. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199688890.003.0012 · Cited by 111
“Indeed, meta-d’ has better properties than type 2 d’ in practice for large numbers of trials, including insensitivity to type 1 and 2 bias (Barrett et al. 2013) (though it may be better to use type 2 d’ than meta-d’ if the number of trials per participant is less than 50 and response bias is small; Sherman et al.”
InfluentialSelf-citationThe nature of metacognitive inefficiency in perceptual decision making.
Shekhar, M., & Rahnev, D. (2020) · Psychological Review · doi:10.1037/rev0000249 · Cited by 137
The impact of evidence reliability on sensitivity and bias in decision confidence.
Boldt, A., de Gardelle, V., & Yeung, N. (2017) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000404 · Cited by 110
Behavioral Methods in Consciousness Research
Overgaard, M. S. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199688890.001.0001 · Cited by 123
“Meta-d' (Maniscalco & Lau 2012) and meta-d’ balance (written here as meta-d'b; Barrett et al. 2013) are currently the gold standard in measures of metacognition.”
BackgroundMethodInfluentialSamaha, J., Barrett, J. J., Sheldon, A. D., LaRocque, J. J., & Postle, B. R. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00851 · Cited by 111
“These metacognitive judgments are often quantified using subjective ratings on confidence or visibility scales (Barrett et al., 2013; Kanai et al., 2010; Maniscalco and Lau, 2012; Yeung and Summerfield, 2012).”
BackgroundSubliminal understanding of negation: Unconscious control by subliminal processing of word pairs
Armstrong, A.-M., & Dienes, Z. P. (2013) · Consciousness and Cognition · doi:10.1016/j.concog.2013.06.010 · Cited by 104
Self-citationUnconscious processing under interocular suppression: getting the right measure
Stein, T., & Sterzer, P. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00387 · Cited by 106
“…still under development and an agreement on a valid, bias-free measure of subjective awareness has yet to be reached (Evans and Azzopardi, 2007; Sandberg et al., 2010; Maniscalco and Lau, 2012; Barrett et al., 2013), we believe that this approach represents a promising future application for b-CFS.”
Prior expectations facilitate metacognition for perceptual decision
Sherman, M. T., Seth, A. K., Barrett, A. B., & Kanai, R. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2015.04.015 · Cited by 97
“We calculated meta-d 0 -balance from freely available online code (Barrett et al., 2013).”
InfluentialSelf-citationAccurate Metacognition for Visual Sensory Memory Representations
Vandenbroucke, A. R. E., Sligte, I. G., Barrett, A. B., Seth, A. K., Fahrenfort, J. J., & Lamme, V. A. F. (2014) · Psychological Science · doi:10.1177/0956797613516146 · Cited by 86
“513, and therefore, the comparison between metacognition scores using AUC can be fully justified (Barrett et al., 2013).”
BackgroundMethodInfluentialSelf-citationModeling perceptual confidence and the confidence forced-choice paradigm.
Mamassian, P., & de Gardelle, V. (2022) · Psychological Review · doi:10.1037/rev0000312 · Cited by 70
Domain-specific and domain-general processes underlying metacognitive judgments
Fitzgerald, L. M., Arvaneh, M., & Dockree, P. M. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2017.01.011 · Cited by 86
How to use and report Bayesian hypothesis tests.
Dienes, Z. P. (2020) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000258 · Cited by 91
Self-citationManiscalco, B., & Lau, H. C. (2015) · Neuroscience of Consciousness · doi:10.1093/nc/niv002 · Cited by 71
“A recent investigation of the statistical properties of meta-d’ suggests that it has acceptably low levels of bias and variance even when estimated with as few as 50 trials (Barrett et al., 2013).”
The future of metacognition research: Balancing construct breadth with measurement rigor
Katyal, S., & Fleming, S. M. (2024) · Cortex · doi:10.1016/j.cortex.2023.11.002 · Cited by 63
“…assumption that Mratio is performance-independent has been systematically evaluated in both simulation and empirical studies, with nonlinearities in this relationship leading to new model-based metrics with more stable psychometric properties (Barrett, Dienes, & Seth, 2013; Guggenmos, 2021, 2022).”
BackgroundVisual metacognition: Measures, models, and neural correlates.
Rahnev, D. (2021) · American Psychologist · doi:10.1037/amp0000937 · Cited by 69
“Indeed, Mratio has been found to measure metacognitive ability independent of primary task difficulty in both simulations (Barrett et al., 2013) and empirical data (Shekhar & Rahnev, 2021a).”
Can working memory be non-conscious?
Stein, T., Kaiser, D., & Hesselmann, G. (2016) · Neuroscience of Consciousness · doi:10.1093/nc/niv011 · Cited by 61
“Note that even if bias-free measures of subjective awareness (Barrett et al., 2013) were applied in future studies to demonstrate that observers had no subjective awareness of the memory cue, this would not provide evidence for non-conscious WM.”
BackgroundEmotion as a boost to metacognition: How worry enhances the quality of confidence
Massoni, S. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.08.006 · Cited by 69
Confidence measurement in the light of signal detection theory
Massoni, S., Gajdos, T., & Vergnaud, J.-C. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01455 · Cited by 58
Moeller, S. J., Fleming, S. M., Gan, G., Zilverstand, A., Malaker, P., Uquillas, F. D., Schneider, K. E., Preston‐Campbell, R. N., Parvaz, M. A., Maloney, T., et al. (2016) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2016.02.009 · Cited by 68
“Using this ratio as a measure of metacognition effectively eliminates performance and response bias confounds that can affect other measures (Barrett et al., 2013).”
BackgroundVisibility Is Not Equivalent to Confidence in a Low Contrast Orientation Discrimination Task
Rausch, M., & Zehetleitner, M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00591 · Cited by 64
“Likewise, the lower metacognitive sensitivity of visibility compared to confidence may be formally described by criterion jitter (Ko and Lau, 2012) or by decreasing signal (Barrett et al., 2013).”
BackgroundHändel, M., & Fritzsche, E. S. (2015) · Memory & Cognition · doi:10.3758/s13421-015-0552-0 · Cited by 66
Blind Insight : Metacognitive Discrimination Despite Chance Task Performance
Scott, R. B. Y., Dienes, Z. P., Barrett, A. B., Bor, D., & Seth, A. K. (2014) · Psychological Science · doi:10.1177/0956797614553944 · Cited by 66
“…that both first-order and metacognitive discriminations emerge from the interaction of top-down expectations and bottom-up prediction errors, for example by allowing topdown signals to reshape the probability distributions of evidence on which decision thresholds are imposed (Barrett et al., 2013).”
BackgroundMethodInfluentialSelf-citationFilippi, R., Ceccolini, A., Periche-Tomas, E., & Bright, P. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820931096 · Cited by 67
A bilingual disadvantage in metacognitive processing
Folke, T., Ouzia, J., Bright, P., Martino, B. D., & Filippi, R. (2016) · Cognition · doi:10.1016/j.cognition.2016.02.008 · Cited by 89
The perceptual and social components of metacognition.
Pescetelli, N., Rees, G. E., & Bahrami, B. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000180 · Cited by 72
Shekhar, M., & Rahnev, D. (2023) · Journal of Experimental Psychology General · doi:10.1037/xge0001524 · Cited by 79
“The fi rst one assumes the presence of additional, postdecisional processing that adds more information before con fi dence is given (Post-Dec model; Barrett et al., 2013).”
BackgroundThe Relationship Between Consciousness and Top-Down Attention
Tsuchiya, N., & Koch, C. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-800948-2.00005-4 · Cited by 52
Examining the robustness of the relationship between metacognitive efficiency and metacognitive bias
Xue, K., Shekhar, M., & Rahnev, D. (2021) · Consciousness and Cognition · doi:10.1016/j.concog.2021.103196 · Cited by 45
Rausch, M., Zehetleitner, M., Steinhauser, M., & Maier, M. E. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116963 · Cited by 55
Bor, D., Schwartzman, D. J., Barrett, A. B., & Seth, A. K. (2017) · PLoS ONE · doi:10.1371/journal.pone.0171793 · Cited by 54
“There are specific methodological advantages provided by meta d’, as compared to type II d’, for measuring metacognitive sensitivity [18,20,22].”
BackgroundMethodResultInfluentialSelf-citationPerformance Monitoring for Sensorimotor Confidence: A Visuomotor Tracking Study
Locke, S. M., Mamassian, P., & Landy, M. S. (2019) · Cognition · doi:10.1016/j.cognition.2020.104396 · Cited by 40
Lush, P., Roseboom, W., Axel Cleeremans, B., Scott, R. B. Y., Seth, A. K., & Dienes, Z. P. (2019) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000661 · Cited by 46
Self-citationA comprehensive assessment of current methods for measuring metacognition
Rahnev, D. (2025) · Nature Communications · doi:10.1038/s41467-025-56117-0 · Cited by 106
“Several papers have relied exclusively on simulations to investigate some of the properties of measures of metacognition 36,37 .”
I know better! Emerging metacognition allows adolescents to ignore false advice
Moses-Payne, M. E., Habicht, J., Bowler, A., Steinbeis, N., & Hauser, T. U. (2021) · Developmental Science · doi:10.1111/desc.13101 · Cited by 51
“Metacognitive efficiency (meta- d′/d′) is a relative measure that eliminates any remaining performance and response bias confounds (Barrett et al., 2013; Galvin et al., 2003; Maniscalco & Lau, 2012, 2014; Masson & Rotello, 2009).”
Munnich, E. L., & Ranney, M. A. (2018) · Topics in Cognitive Science · doi:10.1111/tops.12397 · Cited by 39
Brain Structural Correlates of Metacognition in First-Episode Psychosis
Alkan, E., Davies, G., Greenwood, K., & Evans, S. (2019) · Schizophrenia Bulletin · doi:10.1093/schbul/sbz116 · Cited by 38
Sensitivity to changes in rate of heartbeats as a measure of interoceptive ability
Larsson, D. E. O., Esposito, G., Critchley, H., Dienes, Z. P., & Garfinkel, S. N. (2021) · Journal of Neurophysiology · doi:10.1152/jn.00059.2021 · Cited by 46
Self-citationVisual statistical learning in children and young adults: how implicit?
Bertels, J., Boursain, E., Destrebecqz, A., & Gaillard, V. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01541 · Cited by 54
Metacognitive sensitivity of subjective reports of decisional confidence and visual experience
Rausch, M., Müller, H. J., & Zehetleitner, M. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2015.02.011 · Cited by 46
Towards a common conceptual space for metacognition in perception and memory
Mazancieux, A., Pereira, M., Faivre, N., Mamassian, P., Moulin, C. J. A., & Souchay, C. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00245-1 · Cited by 48
“The optimal calculation of metacognitive sensitivity has been widely discussed and reviewed 22,35–38 ( Correlation studies consistently find that metacognitive bias is stable across many domains including perception and episodic and semantic memory 8,10–13 .”
BackgroundLeganes‐Fonteneau, M., Scott, R. B. Y., & Duka, T. (2017) · Behavioural Brain Research · doi:10.1016/j.bbr.2017.12.015 · Cited by 38
“In this experiment CA categorization was performed using Signal Detection Theory (SDT) methods [37, 56].”
InfluentialDomain-Specific Metacognition Impairment in Opiate Addiction
Sadeghi, S., Ekhtiari, H., Bahrami, B., & Ahmadabadi, M. N. (2015) · Scientific Reports · doi:10.1038/s41598-017-06707-w · Cited by 40
Miyoshi, K., & Lau, H. (2020) · Psychological Review · doi:10.1037/rev0000184 · Cited by 33
What do second-order judgments tell us about low-performing students’ metacognitive awareness?
Fritzsche, E. S., Händel, M., & Kröner, S. (2018) · Metacognition and Learning · doi:10.1007/s11409-018-9182-9 · Cited by 37
“…for students of the bottom performance quartile (N = 28 students, N = 766 responses) to investigate differences between these two groups.7 The separate assessment of PJs and respective SOJs on the item level allowed analysis according to the SDT-framework (Barrett et al. 2013; Schraw et al. 2013).”
BackgroundMethodInfluentialMeasuring metacognition of direct and indirect parameters of voluntary movement.
Arbuzova, P., Peters, C., Röd, L., Koß, C., Maurer, H., Maurer, L. K., Müller, H., Verrel, J., & Filevich, E. (2021) · Journal of Experimental Psychology General · doi:10.1037/xge0000892 · Cited by 29
Metacognitive Information Theory
Dayan, P. (2023) · Open Mind · doi:10.1162/opmi_a_00091 · Cited by 41
“Meta – d 0 and the M-ratio are widely used as measures of meta-cognitive effectiveness (Barrett et al., 2013).”
Should metacognition be measured by logistic regression?
Rausch, M., & Zehetleitner, M. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2017.02.007 · Cited by 29
“An important implication of the SDT model is that the full evidence available to task responses is also available to subjective reports (Macmillan & Creelman, 2005), which is why the model is sometimes referred to as ‘‘ideal observer model” (Barrett et al., 2013).”
BackgroundMethodAdvancing sustainable tourism behavioural research: a metacognitive perspective
Hadinejad, A., Esfandiar, K., & Skavronskaya, L. (2025) · Current Issues in Tourism · doi:10.1080/13683500.2025.2512999 · Cited by 35
“…forced-choice task (a task to recognise a previously experienced stimulus from a novel one), and meta-d’ (a metacognitive sensitivity index to quantify the discrepancy between correct and incorrect trials) to measure metacognition (Barrett et al., 2013; Dienes & Seth, 2010; Maniscalco & Lau, 2012).”
Suprathreshold perceptual decisions constrain models of confidence
Locke, S. M., Landy, M. S., & Mamassian, P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010318 · Cited by 28
Measuring metacognition: A comprehensive assessment of current methodsPreprint
Rahnev, D. (2023) · doi:10.31234/osf.io/waz9h · Cited by 25
Sensor-based modeling of problem-solving in virtual reality manufacturing systems
Zhu, R., Aqlan, F., Zhao, R., & Yang, H. Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117220 · Cited by 24
Optimal metacognitive decision strategies in signal detection theory
Maniscalco, B., Charles, L., & Peters, M. A. K. (2024) · Psychonomic Bulletin & Review · doi:10.3758/s13423-024-02510-7 · Cited by 25
“Type 2 sensitivity is constrained by various factors (including type 1 sensitivity) and extensive literature has explored how to measure it in a meaningful way (Barrett et al., 2013; Fleming & Daw, 2017; Fleming & Lau, 2014).”
Esser, S., Lustig, C., & Haider, H. (2021) · Psychological Research · doi:10.1007/s00426-021-01594-3 · Cited by 34
“1 3 being based on bottom-up signal-detection theories (Barrett et al., 2013; Fleming & Lau, 2014; Maniscalco & Lau, 2012, 2016).”
Intracranial Markers of Conscious Face Perception in Humans
Baroni, F., van Kempen, J., Kawasaki, H., Kovach, C. K., Oya, H., Howard, M. A., Adolphs, R., & Tsuchiya, N. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.074 · Cited by 24
“325 introduced measure from signal detection theory known as meta-d' (Maniscalco and Lau, 2012; Barrett et al., 2013).”
BackgroundMethodMetric error monitoring: Another generalized mechanism for magnitude representations?
Yallak, E., & Balcı, F. (2021) · Cognition · doi:10.1016/j.cognition.2020.104532 · Cited by 26
Azevedo, R. T., Aglioti, S. M., & Lenggenhager, B. (2016) · Scientific Reports · doi:10.1038/srep26545 · Cited by 24
Measures of metacognitive efficiency across cognitive models of decision confidence.
Rausch, M., Hellmann, S., & Zehetleitner, M. (2023) · Psychological Methods · doi:10.1037/met0000634 · Cited by 22
Evidence for Age-Equivalent and Task-Dissociative Metacognition in the Memory Domain
Zakrzewski, A. C., Sanders, E. C., & Berry, J. M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.630143 · Cited by 23
“However, meta-d’, like d’, has been shown to be resistant to response bias, including metacognitive response bias (Maniscalco and Lau, 2012; Barrett et al., 2013).”
BackgroundDavies, G., Rae, C. L., Garfinkel, S. N., Seth, A. K., Medford, N., Critchley, H., & Greenwood, K. (2018) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2018.1444597 · Cited by 22
“This study furthermore does this through advanced SDT theory therefore employing a sensitive, rigorous and validated model of metacognitive sensitivity (Barrett et al., 2013).”
MethodSelf-citationNeural Substrate for Metacognitive Accuracy of Tactile Working Memory
Gogulski, J., Zetter, R., Nyrhinen, M., Pertovaara, A., & Carlson, S. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx219 · Cited by 22
“Given the relatively low number of trials, the most preferable, subject-per-subject analysis of metacognitive accuracy would have yielded unstable estimates of meta-d’ (Barrett et al. 2013).”
BackgroundInfluentialRuby, E., Maniscalco, B., & Peters, M. A. K. (2018) · Consciousness and Cognition · doi:10.1016/j.concog.2018.04.009 · Cited by 23
“(2017) primary justification for subject exclusion is based on their work showing that sufficiently large or small hit and false alarm rates tend to induce large changes in meta d′ estimates (Barrett et al., 2013). However, we emphasize that in classical hypothesis testing there are two main types of error: Type I and…”
BackgroundInfluentialA window of subliminal perception
Sandberg, K., Pin, S. H. D., Overgaard, M. S., & Bibby, B. M. (2022) · Behavioural Brain Research · doi:10.1016/j.bbr.2022.113842 · Cited by 24
Common computations for metacognition and meta-metacognition
Zheng, Y., Recht, S., & Rahnev, D. (2023) · Neuroscience of Consciousness · doi:10.1093/nc/niad023 · Cited by 15
Effects of ketamine on brain function during metacognition of episodic memory
Lehmann, M., Neumann, C., Wasserthal, S., Schultz, J., Delis, A., Trautner, P., Hurlemann, R., & Ettinger, U. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niaa028 · Cited by 20
Consciousness Under the Spotlight: The Problem of Measuring Subjective Experience
Jimenez, M., Prieto, A., Hinojosa, J. A., & Montoro, P. R. (2024) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1697 · Cited by 25
Methodological concerns: the feeling-of-knowing task affects resolution
Schwartz, B. L., Boduroğlu, A., & Tekcan, A. Í. (2015) · Metacognition and Learning · doi:10.1007/s11409-015-9152-4 · Cited by 22
“We also predicted that the gamma correlation will be higher for unrecalled items in the unrecalled-only condition than the unrecalled-all condition (see Barrett et al. 2014, Masson and Rotello 2009, and Nelson 1984 for discussions of the use of gamma as a measure of resolution).”
Leganes‐Fonteneau, M., Nikolaou, K., Scott, R. B. Y., & Duka, T. (2019) · Learning & Memory · doi:10.1101/lm.048272.118 · Cited by 18
“Using Signal Detection Theory methods (Stanislaw and Todorov 1999; Barrett et al. 2013), we computed the number of Type I: Hits (responding “Yes” on aHR trial), Correct Rejections (responding “No” on a LR trial), False Alarms (responding “Yes” on a LR trial), andMisses (responding “No” on a HR…”
BackgroundMethodLandry, M., Castanheira, J. D. S., Sackur, J., & Raz, A. (2021) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000810 · Cited by 19
“Furthermore, we extended this analytic strategy to estimate 432 parameter values of linear regression models for examining how stimulus-driven 433 18 attention, goal-driven attention, and their interaction predict log M-Ratio.”
BackgroundInfluentialThe role of metacognition in recognition of the content of statistical learning
Ordin, M., & Polyanskaya, L. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01800-0 · Cited by 16
Matthews, J., Nagao, K. J., Ding, C., Newby, R., Kempster, P. A., & Hohwy, J. (2020) · Cortex · doi:10.1016/j.cortex.2019.12.009 · Cited by 14
A single oral dose of citalopram increases interoceptive insight in healthy volunteers
Livermore, J. J. A., Holmes, C. L., Moga, G., Adamatzky, K., Critchley, H., Garfinkel, S. N., & Campbell-Meiklejohn, D. K. (2022) · Psychopharmacology · doi:10.1007/s00213-022-06115-7 · Cited by 20
“This also provides a poor fit to signal detection theory approaches to metacognition analysis that assume that metacognitive insight arises from the same information and processes as the perceptual decision, necessitating above chance accuracy to interpret above chance metacognition (Barrett et al. 2013).”
BackgroundZloteanu, M., & Vuorre, M. (2024) · Journal of Nonverbal Behavior · doi:10.1007/s10919-024-00456-x · Cited by 16
“And, as mentioned, extending this framework to Type II SDT, quantifying judges’ awareness of their decisions (Barrett et al., 2013).”
Wright, A. C., Fowler, D. G., & Greenwood, K. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-022546 · Cited by 16
Quantifying metacognitive thresholds using signal-detection theoryPreprint
Sherman, M. T., Seth, A. K., & Barrett, A. B. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/361543 · Cited by 15
“…evidence xk received on trial k (from which the objective decision is made), the evidence made available for the confidence report yk is given by (Barrett et al., 2013): Here, s1 and s2 are independent free parameters (bounded by zero) that determine the degree of additional noise applied to the…”
BackgroundMethodResultInfluentialSelf-citationDoes age affect metacognition? A cross-domain investigation using a hierarchical Bayesian framework
Meunier-Duperray, L., Mazancieux, A., Souchay, C., Fleming, S. M., Bastin, C., Moulin, C. J. A., & Angel, L. (2025) · Cognition · doi:10.1016/j.cognition.2025.106089 · Cited by 14
On the assumptions behind metacognitive measurements: Implications for theory and practice
Miyoshi, K., Sakamoto, Y., & Nishida, S. (2022) · Journal of Vision · doi:10.1167/jov.22.10.18 · Cited by 10
Typological differences influence the bilingual advantage in metacognitive processing.
Polyanskaya, L., Manrique, H. M., Marín, A., García‐Palacios, A., & Ordin, M. (2022) · Journal of Experimental Psychology General · doi:10.1037/xge0001225 · Cited by 11
Regression methods for metacognitive sensitivity
Kristensen, S. B., Sandberg, K., & Bibby, B. M. (2019) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2019.102297 · Cited by 16
Multilingualism and Metacognitive Processing
Bright, P., Ouzia, J., & Filippi, R. (2019) · Wiley eBooks · doi:10.1002/9781119387725.ch17 · Cited by 10
Mood and implicit confidence independently fluctuate at different time scales
da Fonseca, M., Maffei, G., Moreno‐Bote, R., & Hyafil, A. (2022) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-022-01038-4 · Cited by 12
“The definition is based on the framework of signal detection theory (Barrett et al., 2013; Massoni et al., 2014).”
BackgroundMethodHands of confidence: When gestures increase confidence in spatial problem-solving
Çapan, D., Furman, R., Göksun, T., & Eskenazi, T. (2023) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218231164270 · Cited by 9
“We calculated the participants’ metacognitive sensitivity (meta d′) and efficiency (MRatio) scores based on a signal detection theory (SDT) framework (Barrett et al., 2013).”
MethodSherman, M. T., & Seth, A. K. (2024) · Neuroscience of Consciousness · doi:10.1093/nc/niae020 · Cited by 12
“M-ratio (Man-iscalco and Lau 2012, Barrett et al. 2013, Fleming 2017) is a signal detection theoretic (SDT) measure (Green and Swets 1966) of metacognitive efficiency.”
BackgroundSelf-citation
Metadata
- Authors
- Barrett, A. B., Dienes, Z., & Seth, A. K.
- Affiliations
- University of Sussex (GB)
- Venue
- Psychological Methods
- Published
- 2013
- Volume
- 18
- Issue
- 4
- Pages
- 535-552
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2006647339
- Cited by
- 155
- References
- 55
- Citations by year
- 2026: 2 · 2025: 13 · 2024: 6 · 2023: 16 · 2022: 18 · 2021: 16 · 2020: 13 · 2019: 11 · 2018: 12 · 2017: 13 · 2016: 12 · 2015: 9 · 2014: 11 · 2013: 3
- FWCI
- 6.37
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Sussex Research Online (University of Sussex) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- Dr. Mortimer and Dame Theresa Sackler Foundation
- Engineering and Physical Sciences Research Council (EP/G007543/1)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- metacognition, signal detection theory, metacognitive sensitivity, response bias, metacognitive judgments, metacognitive accuracy, metacognitive confidence, metacognitive monitoring
- MeSH terms
- Cognition, Data Interpretation, Statistical, Humans, Models, Psychological, Signal Detection, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.