Investigating strength and frequency effects in recognition memory using type-2 signal detection theory
The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Criterion- versus distribution-shift accounts of frequency and strength effects in recognition memory were investigated with Type-2 signal detection receiver operating characteristic (ROC) analysis, which provides a measure of metacognitive monitoring. Experiment 1 demonstrated a frequency-based mirror effect, with a higher hit rate and lower false alarm rate, for low frequency words compared with high frequency words. In Experiment 2, the authors manipulated item strength with repetition, which showed an increased hit rate but no effect on the false alarm rate. Whereas Type-1 indices were ambiguous as to whether these effects were based on a criterion- or distribution-shift model, the two models predict opposite effects on Type-2 distractor monitoring under some assumptions. Hence, Type-2 ROC analysis discriminated between potential models of recognition that could not be discriminated using Type-1 indices alone. In Experiment 3, the authors manipulated Type-1 response bias by varying the number of old versus new response categories to confirm the assumptions made in Experiments 1 and 2. The authors conclude that Type-2 analyses are a useful tool for investigating recognition memory when used in conjunction with more traditional Type-1 analyses.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For instance, Galvin et al. (2003) showed mathematically that AUROC2 is affected by both type 1 d′ and type 1 criterion placement, a conclusion supported by experimental manipulation (Higham et al., 2009).”
From How to measure metacognition (2014) · cites this paper as Higham et al., 2009
Citations
Cites
Detection Theory: A User's Guide
Macmillan, N. A., & Creelman, C. D. (1991) · Cited by 5,415
Journal of Experimental Psychology: Human Learning and Memory
Bourne, L. E. (1977) · Cited by 4,328
A process dissociation framework: Separating automatic from intentional uses of memory
Jacoby, L. L. (1991) · Journal of Memory and Language · doi:10.1016/0749-596x(91)90025-f · Cited by 3,696 · cited 2×
“Similarly, Payne, Jacoby, and Lambert (2004) have found a moderate relationship between confidence and accuracy (a measure of metacognitive monitoring) in a two-alternative forced choice memory task.”
BackgroundMethodPragmatics of measuring recognition memory: Applications to dementia and amnesia.
Snodgrass, J. G., & Corwin, J. (1988) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.117.1.34 · Cited by 3,089 · cited 2×
“That is, Strack and Bless’s (1994) presuppositional strategy is adopted, which causes the proportion of “old” responses and the weak FAR1 to increase and a mirror effect to occur.”
MethodMonitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning
Koriat, A. (1997) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.126.4.349 · Cited by 1,363
Receiver-operating characteristics in recognition memory: Evidence for a dual-process model.
Yonelinas, A. P. (1994) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.20.6.1341 · Cited by 1,151
The role of decision processes in remembering and knowing
Donaldson, W. (1996) · Memory & Cognition · doi:10.3758/bf03200940 · Cited by 594 · cited 1×
“In particular, Donaldson’s (1996) procedure that varied the number of “old” versus “new” response categories was adopted.”
MethodKelley, C. M., & Lindsay, D. S. (1993) · Journal of Memory and Language · doi:10.1006/jmla.1993.1001 · Cited by 556
Yonelinas, A. P. (1997) · Memory & Cognition · doi:10.3758/bf03211318 · Cited by 473
Galvin, S. J., Podd, J. V., Drga, V., & Whitmore, J. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196546 · Cited by 405
Cited by
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
“…metacognitive sensitivity (Clarke et al., 1959; Lachman et al., 1979; Ferrell and McGoey, 1980; Nelson, 1984; Kunimoto et al., 2001; Higham, 2007; Higham et al., 2009), where type 2 hit rate is defined as the proportion of trials in which subjects reported high confidence given their responses…”
BackgroundThe neural basis of metacognitive ability
Fleming, S. M., & Dolan, R. J. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0417 · Cited by 747
“Two corollaries arise from this ‘direct translation hypothesis’ [65].”
BackgroundSupra-personal cognitive control and metacognition
Shea, N., Boldt, A., Bang, D., Yeung, N., Heyes, C., & Frith, C. D. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.006 · Cited by 368
Signal detection with criterion noise: Applications to recognition memory.
Benjamin, A. S., Diaz, M., & Wee, S. (2009) · Psychological Review · doi:10.1037/a0014351 · Cited by 136
Domain-specific enhancement of metacognitive ability following meditation training.
Baird, B., Mrazek, M. D., Phillips, D. T., & Schooler, J. W. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0036882 · Cited by 132
Assessing the belief bias effect with ROCs: It's a response bias effect.
Dube, C., Rotello, C. M., & Heit, E. (2010) · Psychological Review · doi:10.1037/a0019634 · Cited by 116
“An important advancement in research on the belief bias effect was provided by Klauer et al. (2000). The analyses conducted by Klauer et al.”
MethodA Mathematical Framework for Statistical Decision Confidence
Hangya, B., Sanders, J. I., & Kepecs, A. (2016) · Neural Computation · doi:10.1162/neco_a_00864 · Cited by 113
“Beyond a description of how confidence could be computed, signal detection theory has also been used as a starting point for evaluating the metacognitive sensitivity of human confidence reports (Ferrell and McGoey, 1980; Higham and Arnold, 2007; Higham et al., 2009; Kunimoto et al., 2001; Lachman et al., 1979; Nelson,…”
BackgroundMethodThe nature of metacognitive inefficiency in perceptual decision making.
Shekhar, M., & Rahnev, D. (2021) · Psychological Review · doi:10.1037/rev0000249 · Cited by 111
Siedlecka, M., Paulewicz, B., & Wierzchoń, M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00218 · Cited by 109
“The first row in Table 2 (intercept) estimates the average accuracy (on the logit scale) in the baseline condition (condition tDM, lowest rating = guessing).”
BackgroundSensory noise increases metacognitive efficiency
Bang, J. W., Shekhar, M., & Rahnev, D. (2019) · Journal of Experimental Psychology: General · doi:10.1037/xge0000511 · Cited by 94
Effects of loss aversion on post-decision wagering: Implications for measures of awareness
Fleming, S. M., & Dolan, R. J. (2010) · Consciousness and Cognition · doi:10.1016/j.concog.2009.11.002 · Cited by 77
“These behavioural deviations from the model hint at a deeper issue regarding the relationship between Type I task performance and metacognitive confidence (Baranski & Petrusic, 2001; Busey, Tunnicliff, Loftus, & Loftus, 2000; Higham et al., 2009).”
Regional White Matter Variation Associated with Domain-specific Metacognitive Accuracy
Baird, B., Cieslak, M., Smallwood, J., Grafton, S. T., & Schooler, J. W. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00741 · Cited by 57
Blind Insight: Metacognitive Discrimination Despite Chance Task Performance
Scott, R. B., Dienes, Z., Barrett, A. B., Bor, D., & Seth, A. K. (2014) · Psychological Science · doi:10.1177/0956797614553944 · Cited by 56
Detection of Sexual Orientation (“Gaydar”) by Homosexual and Heterosexual Women
Lyons, M. T., Lynch, A., Brewer, G., & Bruno, D. (2013) · Archives of Sexual Behavior · doi:10.1007/s10508-013-0144-7 · Cited by 50
Self-citationThe Neural Basis of Metacognitive Ability
Fleming, S. M., & Dolan, R. J. (2014) · The Cognitive Neuroscience of Metacognition · doi:10.1007/978-3-642-45190-4_11 · Cited by 50
It takes one to know one: Relationship between lie detection and psychopathy
Lyons, M. T., Healy, N., & Bruno, D. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2013.05.018 · Cited by 49
Self-citationCue familiarity and ‘don’t know’ responding in episodic memory tasks
Hanczakowski, M., Pasek, T., Zawadzka, K., & Mazzoni, G. A. L. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2013.04.005 · Cited by 41
“The full discussion of differences between type-1 and type-2 models is beyond the scope of the present work and interested readers can find such a discussion in Higham, Perfect, and Bruno (2009).”
BackgroundMethodSawyer, A. C. P., Williamson, P., & Young, R. L. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-013-1999-0 · Cited by 34
“This is best indexed using the Type-2 Signal Detection Theory d prime (d’) statistic which considers the difference in proportions of hit rates and false-alarm rates (Higham et al. 2009).”
MethodGlobal subjective memorability and the strength-based mirror effect in recognition memory
Bruno, D., Higham, P. A., & Perfect, T. J. (2009) · Memory & Cognition · doi:10.3758/mc.37.6.807 · Cited by 33
“These demonstrations of differential FAR across classes of items contrast markedly with the failure to demonstrate such a shift based on study repetitions manipulated within a list (Higham et al., 2009; Morrell et al., 2002; Stretch & Wixted, 1998).”
BackgroundSelf-citationDoss, M. K., Samaha, J., Barrett, F. S., Griffiths, R. R., de Wit, H., Gallo, D. A., & Koen, J. D. (2024) · Psychological Review · doi:10.1037/rev0000455 · Cited by 38
Koriat, A. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000397 · Cited by 37
Horry, R., Colton, L.-M., & Williamson, P. (2014) · Acta Psychologica · doi:10.1016/j.actpsy.2014.06.006 · Cited by 39
Responses improve the accuracy of confidence judgements in memory tasks.
Siedlecka, M., Skóra, Z., Paulewicz, B., Fijałkowska, S., Timmermans, B., & Wierzchoń, M. (2019) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000608 · Cited by 36
Lyons, M. T., Croft, A., Fairhurst, S., Varley, K., & Wilson, C. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.03.008 · Cited by 25
Stage 2 Registered Report: Metacognitive asymmetries in visual perception
Mazor, M., Moran, R., & Fleming, S. M. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab025 · Cited by 21
“For instance, in recognition memory, subjects typically show poor metacognitive sensitivity for judgments about the absence of memories (such as when judging that they have not seen a study item before; Higham et al. 2009).”
Confidence judgments: The monitoring of object-level and same-level performance
Koriat, A. (2019) · Metacognition and Learning · doi:10.1007/s11409-019-09195-7 · Cited by 28
The recency ratio as an index of cognitive performance and decline in elderly individuals
Bruno, D., Plaska, C. R., & Pomara, N. (2016) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2016.1179721 · Cited by 19
Self-citationLueddeke, S. E., & Higham, P. A. (2011) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2011.584631 · Cited by 18
Self-citationConfounding in Studies on Metacognition: A Preliminary Causal Analysis Framework
Paulewicz, B., Siedlecka, M., & Koculak, M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01933 · Cited by 21
“Most theories of confidence assume that metacognitive assessments are informed by stimulus-related information, such as the quality of a perceptual item, its intensity or its size (e.g., Rhodes and Castel, 2008; Galvin et al., 2003; Higham et al., 2009; Vickers and Lee, 1998), although the degree to which stimuli-rela…”
BackgroundRecovering the variance of d' from hit and false alarm statistics
Botella, J., & Suero, M. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1181-x · Cited by 15
Hicks, J. L., & Starns, J. J. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0397-y · Cited by 15
Metacognitive Control of Memory Reporting
Goldsmith, M., Pansky, A., & Koriat, A. (2014) · SAGE Publications Ltd eBooks · doi:10.4135/9781446294703.n27 · Cited by 15
Monitoring and meta-metacognition in the own-race bias
Arnold, M. M. (2013) · Acta Psychologica · doi:10.1016/j.actpsy.2013.07.007 · Cited by 14
Sizing Up Objects: The Effect of Diminutive Forms on Positive Mood, Value, and Size Judgments
Parzuchowski, M., Bocian, K., & Gygax, P. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01452 · Cited by 18
Luna, K., Мартин-Луенго, Б., & Brewer, N. (2015) · Memory & Cognition · doi:10.3758/s13421-015-0534-2 · Cited by 12
Exploring the relationship between prior knowledge and metacognitive monitoring accuracy
Witherby, A. E., Carpenter, S. K., & Smith, A. M. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09344-z · Cited by 14
“This approach to estimating metacognitive sensitivity is most similar to estimating Type-2 d’ (Clarke et al., 1959; Kunimoto et al., 2001; Higham, 2007; Higham et al., 2009).”
MethodA strength-based mirror effect persists even when criterion shifts are unlikely
Koop, G. J., Criss, A. H., & Pardini, A. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00906-8 · Cited by 10
Remembering “primed” words: A counter-intuitive effect of repetition on recognition memory.
Rosner, T. M., López‐Benítez, R., D’Angelo, M. C., Thomson, D. R., & Milliken, B. (2018) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000139 · Cited by 9
No pain no gain: The positive impact of punishment on the strategic regulation of accuracy
Arnold, M. M., Chisholm, L. M., & Prike, T. (2014) · Memory · doi:10.1080/09658211.2014.990982 · Cited by 7
Gaynor, A. M., & Chua, E. F. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01449 · Cited by 9
One mirror effect: The regularities of recognition memory
Hilford, A., Glanzer, M., Kim, K., & Maloney, L. T. (2018) · Memory & Cognition · doi:10.3758/s13421-018-0864-y · Cited by 8
“It has been supported further by investigations that have replicated the mixed-list-strength-no-mirror effect (Bruno et al., 2009, Exp. 1; Criss, 2006, Exp. 2; Higham et al., 2009, Exp. 2; Morrell et al., 2002, Exps.”
ResultMetacognitive asymmetries in visual perception
Mazor, M., Moran, R., & Fleming, S. M. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab005 · Cited by 8
Task-related motor response inflates confidencePreprint
Siedlecka, M., Paulewicz, B., & Koculak, M. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.03.26.010306 · Cited by 14
Arnold, M. M., & Prike, T. (2015) · Acta Psychologica · doi:10.1016/j.actpsy.2015.02.018 · Cited by 7
Recognition of categorised words: Repetition effects in rote study
Singer, M., Fazaluddin, A., & Andrew, K. N. (2012) · Memory · doi:10.1080/09658211.2012.739625 · Cited by 7
Dymarska, A., Connell, L., & Banks, B. (2023) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001265 · Cited by 10
Higham, P. A., Bruno, D., & Perfect, T. J. (2010) · Memory · doi:10.1080/09658211.2010.517757 · Cited by 6
“Indeed, it is because of the higher target strength for a given class of items (e.g., pictures) that participants are assumed to shift their criterion to be more conservative (e.g., Brown et al., 1977; Higham et al., 2009; Stretch & Wixted, 1998).”
BackgroundSelf-citationLie Detection Accuracy—the Role of Age and the Use of Emotions as a Reliable Cue
Shaw, H., & Lyons, M. T. (2016) · Journal of Police and Criminal Psychology · doi:10.1007/s11896-016-9222-9 · Cited by 12
“To estimate deception detection accuracy, signal detection theory (Higham et al. 2009; Macmillan and Creelman 2005) was used to calculate a hit rate and a false alarm rate for each”
MethodSaccenti, D., Moro, A. S., Salvetti, G., Sassaroli, S., Malgaroli, A., Lamanna, J., & Ferro, M. (2025) · Biomedicines · doi:10.3390/biomedicines13071522 · Cited by 6
“Since the latter were shown to be influenced by task performance [9,91], we opted for subsequently modeling the connection between performance and metacognition by employing the meta-d ′ measure.”
Exploration of a new consumer test method based on metacognitive certainty
Kim, I.-A., Cho, H.-Y., Hautus, M. J., & Lee, H.-S. (2019) · Food Quality and Preference · doi:10.1016/j.foodqual.2019.103857 · Cited by 5
The subjective experience of retrieval-induced forgetting
Luna, K., & Мартин-Луенго, Б. (2013) · Memory · doi:10.1080/09658211.2013.832331 · Cited by 5
Hughes, G. I., & Thomas, A. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10040101 · Cited by 5
Decision criteria in signal detection model are not based on the objective likelihood ratio.
Hu, X., Yang, C., & Luo, L. (2023) · Journal of Experimental Psychology General · doi:10.1037/xge0001438 · Cited by 4
Lee, Y., van Hout, D., & Lee, H.-S. (2024) · Food Quality and Preference · doi:10.1016/j.foodqual.2024.105170 · Cited by 3
Generality of likelihood ratio decisions
Glanzer, M., Hilford, A., Kim, K., & Maloney, L. T. (2019) · Cognition · doi:10.1016/j.cognition.2019.03.023 · Cited by 3
Stage 2 Registered Report: Metacognitive asymmetries in visual perceptionPreprint
Mazor, M., Moran, R., & Fleming, S. M. (2021) · doi:10.31234/osf.io/av9ns · Cited by 3
How much can children see and report about their experience of a brief glance at a natural scene?
Watanabe, R., Tsuchiya, N., Qianchen, L., Myowa, M., & Moriguchi, Y. (2025) · Neuroscience of Consciousness · doi:10.1093/nc/niaf019 · Cited by 4
“However, we must consider that Type 2 measures are influenced by Type 1 task performance (Galvin et al. 2003, Higham et al. 2009, Fleming and Lau 2014).”
Eyewitness memory in the news can affect the strategic regulation of memory reporting
Butt, M. M., Colloff, M. F., Magner, E., & Flowe, H. D. (2020) · Memory · doi:10.1080/09658211.2020.1846750 · Cited by 2
“Future research could use a Type 2 signal-detection analysis to further investigate strategic regulation of memory (Higham et al., 2009).”
MethodYu, C., & Moore, K. N. (2026) · Memory · doi:10.1080/09658211.2026.2691574 · Cited by 1
“…analysis draws explicitly on this conceptual distinction between confidence judgments and primary task decisions and provides a way to quantify metacognitive sensitivity independently of metacognitive bias (Ben-jamin et al., 2009; Benjamin & Diaz, 2008; Higham et al., 2009; Masson & Rotello, 2009).”
Memory Monitoring and Control in Young and Intermediate-Age Adults
Zortéa, M., de Jou, G. I., & de Salles, J. F. (2015) · Paidéia (Ribeirão Preto) · doi:10.1590/1982-43272561201512 · Cited by 1
You’d better decide first: overt and covert decisions improve metacognitive accuracyPreprint
Siedlecka, M., Skóra, Z., Paulewicz, B., & Wierzchoń, M. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/470146 · Cited by 1
“of confidence, assuming that confidence and decision are based on the same information (Galvin et al., 2003; Higham et al., 2009; Vickers & Lee, 1998).”
BackgroundResultRemembering “primed” words: A counter-intuitive effect of repetition on recognition memoryPreprint
Rosner, T. M., López‐Benítez, R., D’Angelo, M. C., Thomson, D. R., & Milliken, B. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/depw9 · Cited by 1
Criteria and awareness in perceptual decision
Fleming, S. M. (2011) · UCL Discovery (University College London)
Conscious and unconscious: passing judgment
Mealor, A. D. (2013) · Sussex Research Online (University of Sussex)
SAC Attack: Assessing the Role of Recollection in the Mirror Effect
Pazzaglia, A. M. (2022) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/3531192
Carr, S. E. (2012) · ePrints Soton (University of Southampton)
Jou, J., Escamilla, E. E., Torres, A., Ortiz, A., & Matos, M. S. (2020) · The American Journal of Psychology · doi:10.5406/amerjpsyc.133.4.0453
Sensorimotor effects in surprise word memory – A registered report
Dymarska, A., & Connell, L. (2025) · Cortex · doi:10.1016/j.cortex.2025.03.010
“Lower frequency words produced higher hit rates and HR-FA and better d’ sensitivity (as in Cortese et al., 2010; 2015; Higham et al., 2009; Lau et al., 2018).”
Towards a unified view of metacognition : Insights from metamemory
Mazancieux, A. (2020) · theses.fr (ABES) · doi:10.70675/f37dcebbz4e30z4da4za014z74039ef3666f · Cited by 1
The Role of Metacognition in Occupational Pursuits : Evidence from Laboratory Experiments
Cavalan, Q. (2023) · theses.fr (ABES) · doi:10.70675/7fb86a89zd36fz4d73zae75zb74f435a571f
Metadata
- Authors
- Higham, P. A., Perfect, T. J., & Bruno, D.
- Affiliations
- University of Southampton (GB)
- Venue
- Journal of Experimental Psychology Learning Memory and Cognition
- Published
- 2009-01
- Volume
- 35
- Issue
- 1
- Pages
- 57-80
- ISSN
- 0278-7393 (ISSN-L)
- 1939-1285
- OpenAlex
- W2164375539
- Cited by
- 70
- References
- 55
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 1 · 2023: 5 · 2022: 2 · 2021: 3 · 2020: 6 · 2019: 6 · 2018: 7 · 2017: 1 · 2016: 5 · 2015: 3 · 2014: 10 · 2013: 7 · 2012: 3
- FWCI
- 1.61
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology Learning Memory and Cognition (publishedVersion)
- PubMed (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- Funders
- Economic and Social Research Council (RES-000-23-1375)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Keywords
- recognition memory, frequency effects, mirror effect, metacognitive monitoring, criterion shift, distribution shift, response bias, word frequency, repetition
- MeSH terms
- Adolescent, Analysis of Variance, Association Learning, Cognition, Female, Humans, Male, Models, Psychological, Photic Stimulation, Psycholinguistics, Reaction Time, ROC Curve, Vocabulary, Signal Detection, Psychological, Recognition, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.