When asking the question changes the ultimate answer: Metamemory judgments change memory
The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Abstract
Self-report measurements are ubiquitous in psychology, but they carry the potential of altering processes they are meant to measure. We assessed whether a common metamemory measure, judgments of learning, can change the ongoing process of memorizing and subsequent memory performance. Judgments of learning are a form of metamemory monitoring described as conscious reflection on one's own memory performance or encoding activities for the purpose of exerting strategic control over one's study and retrieval activities (T. O. Nelson & Narens, 1990). Much of the work examining the conscious monitoring of encoding relies heavily on a paradigm in which participants are asked to estimate the probability that they will recall a given item in a judgment of learning. In 5 experiments, we find effects of measuring judgments of learning on how people allocate their study time to difficult versus easy items, and on what they will recall. These results suggest that judgments of learning are partially constructed in response to the measurement question. The tendency of judgments of learning to alter performance places them in the company of other reactive verbal reporting methods, counseling researchers to consider incorporating control groups, creating alternative scales, and exploring other verbal reporting methods. Less directive methods of accessing participants' metacognition and other judgments should be considered as an alternative to response scales.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“All previous reactivity studies presented stimuli in a unimodal form (e.g., word pairs presented visually; Mitchum et al., 2016; Yang, Huang, et al., 2021), which is somewhat unrepresentative of materials in real educational settings.”
From When judging what you know changes what you really know: Soliciting metamemory judgments reactively enhances children’s learning (2022) · cites this paper as Mitchum et al., 2016
In the citing paper
“Some recent studies have documented that, in some situations, the reactivity effect can be negative (that is, making JOLs impairs retention).”
From When judging what you know changes what you really know: Soliciting metamemory judgments reactively enhances children’s learning (2022) · cites this paper as Mitchum, Kelley, and Fox (2016)
In the citing paper
“The positive reactivity effect on children's learning may be accounted for by the positivereactivity theory (Mitchum et al., 2016; Rivers, 2018; Dougherty, Scheck, Nelson, & Narens, 2005), which proposes that positive reactivity is primarily caused by the fact that making item-by-item JOLs encourages learners to adopt more effective encoding strategies and exert greater study effort.”
From When judging what you know changes what you really know: Soliciting metamemory judgments reactively enhances children’s learning (2022) · cites this paper as Mitchum et al., 2016
Citations
Cites
James, W. (1913) · Henry Holt and Company eBooks · doi:10.1037/11059-000 · Cited by 25,226
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Self-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846
The MRC Psycholinguistic Database
Coltheart, M. (1981) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748108400805 · Cited by 2,437
On the Rate of Gain of Information
Hick, W. E. (1952) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215208416600 · Cited by 2,279
The construction of preference.
Slovic, P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.5.364 · Cited by 2,009
Cited by
Items 101–162 of 162
Myers, S. J., Rhodes, M. G., & Loaiza, V. M. (2024) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001176 · Cited by 5
Chang, M., & Brainerd, C. J. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104667 · Cited by 4
Instructed learning strategy use eliminates negative reactivity of immediate judgments of learning
Ingendahl, F., & Undorf, M. (2026) · Psychonomic Bulletin & Review · doi:10.3758/s13423-025-02844-w · Cited by 4
“The changed-goal account (Mitchum et al., 2016) proposes that soliciting JOLs shifts people’s learning goal from mastering all pairs to focusing on pairs perceived as easier (e.g., related pairs) and neglecting pairs perceived as more difficult (e.g., unrelated pairs).”
InfluentialStrategic, Emotional, and Motivational Influences on Metacognition in Older Adulthood
McGillivray, S. (2021) · Springer eBooks · doi:10.1007/978-3-030-51673-4_12 · Cited by 5
Double, K. S., & Birney, D. P. (2017) · Oxford University Research Archive (ORA) (University of Oxford) · Cited by 6
Comparative Approaches to the Natural Ecology of Metacognition
Schwartz, B. L., Pournaghdali, A., & Hess, K. L. (2023) · Comparative Cognition & Behavior Reviews · doi:10.3819/ccbr.2023.180003 · Cited by 4
Evidence of a metacognitive benefit to memory?
Hollins, T. J., & Weber, N. (2016) · Memory · doi:10.1080/09658211.2016.1171363 · Cited by 4
Whatley, M. C., Murphy, D. H., Silaj, K. M., & Castel, A. D. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197528976.003.0003 · Cited by 11
Age-related differences in metacognitive reactivity in younger and older adults
Murphy, D. H., Rhodes, M. G., & Castel, A. D. (2024) · Metacognition and Learning · doi:10.1007/s11409-024-09391-0 · Cited by 4
“Overall, we found negative reactivity, and there was some evidence that this negative reactivity was specific to unrelated word pairs (consistent with some prior work, see Mitchum et al., 2016) with no reactivity for related word pairs.”
BackgroundResultInfluentialWhen confidence reveals more than recognition performance does: The case of context load.
Zaborowska, O., Kuhlmann, B. G., Zawadzka, K., & Hanczakowski, M. (2024) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001391 · Cited by 5
Beyond the Prompt: Investigating Retrieval-Based Monitoring in Self-Regulated Learning
Wu, M., & Was, C. A. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13080099 · Cited by 3
“…observed in the retrieval group likely reflect the well-documented metacognitive benefits of retrieval practice (Karpicke 2009; Kubik et al. 2022; Mitchum et al. 2016; Yang et al. 2017a; Yang et al. 2017b), which could also be the cognitive mechanism that increased the study decision group’s…”
Recognition, remember-know, and confidence judgments: no evidence of cross-contamination here!
Williams, H. L., Bodner, G. E., & Lindsay, D. S. (2023) · Memory · doi:10.1080/09658211.2023.2207804 · Cited by 3
“The idea that task performance can be changed by inclusion of a selfreport measure is referred to as “reactivity,” and this has often been studied in the metacognitive domain (e.g., Double & Birney, 2017, 2018; Fox et al., 2011; Mitchum et al., 2016).”
BackgroundEmotional disparities in JOL reactivity: validating the enhanced learning engagement theory
Guo, Y., Ren, J., Zhang, X., Yuan, Y., & Jiang, Y. (2024) · Current Psychology · doi:10.1007/s12144-024-06520-5 · Cited by 3
“…research suggests that JOLs can indeed exert a direct influence on memory performance, a phenom - enon commonly termed “JOL reactivity” (e.g., Double et al., 2018; Mitchum et al., 2016; Myers et al., 2020; Rivers et al., 2021; Shi et al., 2022; Soderstrom et al., 2015; Zhao et al., 2022, 2023).”
InfluentialJudgments of learning reactively affect memory by inducing covert retrieval
Zhang, X., Guo, Y., Jiang, Y., & Yuan, Y. (2024) · The Journal of General Psychology · doi:10.1080/00221309.2024.2409785 · Cited by 3
“Furthermore, both the changed-goal hypothesis (Mitchum et al., 2016) and the dual-mechanism hypothesis (Janes et al., 2018) focus on negative reactivity effects.”
InfluentialPournaghdali, A., Schwartz, B. L., & Soto, F. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6bxza_v1 · Cited by 3
The Forward Effect of Judgements of Learning on Memory and Transfer in Inductive Learning
Ritter, C., Hausman, H., Gaschler, R., Tiffin‐Richards, S. P., & Kubik, V. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10094-4 · Cited by 2
“…can have similar beneficial forward and backward effects on learning outcomes, which is referred to as positive JOL reactivity , although some studies report null or even negative effects (Double & Birney, 2019; Double et al., 2018; Ingendahl et al., 2025; Mitchum et al., 2016; Zhao et al., 2023).”
Do judgments of learning have reactive effects on learning of foreign language vocabulary?
Elsden, A. G., & Witherby, A. E. (2026) · Metacognition and Learning · doi:10.1007/s11409-026-09465-1 · Cited by 2
Metacognitive Judgment Formation During Map Learning: Evidence for Global Monitoring
Mason, L., Thomas, A. K., & Taylor, H. A. (2023) · Cognition · doi:10.1016/j.cognition.2024.105743 · Cited by 2
Reducing cheap talk? How monetary incentives affect the accuracy of metamemory judgments
Bröder, A., Navarro-Báez, S., & Undorf, M. (2025) · Memory & Cognition · doi:10.3758/s13421-024-01679-5 · Cited by 2
“In recent years, the discussion about JOL reactivity has highlighted that the criterion behavior is malleable and might be influenced by the very act of providing JOLs, either intentionally or unintentionally (Double & Birney, 2019; Mitchum et al., 2016; Soder-strom et al., 2015).”
Do metamemory judgments impair relational encoding?
Churey, K. R., Laursen, S. J., & Fiacconi, C. M. (2025) · Metacognition and Learning · doi:10.1007/s11409-025-09424-2 · Cited by 2
“That is, JOLs can induce reactive shifts in encoding as measured by subsequent memory performance – a pattern referred to as JOL reactivity (Double et al., 2018; Kaya & Mulligan, 2024; Mitchum et al., 2016; Zhao et al., 2023).”
The Mason: Health Starts Here Prospective Cohort StudyPreprint
Cuellar, A. E., Adams, L. M., de Jonge, E., Espina, V. A., Espinoza, L., Fischer, S. F., Frankenfeld, C. L., Hines, D. A., Kornienko, O., Lawrence, H. Y., et al. (2020) · Research Square · doi:10.21203/rs.3.rs-115934/v1 · Cited by 2
“For example, participants may be triggered to answer survey questions “appropriately” (so-called “reactivity” effects, or to address unfavorable health-related behaviors through merely being asked about them (96).”
BackgroundJOL reactivity in negative faces memory: an examination of the changed-goal hypothesis
Guo, Y., Zhang, X., Yuan, Y., Long, Y., Cong, P., & Jiang, Y. (2025) · The Journal of General Psychology · doi:10.1080/00221309.2025.2478003 · Cited by 1
“This finding is consistent with the prediction of the changed-goal hypothesis (Mitchum et al., 2016).”
InfluentialTang, H., Zhao, W., Li, B., Liu, S., Li, A., Hu, M., Hu, X., Luo, L., & Yang, C. (2025) · Metacognition and Learning · doi:10.1007/s11409-025-09439-9 · Cited by 1
“Moreover, previous studies generally determined the nature of the reactivity effect about whether it is positive (Li et al., 2021; Witherby & Tauber, 2017; Zhao et al., 2022) or negative (Mitchum et al., 2016 ) based on a single measure of final test performance.”
InfluentialDiminished reactivity effect of confidence rating on perceptual decision-making in depression
Zhang, L., Liu, Y., Wang, Y., Gong, K., Liu, K., Lei, W. I., & Chen, J. (2025) · Frontiers in Neuroscience · doi:10.3389/fnins.2025.1638734 · Cited by 1
“…confidence judgments from participants may induce reactivity effects on task performance (Bonder and Gopher, 2019; Double and Birney, 2017, 2018; Lei et al., 2020; Li et al., 2024; Mitchum et al., 2016), specifically measurable alterations in decision response times (RTs) or decision accuracy.”
The impact of thought probes and other encoding interruptions on memory
Murphy, D. H., & Brewer, G. A. (2025) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218251398503 · Cited by 1
“…2015), enhance the encoding of item-specific information (Senkova & Otani, 2021), modify attention (Castel et al., 2012), or change a learner’s goals (Mitchum et al., 2016), and metacognitive reactivity may be attributable to several of these mechanisms (see Janes et al., 2018; Myers et al., 2020).”
Rating our certainty: how confidence judgments amplify belief polarization
Double, K. S., Pinkus, R. T., Landfear, R., Carnegie, P., Dowell, S., & Goldwater, M. B. (2026) · Psychological Research · doi:10.1007/s00426-026-02239-z · Cited by 1
“In contrast, others have observed that making metacognitive ratings can impede deeper learning or reinforce preexisting beliefs (Double et al., 2025a; Mitchum et al., 2016 ).”
Confidence judgments, feelings of knowing and judgments of learning: Towards a common framework
Koriat, A. (2026) · Memory & Cognition · doi:10.3758/s13421-026-01874-6 · Cited by 1
“Extensive research indicated that making JOLs may alter learning and memory (Mitchum et al., 2016; Soderstrom et al., 2015; Spellman & Bjork, 1992; for recent reviews, see Ingendahl, Halamish, et al., 2025; Ingendahl & Undorf, 2025).”
Czerwonka, M., Benedek, M., Zielińska, A., & Lebuda, I. (2026) · Learning and Individual Differences · doi:10.1016/j.lindif.2026.102872 · Cited by 1
Metamemory: An update of critical findings
Schwartz, B. L., & Metcalfe, J. (2023) · Elsevier eBooks · doi:10.1016/b978-0-443-15754-7.00004-3 · Cited by 1
Increased metamemory accuracy with practice does not require practice with metamemory
West, J. T., Kuhns, J. M., Touron, D. R., & Mulligan, N. W. (2024) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241269322 · Cited by 2
“This perspective has been applied to situations in which JOLs interfere with memory encoding (Mitchum et al., 2016; see Rivers et al., 2021, for related discussion) but also implies that the demands of memory encoding impact monitoring processes.”
InfluentialSchnaubert, L. (2019) · DuEPublico (University of Duisburg-Essen) · doi:10.17185/duepublico/70041 · Cited by 1
Tekin, E. (2017) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k74j0dj4
“Yet, in Experiment 1, the JOL condition demonstrated enhanced retention for shallower tasks, compared to the Intentional and the Delay conditions, a result that was in the opposite direction of suggested explanations by Mitchum et al. (2016) and Soderstrom et al. (2015).”
BackgroundResultMetamnemonic predictions of lineup identification
McKinley, G. L., Benjamin, A. S., & Gronlund, S. D. (2023) · Memory · doi:10.1080/09658211.2023.2218123
Research and Enlightenment of the Metacognitive Illusions in Judgment of Learning
王, 景. (2024) · Advances in Social Sciences · doi:10.12677/ass.2024.13111047
Le, N. D. (2025) · Roczniki Psychologiczne · doi:10.18290/rpsych2024.0017
“However, the findings on no reactivity on pure lists, found in some studies, may be explained only in terms of the changed-goal hypothesis (Janes et al., 2018; Mitchum et al., 2016).”
InfluentialThe Influence of Judgments of Learning on Collaborative Memory for Items and Sequences
Luo, X., Xiao, Q., & Tang, W. (2025) · Behavioral Sciences · doi:10.3390/bs15070905
“However, the dual-task costs (encoding plus making JOLs) suggest that making JOLs might borrow limited cognitive resources from the primary learning task, leading to a weaker encoding of temporal information (Mitchum et al., 2016).”
InfluentialAre memorability judgements suggestible?
Wan, Y., Nash, R. A., & Pennington, C. R. (2025) · Memory · doi:10.1080/09658211.2025.2550409
“For instance, when people assign low JOLs to study materials, they often allocate more study time for encoding those items (Mitchum et al., 2016; Nelson & Leonesio, 1988; Thiede & Dunlosky, 1999).”
Lakhlifi, C., Lejeune, F., Rouault, M., Khamassi, M., & Rohaut, B. (2024) · Figshare · doi:10.6084/m9.figshare.26583951
Chang, M. (2022) · eCommons (Cornell University) · doi:10.7298/mt4a-0092
Cue learning in metamemory: understanding how people learn to judge memory
Navarro-Báez, S. (2024) · MADOC (University of Mannheim)
Was That My Cue? Reactivity to Category-Level Judgments of Learning
Cruz, A., & Minda, J. P. (2024) · eScholarship (California Digital Library) · Cited by 5
Balthasart, E. (2024) · ORBi (University of Liège)
A systematic review and investigation of judgment of learning (JoL) reactivity
Chilcott, L. (2023) · ePrints Soton (University of Southampton) · Cited by 1
Van Tress, J. J. (2020) · ScholarWorks (Walden University)
Maxwell, N. P., & Adkins, M. (2026) · Memory · doi:10.1080/09658211.2026.2645631
“Consistent with this notion, Mitchum et al. (2016) proposed a changed-goals account of reactivity, which posits that having participants make JOLs at encoding lets them more easily distinguish between easy and difficult items.”
Fernandez, J. (2017) · theses.fr (ABES) · doi:10.70675/c7ad77ddz9976z4beeza5b9zd163df512099 · Cited by 7
Towards a unified view of metacognition : Insights from metamemory
Mazancieux, A. (2020) · theses.fr (ABES) · doi:10.70675/f37dcebbz4e30z4da4za014z74039ef3666f · Cited by 1
Must we do this again? Evaluating JOL carryover effects in cued-recall
Morehead, A. G., Huff, M. J., & Maxwell, N. P. (2026) · Memory · doi:10.1080/09658211.2026.2652400
“On unrelated pairs, however, JOLs are non-reactive (Maxwell & Huff, 2022, 2023; Soderstrom et al., 2015), or result in memory cost (i.e., negative reactivity ; Mitchum et al., 2016; Undorf et al., 2024).”
The Metamemory Expectancy Illusion in Source Monitoring Affects Metamemory Control and MemoryPreprint
Bayen, U. J., & Schaper, M. L. (2020) · OSF Preprints (OSF Preprints)
Judgments of learning modify memory even when made covertly or using a non-numerical scale
Halamish, V., Meer, Y., & Undorf, M. (2026) · Metacognition and Learning · doi:10.1007/s11409-026-09471-3
Navigational metacognition in aging: Encoding strategies and spatial representation
Lloyd, M. R., & Moffat, S. D. (2026) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2026.109492
Ingendahl, F., & Undorf, M. (2026) · Metacognition and Learning · doi:10.1007/s11409-026-09479-9
“Our findings are partially consistent with the changed-goal account (Mitchum et al., 2016).”
InfluentialCombined Oral Contraceptive Use and Binge Eating
Klump, K. L., Dio, A. M. D., Anaya, C., Mikhail, M. E., Burt, S. A., Sisk, C. L., Keel, P. K., Katzman, D. K., Neale, M. C., Ackerman, L., et al. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.19047
An afforded elaboration mechanism of judgment of learning reactivity
Scholten, F., & Niese, Z. A. (2026) · Metacognition and Learning · doi:10.1007/s11409-026-09478-w
“…2015; Witherby & Tauber, 2017), whereas unrelated word pairs either produce no reactivity or negative reactivity, in which participants who provide JOLs perform worse than those who do not provide JOLs (Halamish & Undorf, 2023 ; Mitchum et al., 2016; Undorf et al., 2024; Witherby et al., 2023).”
InfluentialLiu, M., Qi, Y., Hu, M., Su, N., & Li, B. (2026) · Journal of Intelligence · doi:10.3390/jintelligence14070145
“Prior research has primarily examined whether making JOLs changes later memory and has shown that such memory-level reactivity varies substantially across materials and task conditions (Double et al., 2018; Ingendahl et al., 2025; Mitchum et al., 2016; Soderstrom et al., 2015).”
InfluentialJudgment of Learning Reactivity for Emotional Faces
Lemler, M. O., Bialer, D. M., & Chang, M. (2026) · Behavioral Sciences · doi:10.3390/bs16081443
“This prediction was supported by evidence of negative reactivity for semantically unrelated word pairs, but positive or null reactivity for semantically related word pairs (Janes et al., 2018; Mitchum et al., 2016; Undorf et al., 2024).”
Making Judgments of Learning (JOLs) for Others Produces Positive Reactivity
Wei, Y., Soderstrom, N. C., & Meade, M. L. (2026) · Behavioral Sciences · doi:10.3390/bs16091542
“Importantly, however, there is also evidence that JOLs impair memory performance (negative reactivity, e.g., Halamish & Undorf, 2020; Ingendahl & Undorf, 2026; Mitchum et al., 2016; Zhao et al., 2023).”
Physicians’ metacognition in medical decision-making
Lakhlifi, C., Kouzy, R., Lejeune, F., Beuzon, N., Mawet, J., Roos, C., Khamassi, M., Rohaut, B., & Rouault, M. (2026) · Neuroscience of Consciousness · doi:10.1093/nc/niag064 · Cited by 1
“…some-times impact accuracy itself, a phenomenon known as confidence reactivity; either enhancing performance by activating participants’ metacognition or diminishing performance by diverting cognitive resources to the metacognitive judgments ( Mitchum et al. 2016, Double and Birney 2019a, 2019b).”
Ingendahl, F., & Undorf, M. (2026) · Psychonomic Bulletin & Review · doi:10.3758/s13423-026-03030-2
“…account (Soder-strom et al., 2015) explaining positive reactivity as a result of increased processing of cues, the dual-task account (Mitchum et al., 2016) proposing that negative reactivity stems from JOLs interfering with learning, and the changed-goal account (Mitchum et al.,…”
InfluentialChen, Y., & Kitagami, S. (2026) · The Japanese Journal of Cognitive Psychology · doi:10.5265/jcogpsy.2605
Metadata
- Authors
- Mitchum, A. L., Kelley, C. M., & Fox, M. C.
- Affiliations
- Florida State University (US)
- Venue
- Journal of Experimental Psychology: General
- Published
- 2016
- Volume
- 145
- Issue
- 2
- Pages
- 200-219
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2479323233
- Cited by
- 148
- References
- 85
- Citations by year
- 2026: 16 · 2025: 18 · 2024: 19 · 2023: 21 · 2022: 11 · 2021: 16 · 2020: 15 · 2019: 9 · 2018: 7 · 2017: 12 · 2016: 3
- FWCI
- 6.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology General (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- judgments of learning, metamemory, metacognitive monitoring, self-report bias, measurement effects, study time allocation, memory performance, metacognition, response scales, metacognitive regulation
- MeSH terms
- Metacognition, Adult, Humans, Judgment, Learning, Mental Recall, Word Association Tests, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.