Dissociating hippocampal and striatal contributions to sequential prediction learning
Open accessThe DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
Behavior may be generated on the basis of many different kinds of learned contingencies. For instance, responses could be guided by the direct association between a stimulus and response, or by sequential stimulus–stimulus relationships (as in model‐based reinforcement learning or goal‐directed actions). However, the neural architecture underlying sequential predictive learning is not well understood, in part because it is difficult to isolate its effect on choice behavior. To track such learning more directly, we examined reaction times (RTs) in a probabilistic sequential picture identification task in healthy individuals. We used computational learning models to isolate trial‐by‐trial effects of two distinct learning processes in behavior, and used these as signatures to analyse the separate neural substrates of each process. RTs were best explained via the combination of two delta rule learning processes with different learning rates. To examine neural manifestations of these learning processes, we used functional magnetic resonance imaging to seek correlates of time‐series related to expectancy or surprise. We observed such correlates in two regions, hippocampus and striatum. By estimating the learning rates best explaining each signal, we verified that they were uniquely associated with one of the two distinct processes identified behaviorally. These differential correlates suggest that complementary anticipatory functions drive each region’s effect on behavior. Our results provide novel insights as to the quantitative computational distinctions between medial temporal and basal ganglia learning networks and enable experiments that exploit trial‐by‐trial measurement of the unique contributions of both hippocampus and striatum to response behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256 · cited 2×
“encoding (McClelland et al., 1995), and striatum with more incremental procedural learning (Knowlton et al.”
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 3×
“…are unlikely to relate to the reward prediction errors posited by these models (Delgado et al., 2000; Knutson et al., 2001; O’Doherty et al., 2003; McClure et al., 2004; Hare et al., 2008), but could relate to other non-reward correlates in striatum (Zink et al., 2006; Wittmann et al., 2008).”
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 5×
“Such activity may reflect differential engagement of either system under different conditions of uncertainty (Daw et al., 2005).”
InfluentialSelf-citationAnticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224
Self-citationA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 3×
“learning (Doya, 1999; Daw et al., 2005; Niv et al., 2006; Johnson and Redish 2005; Rangel et al., 2008; Balleine et al., 2008; Doll et al., 2009) and also known as constructive episodic simulation (Tulving &”
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“In particular, whereas much work has examined the brain’s mechanisms for ‘model-free’ reinforcement learning (RL) of action policies (Houk et al., 1995; Montague et al., 1996), decisions may also be evaluated by anticipating their consequences using learned predictive associations among…”
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983 · cited 1×
“…that hippocampus forms associations preferentially at the detection of sufficiently large deviations from expected input (Tulving et al., 1996; Lisman & Grace, 2005; Bakker et al., 2008), or when task demands enhance the motivational salience of expectancy violations (Duncan et al., 2009).”
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916
The cognitive neuroscience of constructive memory: remembering the past and imagining the future
Schacter, D. L., & Addis, D. R. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2087 · Cited by 1,836 · cited 1×
“…a strategy formalized by model-based reinforcement learning (Doya, 1999; Daw et al., 2005; Niv et al., 2006; Johnson and Redish 2005; Rangel et al., 2008; Balleine et al., 2008; Doll et al., 2009) and also known as constructive episodic simulation (Tulving & Thomson, 1971; Schacter & Addis, 2007).”
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“…of deliberative processing, to which model-based RL might correspond, often take their representations to be rule-based or categorical, in contrast to more graded representations learned in an incremental fashion by (model-free) procedural systems (Packard & Knowlton, 2002; Maddox & Ashby, 2004).”
Bar, M. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1476 · Cited by 1,613
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · cited 2×
“Lesions in rodents support a dissociation between decision strategies along the lines of model-based vs model-free learning, supported by distinct networks neurally (Balleine and Dickinson 1998; Corbit and Balleine 2000; Gerlai 1998; Balleine et al. 2008).”
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Eichenbaum (2004) · doi:10.1016/j.neuron.2004.08.028 · Cited by 1,464
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 2×
“…error-driven learning algorithms such as the Rescorla & Wagner (1972) model predict that the coefficients for these indicators should decline exponentially with the number of image presentations into the past (Bayer & Glimcher, 2005), we fitted exponential functions to the regression weights.”
Forward and reverse hippocampal place-cell sequences during ripples
Diba, K., & Buzsáki, G. (2007) · Nature Neuroscience · doi:10.1038/nn1961 · Cited by 1,205
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · cited 7×
“…up on the results of this analysis, we considered a more constrained learning rule – again, of the form proposed by Rescorla & Wagner (1972; see also Gläscher et al., 2010) – which updates entries in a 4 · 4 stimulus–stimulus conditional probability matrix in light of each trial’s experience.”
InfluentialSelf-citationInteractive memory systems in the human brain
Poldrack, R. A., Clark, J., Paré-Blagoev, E. J., Shohamy, D., Creso Moyano, J., Myers, C., & Gluck, M. A. (2001) · Nature · doi:10.1038/35107080 · Cited by 1,132
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116 · cited 3×
“…involvement of rewards (or errors) in our task, our striatal results are unlikely to relate to the reward prediction errors posited by these models (Delgado et al., 2000; Knutson et al., 2001; O’Doherty et al., 2003; McClure et al., 2004; Hare et al., 2008), but could relate to other non-reward…”
The role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003 · cited 2×
“The suggestion that our hippocampal BOLD effects reflect preparatory ‘prefetching’ of the anticipated next elements in the sequence coincides with observations of ‘preplay’ activity in this structure in rodents (Ferbinteanu & Shapiro, 2003; Diba & Buszáki, 2007; Johnson & Redish, 2007).”
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · cited 2×
“Thus our approach parallels recent work in reward learning and decision-making (O’Doherty et al., 2003; Barraclough et al., 2004; Samejima et al., 2005; Lohrenz et al., 2007), but we apply these methods to investigate behavior that results from sequential contingency learning, while minimizing the…”
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Competition among multiple memory systems: converging evidence from animal and human brain studies
Poldrack, R. A., & Packard, M. G. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00157-4 · Cited by 880 · cited 1×
“Indeed, such a pattern bears strong similarity to that repeatedly observed in probabilistic association learning tasks (Poldrack et al., 2001; Poldrack & Packard, 2003).”
A hierarchy of temporal receptive windows in human cortex
Hasson, U., Yang, E., Vallines, I., Heeger, D. J., & Rubin, N. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5487-07.2008 · Cited by 874
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792 · cited 2×
“…are unlikely to relate to the reward prediction errors posited by these models (Delgado et al., 2000; Knutson et al., 2001; O’Doherty et al., 2003; McClure et al., 2004; Hare et al., 2008), but could relate to other non-reward correlates in striatum (Zink et al., 2006; Wittmann et al., 2008).”
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · cited 2×
“However, simply seeking the correlates of these time-series in a GLM (Tanaka et al., 2004; Gläscher & Buchel, 2005) is statistically inefficient because the versions of our variables of interest calculated at different values of a are highly correlated (average correlation across participants between slow and fast lea…”
A specific role for posterior dorsolateral striatum in human habit learning
Tricomi, E., Balleine, B. W., & O’Doherty, J. P. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06796.x · Cited by 769
What's new with the amnesic patient H.M.?
Corkin, S. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn726 · Cited by 726
Solomon, P. R., Vander Schaaf, E. R., Thompson, R. F., & Weisz, D. J. (1986) · Behavioral Neuroscience · doi:10.1037/0735-7044.100.5.729 · Cited by 724
Amphetamine-induced dopamine release in human ventral striatum correlates with euphoria
Drevets, W. C., Gautier, C., Price, J. C., Kupfer, D. J., Kinahan, P. E., Grace, A. A., Price, J. L., & Mathis, C. A. (2001) · Biological Psychiatry · doi:10.1016/s0006-3223(00)01038-6 · Cited by 706 · cited 1×
“…by the Automated Anatomical Labeling (AAL) atlas (Tzourio-Mazoyer et al., 2002), and anterior ventral striatum (caudate and putamen), defined (after Drevets et al., 2001) by taking the portion of the relevant AAL masks below the ventralmost extent of the lateral ventricles [in Montreal…”
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678 · cited 2×
“Thus our approach parallels recent work in reward learning and decision-making (O’Doherty et al., 2003; Barraclough et al., 2004; Samejima et al., 2005; Lohrenz et al., 2007), but we apply these methods to investigate behavior that results from sequential contingency learning, while minimizing the…”
An fMRI Study of the Role of the Medial Temporal Lobe in Implicit and Explicit Sequence Learning
Schendan, H. E., Searl, M. M., Melrose, R. J., & Stern, C. E. (2003) · Neuron · doi:10.1016/s0896-6273(03)00123-5 · Cited by 610 · cited 1×
“Effects of serial expectation on RTs (Bahrick, 1954) and BOLD responses (Huettel et al., 2002; Harrison et al., 2006; Schendan et al. 2003) are well established; we exploit these effects to study how participants learned expectations trial-by-trial.”
Determining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501 · cited 2×
“1996), decisions may also be evaluated by anticipating their consequences using learned predictive associations among non-rewarding states or events, as for locations in a cognitive map (Doya 1999; Daw et al. 2005; Rangel et al. 2008; Redish et al. 2008; Fermin et al. 2010).”
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498
Learning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495 · cited 2×
“This prediction parallels previous work demonstrating that humans (Behrens et al., 2007; Speekenbrink & Shanks, 2010) and animals (Dayan et al., 2000; Courville et al., 2006; Preuschoff & Bossaerts, 2007) modulate their learning rates in response to the volatility of changes in associational…”
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457
Self-citationSchönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Self-citationRobust Conjunctive Item–Place Coding by Hippocampal Neurons Parallels Learning What Happens Where
Komorowski, R. W., Manns, J. R., & Eichenbaum, H. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1378-09.2009 · Cited by 372 · cited 2×
“depending on the relations involved (Komorowski et al., 2009).”
Learning latent structure: carving nature at its joints
Gershman, S. J., & Niv, Y. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.008 · Cited by 326
A Dual Role for Prediction Error in Associative Learning
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn161 · Cited by 306
Self-citationStriatal Prediction Error Modulates Cortical Coupling
den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J., & Stephan, K. E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4458-09.2010 · Cited by 304 · cited 3×
“We also obtained a T1-weighted, high-resolution anatomical image (MPRAGE, 1 · 1 · 1 mm) for normalization and localizing functional activations.”
A reservoir of time constants for memory traces in cortical neurons
Bernacchia, A., Seo, H., Lee, D., & Wang, X.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2752 · Cited by 292 · cited 2×
“2008), and even between different neurons within an area (Bernacchia et al. 2011).”
Striatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277 · cited 6×
“Participants performed a Serial Reaction Time (SRT) task, in which they were instructed to label each of a continuous sequence of image stimuli (Figure 1b) according to a predetermined one-to-one mapping of each of four keys to each of four natural scene images (Wittmann et al. 2008).”
InfluentialSelf-citationA normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251
Dissociating Hippocampal versus Basal Ganglia Contributions to Learning and Transfer
Myers, C. E., Shohamy, D., Gluck, M. A., Grossman, S., Kluger, A., Ferris, S., Golomb, J., Schnirman, G., & Schwartz, R. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321208123 · Cited by 243
LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
Corrado, G. S., Sugrue, L. P., Seung, H. S., & Newsome, W. T. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.23-05 · Cited by 206
A computational model of event segmentation from perceptual prediction
Reynolds, J. R., Zacks, J. M., & Braver, T. S. (2007) · Cognitive Science · doi:10.1080/15326900701399913 · Cited by 172
Adding prediction risk to the theory of reward learning
PREUSCHOFF, K., & BOSSAERTS, P. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.005 · Cited by 133 · cited 2×
“…prediction parallels previous work demonstrating that humans (Behrens et al., 2007; Speekenbrink & Shanks, 2010) and animals (Dayan et al., 2000; Courville et al., 2006; Preuschoff & Bossaerts, 2007) modulate their learning rates in response to the volatility of changes in associational structure.”
Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118 · cited 2×
“For the former, in our experience (Daw et al., 2006, 2011; Schoenberg et al., 2007, 2010; Gershman et al., 2009; Daw, 2010), enforcing common model parameters provides a simple regularization that improves the reliability of population-level neural results.”
Self-citationModel-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data
Gläscher, J. P., & O'Doherty, J. P. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.57 · Cited by 104 · cited 1×
“We used a strategy of model-based fMRI analysis (Gläscher & O’Doherty, 2010), analogous to an approach often used with rewardrelated learning.”
Evidence for model-based action planning in a sequential finger movement task
Fermin, A., Yoshida, T., Ito, M., Yoshimoto, J., & Doya, K. (2010) · Journal of Motor Behavior · doi:10.1080/00222895.2010.526467 · Cited by 36 · cited 1×
“…Montague et al., 1996), decisions may also be evaluated by anticipating their consequences using learned predictive associations among non-rewarding states or events, as for locations in a cognitive map (Doya, 1999; Daw et al., 2005; Rangel et al., 2008; Redish et al., 2008; Fermin et al., 2010).”
Cited by
Domain generality versus modality specificity: the paradox of statistical learning
Frost, R., Armstrong, B. C., Siegelman, N., & Christiansen, M. H. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.12.010 · Cited by 564
Schapiro, A. C., Turk-Browne, N. B., Botvinick, M. M., & Norman, K. A. (2017) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0049 · Cited by 487
The ubiquity of model-based reinforcement learning
Doll, B. B., Simon, D. A., & Daw, N. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.08.003 · Cited by 380
Self-citationOver the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex
Wikenheiser, A. M., & Schoenbaum, G. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.56 · Cited by 359
How the hippocampus preserves order: the role of prediction and context
Davachi, L., & DuBrow, S. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.12.004 · Cited by 328
Metadata
- Authors
- Bornstein, A. M., & Daw, N. D.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2012-04
- Volume
- 35
- Issue
- 7
- Pages
- 1011-1023
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2143963089
- Cited by
- 124
- References
- 59
- FWCI
- 4.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.