How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis
Open accessThe DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
Instrumental learning involves corticostriatal circuitry and the dopaminergic system. This system is typically modeled in the reinforcement learning (RL) framework by incrementally accumulating reward values of states and actions. However, human learning also implicates prefrontal cortical mechanisms involved in higher level cognitive functions. The interaction of these systems remains poorly understood, and models of human behavior often ignore working memory (WM) and therefore incorrectly assign behavioral variance to the RL system. Here we designed a task that highlights the profound entanglement of these two processes, even in simple learning problems. By systematically varying the size of the learning problem and delay between stimulus repetitions, we separately extracted WM‐specific effects of load and delay on learning. We propose a new computational model that accounts for the dynamic integration of RL and WM processes observed in subjects’ behavior. Incorporating capacity‐limited WM into the model allowed us to capture behavioral variance that could not be captured in a pure RL framework even if we (implausibly) allowed separate RL systems for each set size. The WM component also allowed for a more reasonable estimation of a single RL process. Finally, we report effects of two genetic polymorphisms having relative specificity for prefrontal and basal ganglia functions. Whereas the COMT gene coding for catechol‐O‐methyl transferase selectively influenced model estimates of WM capacity, the GPR6 gene coding for G‐protein‐coupled receptor 6 influenced the RL learning rate. Thus, this study allowed us to specify distinct influences of the high‐level and low‐level cognitive functions on instrumental learning, beyond the possibilities offered by simple RL models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“In particular, phasic changes in the firing of dopaminergic cells (Montague et al. , 1996; Schultz, 1997; Bayer & Glimcher, 2005, etc.) have been shown to encode a signal corresponding to the crucial RL quantity of the reward prediction error, defined as the difference between the expected and…”
BackgroundBarto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 2×
“This point is reminiscent of that of Daw et al. (2005), but here the arbitration between the RL and WM systems is determined by direct estimates of their relative values or reliabilities, rather than the uncertainties about them.”
BackgroundEffect of COMT Val 108/158 Met genotype on frontal lobe function and risk for schizophrenia
Egan, M. F., Goldberg, T. E., Kolachana, B. S., Callicott, J. H., Mazzanti, C. M., Straub, R. E., Goldman, D., & Weinberger, D. R. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.111134598 · Cited by 2,381
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 1×
“In particular, phasic changes in the firing of dopaminergic cells (Montague et al. , 1996; Schultz, 1997; Bayer & Glimcher, 2005, etc.) have been shown to encode a signal corresponding to the crucial RL quantity of the reward prediction error, defined as the difference between the expected and…”
BackgroundLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Model-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779
Discrete fixed-resolution representations in visual working memory
Zhang, W., & Luck, S. J. (2008) · Nature · doi:10.1038/nature06860 · Cited by 1,622
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
In two minds: dual-process accounts of reasoning
Evans, J. S. B. T. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.08.012 · Cited by 1,569
Bayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 1×
“Other model parameters implemented more continuous aspects of WM limitations, through precision or temporal stability (Bays & Husain, 2008), but the COMT effects were selective to the discrete capacity.”
MethodThe Magical Mystery Four: How Is Working Memory Capacity Limited, and Why?
Cowan, N. (2010) · Current Directions in Psychological Science · doi:10.1177/0963721409359277 · Cited by 1,255 · cited 1×
“Notably, the capacity estimate ranged between 3 and 4 for most subjects, coherent with the widely accepted values in the existing literature (Cowan, 2010).”
Dynamic Shifts of Limited Working Memory Resources in Human Vision
Bays, P. M., & Husain, M. (2008) · Science · doi:10.1126/science.1158023 · Cited by 1,117
O'Reilly, R. C., & Frank, M. J. (2006) · Neural Computation · doi:10.1162/089976606775093909 · Cited by 1,066
Self-citationRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · cited 1×
“Further, neural correlates of RL values and prediction errors have consistently implicated the striatum in monkey and rat electrophysiology and human functional imaging (O’Doherty et al. , 2004; Samejima et al. , 2005; Pessiglione et al. , 2006; Lau & Glimcher, 2007; Jocham et al. , 2011).”
BackgroundFrank, M. J. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929052880093 · Cited by 925
Self-citationTransfer of Learning After Updating Training Mediated by the Striatum
Dahlin, E., Neely, A. S., Larsson, A., Bäckman, L., & Nyberg, L. (2008) · Science · doi:10.1126/science.1155466 · Cited by 892 · cited 1×
“Indeed, some evidence indicates that improvements in performance due to cognitive training on WM updating tasks are related to striatal activation (Dahlin et al. , 2008).”
BackgroundInteractions between frontal cortex and basal ganglia in working memory: A computational model
FRANK, M. J., LOUGHRY, B., & O'REILLY, R. C. (2001) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.1.2.137 · Cited by 879 · cited 1×
“…learning, in other work we have emphasized an analogous role of other BG circuits in the learning of when and when not to gate information into WM (Frank et al. , 2001; O’Reilly & Frank, 2006; Frank & Badre, 2011; Collins & Frank, unpublished data; see also Todd et al. , 2008; Gruber et al. ,…”
BackgroundSelf-citationGogos, J. A., Morgan, M., Luine, V., Santha, M., Ogawa, S., Pfaff, D., & Karayiorgou, M. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.17.9991 · Cited by 864
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · cited 1×
“…data, including electrophysiology (Corrado & Doya, 2007), functional magnetic resonance imaging (O’Doherty et al. , 2004, 2007; Seymour et al. , 2004; Tanaka et al. , 2004, 2006; Daw & Doya, 2006; Pessiglione et al. , 2006; Scho¨nberg et al. , 2007; Brovelli et al. , 2008; Kahnt et al. , 2009),…”
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 683
Self-citationHierarchically organized behavior and its neural foundations: A reinforcement learning perspective
Botvinick, M. M., Niv, Y., & Barto, A. G. (2009) · Cognition · doi:10.1016/j.cognition.2008.08.011 · Cited by 646
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 4×
“Activity and plasticity in striatal neurons, a major target of dopaminergic efferents, are dynamically sensitive to these dopaminergic prediction error signals, which enable the striatum to represent RL values (O’Doherty et al. , 2004; Frank, 2005; Daw & Doya, 2006).”
BackgroundMethodInfluentialDurstewitz, D., & Seamans, J. K. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.015 · Cited by 586 · cited 1×
“Met-allele versions of this enzyme are less efficient in degrading dopamine, thereby enabling sustained dopamine levels to persist in the PFC, and promoting the stability of actively encoded WM representations (Durstewitz & Seamans, 2008; Durstewitz et al. , 2010).”
BackgroundSesack, S. R., Hawrylak, V. A., Matus, C., Guido, M. A., & Levey, A. I. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-07-02697.1998 · Cited by 582
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O'DOHERTY, J. P., HAMPTON, A., & KIM, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 508
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498
Frank, M. J., Doll, B. B., Oas-Terpstra, J., & Moreno, F. (2009) · Nature Neuroscience · doi:10.1038/nn.2342 · Cited by 471
Self-citationFrontal theta links prediction errors to behavioral adaptation in reinforcement learning
Cavanagh, J. F., Frank, M. J., Klein, T. J., & Allen, J. J. B. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.11.080 · Cited by 469
Self-citationThe computational neurobiology of learning and reward
Daw, N. D., & Doya, K. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.006 · Cited by 465
Neural substrates of pleiotropic action of genetic variation in COMT: a meta-analysis
Mier, D., Kirsch, P., & Meyer-Lindenberg, A. (2010) · Molecular Psychiatry · doi:10.1038/mp.2009.36 · Cited by 464 · cited 1×
“A recent meta-analysis showed that the COMT genotype reliably affects prefrontal activation (effect size d = 0.73), with an advantage for met carriers in executive function (Mier et al. , 2010).”
BackgroundInfluentialTrial-by-trial data analysis using computational models
Daw, N. D. (2011) · Decision Making, Affect, and Learning · doi:10.1093/acprof:oso/9780199600434.003.0001 · Cited by 456
Tunbridge, E. M. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.1124-04.2004 · Cited by 418
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Matsumoto, M., Weickert, C. S., Akil, M., Lipska, B. K., Hyde, T. M., Herman, M. M., Kleinman, J. E., & Weinberger, D. R. (2003) · Neuroscience · doi:10.1016/s0306-4522(02)00556-0 · Cited by 367
Genes and the parsing of cognitive processes
Goldberg, T. E., & Weinberger, D. R. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.05.011 · Cited by 356 · cited 1×
“…the executive function literature, showing better WM, attention or goal-directed performance for homozygous met allele carriers (Egan et al. , 2001; Goldberg & Weinberger, 2004; Blasi et al. , 2005; Bruder et al. , 2005; Frank et al. , 2007, 2009a; Tan et al. , 2007; Green et al. , 2008; Doll et…”
BackgroundDurstewitz, D., Vittoz, N. M., Floresco, S. B., & Seamans, J. K. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.029 · Cited by 351
Gene expression analyses reveal molecular relationships among 20 regions of the human CNS
Roth, R. B., Hevezi, P., Lee, J., Willhite, D., Lechner, S. M., Foster, A. C., & Zlotnik, A. (2006) · Neurogenetics · doi:10.1007/s10048-006-0032-6 · Cited by 342
Frank, M. J., & Badre, D. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr114 · Cited by 337
Self-citationEffect of Catechol- O -Methyltransferase val 158 met Genotype on Attentional Control
Blasi, G., Mattay, V. S., Bertolino, A., Elvevåg, B., Callicott, J. H., Das, S., Kolachana, B. S., Egan, M. F., Goldberg, T. E., & Weinberger, D. R. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0476-05.2005 · Cited by 294 · cited 1×
“…function literature, showing better WM, attention or goal-directed performance for homozygous met allele carriers (Egan et al. , 2001; Goldberg & Weinberger, 2004; Blasi et al. , 2005; Bruder et al. , 2005; Frank et al. , 2007, 2009a; Tan et al. , 2007; Green et al. , 2008; Doll et al. , 2011).”
BackgroundUsing genetic data in cognitive neuroscience: from growing pains to genuine insights
Green, A. E., Munafò, M. R., DeYoung, C. G., Fossella, J. A., Fan, J., & Gray, J. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2461 · Cited by 279
Jocham, G., Klein, T. A., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3904-10.2011 · Cited by 278 · cited 2×
“…during learning, but that these striatal signals do not influence learning rates during acquisition itself; nevertheless, they are strongly predictive of subsequent choice indices measuring the extent to which learning was sensitive to probabilistic reward contingencies (Jocham et al. , 2011).”
BackgroundCools, R., Sheridan, M., Jacobs, E., & D'Esposito, M. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0601-07.2007 · Cited by 277
Bruder, G. E., Keilp, J. G., Xu, H., Shikhman, M., Schori, E., Gorman, J. M., & Gilliam, T. C. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.05.010 · Cited by 260
COMT genotype predicts cortical-limbic D1 receptor availability measured with [11C]NNC112 and PET
Slifstein, M., Kolachana, B., Simpson, E. H., Tabares, P., Cheng, B., Duvall, M., Gordon Frankle, W., Weinberger, D. R., Laruelle, M., & Abi-Dargham, A. (2008) · Molecular Psychiatry · doi:10.1038/mp.2008.19 · Cited by 195
A Neural Signature of Hierarchical Reinforcement Learning
Ribas-Fernandes, J. J. F., Solway, A., Diuk, C., McGuire, J. T., Barto, A. G., Niv, Y., & Botvinick, M. M. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.042 · Cited by 195
Dopamine modulation in the basal ganglia locks the gate to working memory
Gruber, A. J., Dayan, P., Gutkin, B. S., & Solla, S. A. (2006) · Journal of Computational Neuroscience · doi:10.1007/s10827-005-5705-x · Cited by 194
A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism
Moustafa, A. A., Sherman, S. J., & Frank, M. J. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.07.011 · Cited by 192 · cited 1×
“This role of the BG in updating WM is also supported by empirical studies with patients, pharmacological manipulations, and neuroimaging (Cools et al. , 2007; Moustafa et al. , 2008; Baier et al. , 2010).”
ResultSelf-citationNeurogenetics and Pharmacology of Learning, Motivation, and Cognition
Frank, M. J., & Fossella, J. A. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.96 · Cited by 192
Self-citationDopaminergic Genes Predict Individual Differences in Susceptibility to Confirmation Bias
Doll, B. B., Hutchison, K. E., & Frank, M. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6486-10.2011 · Cited by 184
Self-citationBrain catecholamine metabolism in catechol‐O‐methyltransferase (COMT)‐deficient mice
Huotari, M., Gogos, J. A., Karayiorgou, M., Koponen, O., Forsberg, M., Raasmaja, A., Hyttinen, J., & Männistö, P. T. (2002) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01856.x · Cited by 180
Action and Outcome Encoding in the Primate Caudate Nucleus
Lau, B., & Glimcher, P. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3060-07.2007 · Cited by 177
(2007) · MPG.PuRe (Max Planck Society) · Cited by 169
The Number and Quality of Representations in Working Memory
Zhang, W., & Luck, S. J. (2011) · Psychological Science · doi:10.1177/0956797611417006 · Cited by 168
Baier, B., Karnath, H.-O., Dieterich, M., Birklein, F., Heinze, C., & Muller, N. G. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.1513-10.2010 · Cited by 154
Tan, H.-Y., Chen, Q., Goldberg, T. E., Mattay, V. S., Meyer-Lindenberg, A., Weinberger, D. R., & Callicott, J. H. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4041-07.2007 · Cited by 144
Genetic control of instrumental conditioning by striatopallidal neuron–specific S1P receptor Gpr6
Lobo, M. K., Cui, Y., Ostlund, S. B., Balleine, B. W., & Yang, X. W. (2007) · Nature Neuroscience · doi:10.1038/nn1987 · Cited by 109
Explicit contextual information selectively contributes to predictive switching of internal models
Imamizu, H., Sugimoto, N., Osu, R., Tsutsui, K., Sugiyama, K., Wada, Y., & Kawato, M. (2007) · Experimental Brain Research · doi:10.1007/s00221-007-0940-1 · Cited by 102
Kahnt, T., Park, S. Q., Cohen, M. X., Beck, A., Heinz, A., & Wrase, J. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21092 · Cited by 102
The causal psycho-logic of choice
Sloman, S. A., & Hagmayer, Y. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.001 · Cited by 93
Understanding Neural Coding through the Model-Based Analysis of Decision Making: Figure 1.
Corrado, G., & Doya, K. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1590-07.2007 · Cited by 93
Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics
Tanaka, S., Samejima, K., Okada, G., Ueda, K., Okamoto, Y., Yamawaki, S., & Doya, K. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.05.039 · Cited by 91
Todd, M. T., Niv, Y., & Cohen, J. D. (2008) · neural information processing systems · Cited by 88
Brovelli, A., Laksiri, N., Nazarian, B., Meunier, M., & Boussaoud, D. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm198 · Cited by 81
de Frias, C. M., Marklund, P., Eriksson, E., Larsson, A., Öman, L., Annerbrink, K., Bäckman, L., Nilsson, L.-G., & Nyberg, L. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21318 · Cited by 62
Confirmation of region-specific patterns of gene expression in the human brain
Ernst, C., Sequeira, A., Klempan, T., Ernst, N., ffrench‐Mullen, J. M. H., & Turecki, G. (2007) · Neurogenetics · doi:10.1007/s10048-007-0084-2 · Cited by 26
Even-Dar, E. (2016) · Springer eBooks · doi:10.1007/978-1-4939-2864-4_341 · Cited by 22
Cited by
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Ten simple rules for the computational modeling of behavioral data
Wilson, R. C., & Collins, A. G. (2019) · eLife · doi:10.7554/elife.49547 · Cited by 710
Self-citationNeurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
Prefrontal cortex as a meta-reinforcement learning system
Wang, J. X., Kurth-Nelson, Z., Kumaran, D., Tirumala, D., Soyer, H., Leibo, J. Z., Hassabis, D., & Botvinick, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0147-8 · Cited by 596
Reinforcement learning and episodic memory in humans and animals: an integrative framework
Gershman, S. J., & Daw, N. D. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033625 · Cited by 446
Metadata
- Authors
- Collins, A. G. E., & Frank, M. J.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2012-04
- Volume
- 35
- Issue
- 7
- Pages
- 1024-1035
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2111971565
- Cited by
- 417
- References
- 70
- FWCI
- 7.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.