Error biases in inner and overt speech: evidence from tongue twisters
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
To compare the properties of inner and overt speech, Oppenheim and Dell (2008) counted participants' self-reported speech errors when reciting tongue twisters either overtly or silently and found a bias toward substituting phonemes that resulted in words in both conditions, but a bias toward substituting similar phonemes only when speech was overt. Here, we report 3 experiments revisiting their conclusion that inner speech remains underspecified at the subphonemic level, which they simulated within an activation-feedback framework. In 2 experiments, participants recited tongue twisters that could result in the errorful substitutions of similar or dissimilar phonemes to form real words or nonwords. Both experiments included an auditory masking condition, to gauge the possible impact of loss of auditory feedback on the accuracy of self-reporting of speech errors. In Experiment 1, the stimuli were composed entirely from real words, whereas, in Experiment 2, half the tokens used were nonwords. Although masking did not have any effects, participants were more likely to report substitutions of similar phonemes in both experiments, in inner as well as overt speech. This pattern of results was confirmed in a 3rd experiment using the real-word materials from Oppenheim and Dell (in press). In addition to these findings, a lexical bias effect found in Experiments 1 and 3 disappeared in Experiment 2. Our findings support a view in which plans for inner speech are indeed specified at the feature level, even when there is no intention to articulate words overtly, and in which editing of the plan for errors is implicated. (PsycINFO Database Record (c) 2010 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Corley et al. (2011), however, did observe a phonemic similarity effect in the errors reported by the participants in their own tongue-twister recitation experiment. This suggests that inner slips could in fact be detected at the articulation planning level.”
From The ConDialInt Model: Condensation, Dialogality, and Intentionality Dimensions of Inner Speech Within a Hierarchical Predictive Control Framework (2019) · cites this paper as Corley et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, two studies by Corley and colleagues reported similar phoneme substitution errors in inner and overt speech, for both fluent speakers (Corley, Brocklehurst, & Moat, 2011) and adults who stutter (Brocklehurst & Corley, 2011).”
From Inner Speech: Development, Cognitive Functions, Phenomenology, and Neurobiology (2015) · cites this paper as Corley, Brocklehurst, & Moat, 2011
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Vygotsky, L. S. (1964) · Bulletin of the Orton Society · doi:10.1007/bf02928399 · Cited by 20,704
Hapeman, D. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484817 · Cited by 9,373
Agresti, A. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/0471249688 · Cited by 6,746
A theory of lexical access in speech production
Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99001776 · Cited by 5,136
Speaking: from intention to articulation
(1989) · Choice Reviews Online · doi:10.5860/choice.27-1947 · Cited by 5,003 · cited 1×
“The first is that the view that inner speech is impoverished requires an assumption that participants are able to attend to their own inner speech (Levelt, 1983, 1989) and that they can successfully detect and report all of the errors they make under these circumstances.”
BackgroundApproximate Inference in Generalized Linear Mixed Models
Breslow, N. E., & Clayton, D. G. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594284 · Cited by 4,629
Speaking. From Intention to Articulation
Caplan, D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90151-y · Cited by 4,008
A spreading-activation theory of retrieval in sentence production.
Dell, G. S. (1986) · Psychological Review · doi:10.1037//0033-295x.93.3.283 · Cited by 3,236
Praat : doing phonetics by computer (version 4.4.24)
Boersma, P. (2006) · Medical Entomology and Zoology · Cited by 2,082
Research works printed but not linked: 1
- Nooteboom, S., & Quen´ e, H. (2008). Self-monitoring and feedback: A new attempt to find the main cause of lexical bias in phonological speech errors. Journal of Memory and Language , 58 , 837-861.
Cited by
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
Inner Speech: Development, Cognitive Functions, Phenomenology, and Neurobiology
Alderson-Day, B., & Fernyhough, C. (2015) · Psychological Bulletin · doi:10.1037/bul0000021 · Cited by 864
“Thus, in cases where inner speech appears to have specific phonological features (as in Corley et al., 2011), this may have been be due to participants deploying a form of inner speech involving a greater degree of articulation (such as silently mouthing words as they are represented in inner…”
BackgroundPerrone-Bertolotti, M., Rapin, L., Lachaux, J.-P., Baciu, M., & Lœvenbruck, H. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2013.12.034 · Cited by 317
Decoding Covert Speech From EEG-A Comprehensive Review
Panachakel, J. T., & Ramakrishnan, A. G. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.642251 · Cited by 156
“This hypothesis is contradicted by several studies which show that the phonological and lexical features in both imagined and articulated speech are similar (Abramson and Goldinger, 1997; Brocklehurst and Corley, 2011; Corley et al., 2011).”
ResultDecoding Inner Speech Using Electrocorticography: Progress and Challenges Toward a Speech Prosthesis
Martin, S., Iturrate, I., Millán, J. D. R., Knight, R. T., & Pasley, B. N. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00422 · Cited by 115
“During inner speech, behavioral studies have provided evidence that phoneme substitution errors occurred between phonemes sharing similar features (phonemic similarity effect; Corley et al., 2011), and a similar behavior occurs during overt speech.”
BackgroundNeurolinguistics Research Advancing Development of a Direct-Speech Brain-Computer Interface
Cooney, C., Folli, R., & Coyle, D. (2018) · iScience · doi:10.1016/j.isci.2018.09.016 · Cited by 106
“Several modalities have been developed to facilitate such communication through movement-independent BCI, including BCI-spellers (e.g., D’albis et al., 2012), BCIs based on steady-state visually evoked potential (e.g., Bin et al., 2009), and BCIs based on motor imagery (e.g., Tabar and Halici,…”
MethodInner speech as language process and cognitive tool
Fernyhough, C., & Borghi, A. M. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.08.014 · Cited by 101
“At one end, motor simulation views [28,29] hold that IS is a mental simulation of overt speech that falls short of producing the articulatory actions From external dialogue to inner speech (IS).”
BackgroundGrandchamp, R., Rapin, L., Perrone-Bertolotti, M., Pichat, C., Haldin, C., Cousin, E., Lachaux, J.-P., Dohen, M., Perrier, P., Garnier, M., et al. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02019 · Cited by 97
Cascading influences on the production of speech: Evidence from articulation
McMillan, C. T., & Corley, M. M. B. (2010) · Cognition · doi:10.1016/j.cognition.2010.08.019 · Cited by 78
Self-citationThe Causes and Contents of Inner Speech
Carruthers, P. (2018) · Oxford Scholarship Online · doi:10.1093/oso/9780198796640.003.0002 · Cited by 66
“The efference copy is used to create a sensory representation of what the speech act in question would have sounded like had it been carried through to completion (Tian & Poeppel, 2010; Corley et al., 2011; Scott, 2013; Scott et al., 2013).”
MethodA Psycholinguistic Framework for Diagnosis and Treatment Planning of Developmental Speech Disorders
Terband, H., Maassen, B., & Maas, E. (2019) · Folia Phoniatrica et Logopaedica · doi:10.1159/000499426 · Cited by 105
Inner Speech during Silent Reading Reflects the Reader's Regional Accent
Filik, R., & Barber, E. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025782 · Cited by 62
“However, some of the evidence from tongue twister studies [30] seems to suggest that inner speech is impoverished at the featural level, compared to overt speech (but see [31]).”
BackgroundDynamic reconfiguration of the language network preceding onset of speech in picture naming
Liljeström, M., Kujala, J., Stevenson, C. M., & Salmelin, R. H. (2014) · Human Brain Mapping · doi:10.1002/hbm.22697 · Cited by 70
“Such results suggest that motor articulation affects also earlier stages of speech planning [Oppenheim and Dell, 2010], although this view has not been without controversy [Corley et al., 2011].”
BackgroundResultBrocklehurst, P. H., & Corley, M. (2011) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2010.11.004 · Cited by 46
Self-citationBrocklehurst, P. H., Lickley, R. J., & Corley, M. M. B. (2013) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2013.04.002 · Cited by 44
Self-citationOrofacial electromyographic correlates of induced verbal rumination
Nalborczyk, L., Perrone-Bertolotti, M., Baeyens, C., Grandchamp, R., Polosan, M., Spinelli, E., Koster, E. H. W., & Lœvenbruck, H. (2017) · Biological Psychology · doi:10.1016/j.biopsycho.2017.04.013 · Cited by 32
A voice without a mouth no more: The neurobiology of language and consciousness
Skipper, J. I. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104772 · Cited by 31
Hill, C. S. (2022) · doi:10.1093/oso/9780192867766.001.0001 · Cited by 31
Stephan, F., Saalbach, H., & Rossi, S. (2020) · Brain Sciences · doi:10.3390/brainsci10030148 · Cited by 36
Kell, C. A., Darquea, M., Behrens, M., Cordani, L., Keller, C., & Fuchs, S. I. (2016) · Human Brain Mapping · doi:10.1002/hbm.23398 · Cited by 37
“There is considerable debate on whether inner speech is abstract [Jones, 2009; Oppenheim and Dell, 2008, 2010] or whether it is a more concrete phenomenon with representation of phonetic detail that involves a motor simulation [Corley et al., 2011].”
BackgroundInner Speech's Relationship With Overt Speech in Poststroke Aphasia
Stark, B. C., Geva, S., & Warburton, E. A. (2017) · Journal of Speech Language and Hearing Research · doi:10.1044/2017_jslhr-s-16-0270 · Cited by 38
“…mechanism in the language system (i.e., Dell, 1986; Levelt, 1983) and has been proposed as a potential buffer for detection of pre-speech errors (Corley et al., 2011; Dell & INNER SPEECH'S RELATIONSHIP WITH OVERT SPEECH 5 Repka, 1992; Hartsuiker & Kolk, 2001; Nooteboom, 2005; Oppenheim & Dell,…”
BackgroundFrisson, S., Koole, H., Hughes, L., Olson, A., & Wheeldon, L. R. (2014) · Journal of Memory and Language · doi:10.1016/j.jml.2014.03.004 · Cited by 33
Can we decode phonetic features in inner speech using surface electromyography?
Nalborczyk, L., Grandchamp, R., Koster, E. H. W., Perrone-Bertolotti, M., & Lœvenbruck, H. (2020) · PLOS ONE · doi:10.1371/journal.pone.0233282 · Cited by 24
Perceptual Awareness of Particulars
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0004 · Cited by 18
Zhao, N., Cai, Z. G., & Dong, Y. (2023) · PLoS ONE · doi:10.1371/journal.pone.0292718 · Cited by 18
“In experimental settings, phonological errors can be readily induced by methods such as tongue twisters (e.g., [18]).”
How do speakers coordinate? Evidence for prediction in a joint word-replacement task
Gambi, C., Cop, U., & Pickering, M. J. (2014) · Cortex · doi:10.1016/j.cortex.2014.09.009 · Cited by 21
Anticipating Stock Market Movements with Google and Wikipedia
Moat, H. S., Curme, C., Stanley, E., & Preis, T. (2014) · NATO science for peace and security series. C, Environmental security · doi:10.1007/978-94-017-8704-8_4 · Cited by 18
Self-citationInner speech as a forward model?
Oppenheim, G. M. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12002798 · Cited by 18
Neural Basis of Phonological Short-Term Memory
Fiez, J. A. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-407794-2.00068-7 · Cited by 13
Mantegna, F., Orpella, J., & Poeppel, D. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.115137 · Cited by 18
Predictive Coding and Internal Error Correction in Speech Production
Teghipco, A., Okada, K., Murphy, E., & Hickok, G. S. (2023) · Neurobiology of Language · doi:10.1162/nol_a_00088 · Cited by 14
“Several previous behavioral studies have shown that the lexical bias effect holds even when subjects do not phonate their speech and self-report their errors (Corley et al., 2011; Oppenheim & Dell, 2008, 2010).”
BackgroundThe sound of thought: Form matters–The prosody of inner speech
Kreiner, H., & Eviatar, Z. (2024) · Physics of Life Reviews · doi:10.1016/j.plrev.2024.10.006 · Cited by 16
Predicting and imagining language
Gambi, C., & Pickering, M. J. (2015) · Language Cognition and Neuroscience · doi:10.1080/23273798.2015.1049188 · Cited by 10
What does it mean to predict one's own utterances?
Meyer, A. S., & Hagoort, P. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12002786 · Cited by 14
Insights for Speech Production Planning from Errors in Inner Speech
Dell, G. S., & Oppenheim, G. M. (2015) · Wiley eBooks · doi:10.1002/9781118584156.ch18 · Cited by 9
Oppenheim, G. M. (2012) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0025257 · Cited by 11
Neural representations of the content and production of human vocalization
Voigtlaender, V. A., Sandhaeger, F., Hawellek, D. J., Hage, S. R., & Siegel, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2219310120 · Cited by 7
Words as social tools (WAT): A reprise
Mazzuca, C., Fini, C., Livio, C. D., Falcinelli, I., Maggio, F., Tummolini, L., & Borghi, A. M. (2024) · Physics of Life Reviews · doi:10.1016/j.plrev.2024.12.011 · Cited by 12
The Effect of Auditory Information on Patterns of Intrusions and Reductions
Slis, A., & Lieshout, P. H. H. M. V. (2016) · Journal of Speech Language and Hearing Research · doi:10.1044/2015_jslhr-s-14-0258 · Cited by 7
Synthesising Filled Pauses: Representation and Datamixing
Dall, R., Tomalin, M., & Wester, M. (2016) · ISCA Speech Synthesis Workshop (SSW) · doi:10.21437/ssw.2016-2 · Cited by 5
“Such as the wide range of functions in conversational interactions which FPs performs, where they can (amongst other things) indicate psychological states, structure spoken exchanges, facilitate word recall, and improve object recognition [3, 31, 17, 32, 33, 34, 13, 35].”
BackgroundInner versus Overt Speech Production: Does This Make a Difference in the Developing Brain?
Stephan, F., Saalbach, H., & Rossi, S. (2020) · Brain Sciences · doi:10.3390/brainsci10120939 · Cited by 6
“The lack of difference between inner and overt speech in the execution phase in the EEG for children might account for the unimpoverished hypothesis [18,19].”
BackgroundArticulatory suppression effects on induced ruminationPreprint
Nalborczyk, L., Perrone‐Bertolotti, M., Baeyens, C., Grandchamp, R., Spinelli, E., Koster, E. H. W., & Lœvenbruck, H. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5d6h7 · Cited by 5
Invasive Brain-Computer Interface (BCI) for Communication
Chaudhary, U. (2025) · Springer eBooks · doi:10.1007/978-3-031-78991-5_5 · Cited by 3
Categoricity, Variation, and Gradience in Sambla Balafon Segmental Encoding
McPherson, L. (2021) · Frontiers in Communication · doi:10.3389/fcomm.2021.652635 · Cited by 3
Understanding rumination as a form of inner speech: probing the role of motor processesPreprint
Nalborczyk, L. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/p6dct · Cited by 7
“This claim, related to the Abstraction view, is still debated however, as a phonemic similarity effect has been found by Corley et al. (2011).”
BackgroundResultInfluentialOverview of Conditions that Immediately Reduce Stuttering and A Unifying Account for Their EffectPreprint
Hesse, T. (2022) · Preprints.org · doi:10.20944/preprints202207.0132.v1 · Cited by 1
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0001 · Cited by 1
Alexander, J. M., & Stark, B. C. (2024) · European Journal of Neuroscience · doi:10.1111/ejn.16470 · Cited by 4
“Further, psycholinguistic research suggests that tongue twisters can occur in both inner and overt speech (Corley et al., 2011).”
Monitoring internal speech: an advantage for syllables over phonemes?
Hallé, P., Manoiloff, L. M. V., Gao, J., & Seguí, J. (2021) · Language Cognition and Neuroscience · doi:10.1080/23273798.2021.1941146 · Cited by 1
“Tongue twister recitations show similar lexical bias effects on overt and inner slips as well as largely similar phonemic similarity effects (Corley et al., 2011; Oppenheim & Dell, 2010; but see Oppenheim & Dell, 2008).”
BackgroundVowel epenthesis in English word-final stops: the influence of orthography and inner speech
Lee, J. (2015) · Seoul National University Open Repository (Seoul National University)
Revisiting Bloodstein's Anticipatory Struggle Hypothesis from a psycholinguistic perspective
Brocklehurst, P. H., Lickley, R. J., & Corley, M. M. B. (2016)
Self-citationPuls, L., & Diego, L. (2019) · UCL Discovery (University College London)
Brocklehurst, P. H. (2011) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 3
Self-citationThe Study of Phonological Neighborhoods in Chinese L1 and L2 Speech Production
Xie, T., Ye, H., Wang, H., & van de Weijer, J. (2020) · International Conference on Algorithms, Computing and Artificial Intelligence (ACAI) · doi:10.1145/3446132.3446135
The Impact of Neurological Intervention in Self-Talk Regulation: An Intervention Study.
Thomas, A., & Singh, A. (2022) · International Journal of Neurolinguistics & Gestalt Psychology · doi:10.52522/ijngp.v1i3.5
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0007
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.002.0003
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0002
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.002.0009
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.002.0006
A Quasi-Perceptualist Account of Pain Experience
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0006
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0008
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0003
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.002.0008
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0005 · Cited by 1
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.002.0004
The Epistemic Role of Perception
Hill, C. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192867766.003.0009
Contemporary Theories of Stuttering Development
Novikova, I. A., & Krivonkin, K. (2022) · Clinical Psychology and Special Education · doi:10.17759/cpse.2022110301 · Cited by 1
“Ряд других исследований подтвердили эти выводы [20; 43].”
Stark, B. C., & Alexander, J. M. (2024) · doi:10.31219/osf.io/athr9
How fluency-enhancing conditions reduce stuttering. A unified explanation
Hesse, T. (2024) · Medical Hypotheses · doi:10.1016/j.mehy.2024.111415 · Cited by 1
Metadata
- Authors
- Corley, M., Brocklehurst, P. H., & Moat, H. S.
- Affiliations
- University of Edinburgh (GB)
- Venue
- Journal of Experimental Psychology: Learning, Memory, and Cognition
- Published
- 2011
- Volume
- 37
- Issue
- 1
- Pages
- 162-175
- ISSN
- 0278-7393 (ISSN-L)
- 1939-1285
- OpenAlex
- W2023696903
- Cited by
- 70
- References
- 44
- Citations by year
- 2025: 1 · 2024: 6 · 2023: 3 · 2022: 20 · 2021: 3 · 2020: 4 · 2019: 4 · 2018: 4 · 2017: 2 · 2016: 4 · 2015: 5 · 2014: 5 · 2013: 4 · 2012: 1
- FWCI
- 1.94
- Type
- journal article
- Language
- en
- Open access
- Licence
- other-oa
- Locations
- Journal of Experimental Psychology Learning Memory and Cognition (publishedVersion)
- PubMed (publishedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Economic and Social Research Council (ES/G01230X/1, PTA/031/2004/00279)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
- Keywords
- inner speech, overt speech, speech errors, tongue twisters, phoneme substitution, auditory feedback, auditory masking, lexical bias
- MeSH terms
- Acoustic Stimulation, Adolescent, Adult, Female, Humans, Male, Perceptual Masking, Phonetics, Psycholinguistics, Set, Psychology, Speech, Thinking, Verbal Behavior, Vocabulary, Bias, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.