From Birdsong to Human Speech Recognition: Bayesian Inference on a Hierarchy of Nonlinear Dynamical Systems
Open accessThe DOI matches its Crossref record; 118 of the 119 references it cites were found in a registry or an index.
Abstract
Our knowledge about the computational mechanisms underlying human learning and recognition of sound sequences, especially speech, is still very limited. One difficulty in deciphering the exact means by which humans recognize speech is that there are scarce experimental findings at a neuronal, microscopic level. Here, we show that our neuronal-computational understanding of speech learning and recognition may be vastly improved by looking at an animal model, i.e., the songbird, which faces the same challenge as humans: to learn and decode complex auditory input, in an online fashion. Motivated by striking similarities between the human and songbird neural recognition systems at the macroscopic level, we assumed that the human brain uses the same computational principles at a microscopic level and translated a birdsong model into a novel human sound learning and recognition model with an emphasis on speech. We show that the resulting Bayesian model with a hierarchy of nonlinear dynamical systems can learn speech samples such as words rapidly and recognize them robustly, even in adverse conditions. In addition, we show that recognition can be performed even when words are spoken by different speakers and with different accents-an everyday situation in which current state-of-the-art speech recognition models often fail. The model can also be used to qualitatively explain behavioral data on human speech learning and derive predictions for future experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Summary of the hierarchical model of speech learning and recognition. The core of the model is equivalent to the core of the birdsong model [14]. The Equations 1 and 2 on the right side generate the dynamics shown on the left side, and are described in the Model section (see also Table 1 for the meaning of parameters). Speech sounds, i.e., sound waves, enter the model through the cochlear level. The output is a cochleagram (shown for the speech stimulus “zero”), which is a type of frequency-time diagram. There are 86 channels, which represent the firing rate (warm colors for high firing rate and cold colors for low firing rate) of the neuronal ensembles that encode lower frequencies as the channel number increases. We decrease the dimension of this input to six dimensions by averaging every 14 channels (see the color coding to the right of the cochleagram and also see Model). After this cochlear processing, activity is fed forward into the two-level hierarchical model. This input is encoded by the activity of the first level network (shown with the same color coding on the right), which is in turn encoded by activity at the second level (no color coding at this level, different colors represent different neuronal ensembles). From the generative model shown here (core model), we derived a recognition model (for mathematical details see Model).](https://figures.cochat.ai/paper-figures/58ef7d2bc22540ba93cd42ebc8052438/from-birdsong-to-human-speech-recognition-bayesian-inference-on-a-hierarchy-of-figure-1.jpg)
![Figure 2 Schematic structure of an agent and a module. A) An agent consists of several modules, where each module contains an instance of the model shown in Figure 1 and has learned to recognize a single word. Sensory input is recognized by all modules concurrently and each module experiences prediction error during recognition. A module can be considered as a sophisticated dynamic, Bayes-optimal template matcher which produces less prediction error if the stimulus matches better to the module's learned word. A minimum operator performs classification by selecting the module with the least amount of prediction error during recognition. B) At each level in a module, causal and hidden states ( and , respectively) try to minimize the precision-weighted prediction errors ( and ) by exchanging messages. Predictions are transferred from second level to the first and prediction error is propagated back from the first to the second level (see section Model: Learning and Recognition for more details). Adapted from [110].](https://figures.cochat.ai/paper-figures/2299d43c007840e8aa9fdb6d1242e1b3/from-birdsong-to-human-speech-recognition-bayesian-inference-on-a-hierarchy-of-figure-2.jpg)





![Figure 8 Qualitative modeling of experimental results in second language learning. A) The behavioral results of an experiment [67] for the recognition of English words by three groups of native speakers of Italian who differed in their age of arrival in Canada: Early, Mid and Late arrival groups, also compared to a native English speaker (NE) group. Participants were asked to repeat as many words as possible after they heard an English sentence. Sentences were presented at different signal-to-noise ratios given in decibels (dB). Adapted from [67]. B) The results of the learning and recognition simulations where we used the same speech samples as in the Word Recognition Task. The different age of arrival was modeled with different precision ratios at the first level. Recognition accuracy is measured in terms of normalized, total causal prediction errors during recognition relative to a baseline condition of −30 dB noise, i.e., recognition accuracy = 100*[(baseline prediction error-test prediction error)/baseline prediction error]. Note that we used different signal-to-noise ratios than the original experiment because best recognition results with our model were obtained at 30 dB, which corresponds to almost ideal recognition results in humans around 12 dB, and we scaled the remaining ratios accordingly. Each symbol represents the average recognition accuracy obtained from 10 digits where the stimulus was masked with noise at given signal-to-noise ratios.](https://figures.cochat.ai/paper-figures/6c07759999474ff38655aad873faf467/from-birdsong-to-human-speech-recognition-bayesian-inference-on-a-hierarchy-of-figure-8.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Because consequences follow causes, the generative model acquires a temporal depth [166, 155].”
From The free energy principle made simpler but not too simple (2023) · cites this paper as [166]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“Here, we use a Hopfield network [32] to implement such dynamics.”
MethodFriston, K. J., Harrison, L., & Penny, W. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00202-7 · Cited by 4,583 · cited 1×
“This may be done using either a voxel-wise regressor-based approach, or a network analysis (Dynamic Causal Modeling [99,100]).”
MethodA theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · cited 1×
“As in the brain, learning changes parameters , such as the synaptic connectivity, of the modules relatively slowly, whereas recognition is based on rapidly changing states of the system, such as the membrane potentials and firing rate [45,46].”
BackgroundSome Experiments on the Recognition of Speech, with One and with Two Ears
Cherry, E. C. (1953) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907229 · Cited by 4,549
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025 · cited 1×
“Recently, so called reservoir computing techniques using recurrent neural networks have been used for speech recognition [18,51,89–92] and provide excellent recognition results.”
BackgroundA distributed, developmental model of word recognition and naming.
Seidenberg, M. S., & McClelland, J. L. (1989) · Psychological Review · doi:10.1037/0033-295x.96.4.523 · Cited by 3,909 · cited 1×
“Many other computational speech and word recognition models have been proposed that are both neurobiologically plausible and can explain experimental results [19,20,81–87].”
BackgroundThe TRACE model of speech perception
McClelland, J. L., & Elman, J. L. (1986) · Cognitive Psychology · doi:10.1016/0010-0285(86)90015-0 · Cited by 2,956 · cited 3×
“Our model has also several differences from the influential models such as TRACE [19] and Shortlist [20,21] and we provide a more detailed comparison in the Discussion.”
BackgroundMethodAcoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727 · cited 1×
“the hidden Markov model and, very recently, deep belief networks and liquid state machines [16–18].”
BackgroundBirdsong and human speech: common themes and mechanisms
Doupe, A. J., & Kuhl, P. K. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.567 · Cited by 1,633 · cited 4×
“The similarities include anatomical and functional features that characterize the pathways for vocal production, auditory processing and learning [1,2,7].”
BackgroundInfluentialPredictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579 · cited 1×
“The birdsong model described in [14] performs a Bayesian version of dynamical, predictive coding based on an internal generative model of how birdsong is produced [15].”
MethodSelf-citationForeign Accent, Comprehensibility, and Intelligibility in the Speech of Second Language Learners
Munro, M. J., & Derwing, T. M. (1995) · Language Learning · doi:10.1111/j.1467-1770.1995.tb00963.x · Cited by 1,545
Mechanics of the Mammalian Cochlea
Robles, L., & Ruggero, M. A. (2001) · Physiological Reviews · doi:10.1152/physrev.2001.81.3.1305 · Cited by 1,476 · cited 1×
“The cochlea is a spiral-shaped peripheral organ of hearing in the inner ear which is a key component of the auditory system for translating acoustic waves into neural signals (see [34] for a review).”
BackgroundThe anatomy of language: a review of 100 fMRI studies published in 2009
Price, C. J. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2010.05444.x · Cited by 1,387
Attention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365 · cited 1×
“Finally, the proposed learning and recognition technique could be extended to also estimate dynamically the precision values based on techniques as employed by [109].”
MethodShortlist: a connectionist model of continuous speech recognition
Norris, D. (1994) · Cognition · doi:10.1016/0010-0277(94)90043-4 · Cited by 1,250 · cited 3×
“Our model has also several differences from the influential models such as TRACE [19] and Shortlist [20,21] and we provide a more detailed comparison in the Discussion.”
BackgroundMethodHippocampal ‘time cells’ bridge the gap in memory for discontiguous events
MacDonald, C. J., Lepage, K. Q., Eden, U. T., & Eichenbaum, H. (2011) · Neuron · doi:10.1016/j.neuron.2011.07.012 · Cited by 1,193
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074
Friesen, L. M., Shannon, R. V., Baskent, D., & Wang, X. (2001) · The Journal of the Acoustical Society of America · doi:10.1121/1.1381538 · Cited by 1,049 · cited 1×
“This resolution is comparable to the low number of spectral channels used in cochlear implants [102].”
BackgroundSelective cortical representation of attended speaker in multi-talker speech perception
Mesgarani, N., & Chang, E. F. (2012) · Nature · doi:10.1038/nature11020 · Cited by 1,007 · cited 1×
“Humans are able to concentrate on a specific speaker’s voice when there are other competing speakers, as typically experienced at a cocktail party [56–59].”
BackgroundAn ultra-sparse code underliesthe generation of neural sequences in a songbird
Hahnloser, R. H. R., Kozhevnikov, A. A., & Fee, M. S. (2002) · Nature · doi:10.1038/nature00974 · Cited by 986 · cited 2×
“In songbird studies, temporally precise sequential activation of neurons in a high level structure, HVC, has been observed during singing [22,23] and the same area has also been shown to be involved during recognition of songs with similar precise activations [6].”
BackgroundNonnative and second-language speech perception: Commonalities and complementarities
Best, C. T., & Tyler, M. D. (2007) · Language Learning & Language Teaching · doi:10.1075/lllt.17.07bes · Cited by 964
Hierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 3×
“These error units can be identified with superficial pyramidal cells as they originate forward connections in the brain which correspond to the bottom-up error messages in our setting [43].”
BackgroundOptimization and applications of echo state networks with leaky- integrator neurons
Jaeger, H., Lukoševičius, M., Popovici, D., & Siewert, U. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.016 · Cited by 948
On the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929
State-dependent computations: spatiotemporal processing in cortical networks
Buonomano, D. V., & Maass, W. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2558 · Cited by 926 · cited 1×
“Recently, so called reservoir computing techniques using recurrent neural networks have been used for speech recognition [18,51,89–92] and provide excellent recognition results.”
BackgroundPerceptual adaptation to non-native speech
Bradlow, A. R., & Bent, T. (2008) · Cognition · doi:10.1016/j.cognition.2007.04.005 · Cited by 906 · cited 1×
“However, relatively brief exposure (between 2 and 64 sentences) to foreign-accented speech improves listeners’ recognition accuracy [62] and efficiency, measured in terms of error rates and reaction times [63].”
BackgroundDynamical principles in neuroscience
Rabinovich, M. I., Varona, P., Selverston, A. I., & Abarbanel, H. D. I. (2006) · Reviews of Modern Physics · doi:10.1103/revmodphys.78.1213 · Cited by 824 · cited 3×
“These dynamics can be obtained from a neural mass model of mean membrane potential and action firing potential [31], reviewed in [24].”
BackgroundBronkhorst, A. W. (2000) · TNO Repository · Cited by 799
A new view of language acquisition
Kuhl, P. K. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.22.11850 · Cited by 773 · cited 1×
“Before speech can be recognized, it has to be learned [48,49].”
BackgroundThe neuroanatomical and functional organization of speech perception
Scott, S. K., & Johnsrude, I. S. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)00037-1 · Cited by 705 · cited 1×
“humans and songbirds is organized hierarchically [8–10] where fast time scales are represented by lower levels and slow time scales”
BackgroundShortlist B: A Bayesian model of continuous speech recognition.
Norris, D., & McQueen, J. M. (2008) · Psychological Review · doi:10.1037/0033-295x.115.2.357 · Cited by 686 · cited 5×
“Our model has also several differences from the influential models such as TRACE [19] and Shortlist [20,21] and we provide a more detailed comparison in the Discussion.”
BackgroundMethodInfluentialAbeles, M. (1982) · Studies of Brain Function · doi:10.1007/978-3-642-81708-3 · Cited by 677
Statistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672 · cited 1×
“As in the brain, learning changes parameters , such as the synaptic connectivity, of the modules relatively slowly, whereas recognition is based on rapidly changing states of the system, such as the membrane potentials and firing rate [45,46].”
BackgroundSecond Language Acquisition and the Critical Period Hypothesis
(1999) · Routledge eBooks · doi:10.4324/9781410601667 · Cited by 661
Munro, M. J., & Derwing, T. M. (1995) · Language and Speech · doi:10.1177/002383099503800305 · Cited by 629 · cited 1×
“[60] and increase the processing time of listeners who are used to unaccented speech [61].”
BackgroundRapid adaptation to foreign-accented English
Clarke, C. M., & Garrett, M. F. (2004) · The Journal of the Acoustical Society of America · doi:10.1121/1.1815131 · Cited by 625 · cited 1×
“However, relatively brief exposure (between 2 and 64 sentences) to foreign-accented speech improves listeners’ recognition accuracy [62] and efficiency, measured in terms of error rates and reaction times [63].”
BackgroundTemporal Hierarchical Control of Singing in Birds
Yu, A. C., & Margoliash, D. (1996) · Science · doi:10.1126/science.273.5283.1871 · Cited by 608 · cited 2×
“In songbird studies, temporally precise sequential activation of neurons in a high level structure, HVC, has been observed during singing [22,23] and the same area has also been shown to be involved during recognition of songs with similar precise activations [6].”
BackgroundReconstructing Speech from Human Auditory Cortex
Pasley, B. N., David, S. V., Mesgarani, N., Flinker, A., Shamma, S. A., Crone, N. E., Knight, R. T., & Chang, E. F. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001251 · Cited by 604 · cited 1×
“When we recognize speech, our brains map fast speech sound wave modulations to spectrotemporal auditory representations [3,4].”
BackgroundNonnative and second-language speech perception : commonalities and complementarities
Best, C. T., Tyler, M. D., Bohn, O., & Munro, M. J. (2007) · Cited by 581
Evidence for a hierarchy of predictions and prediction errors in human cortex
Wacongne, C., Labyt, E., van Wassenhove, V., Bekinschtein, T., Naccache, L., & Dehaene, S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117807108 · Cited by 560 · cited 1×
“It would also be revealing to include a variety of precision settings as an experimental condition in studies that specifically test the hierarchical predictive coding hypothesis in the auditory cortex [101].”
BackgroundMarreiros, A., Stephan, K., & Friston, K. (2010) · Scholarpedia · doi:10.4249/scholarpedia.9568 · Cited by 559
Patterson, R. D., Allerhand, M. H., & Giguère, C. (1995) · The Journal of the Acoustical Society of America · doi:10.1121/1.414456 · Cited by 550 · cited 1×
“[36–40]).”
Integrating Form and Meaning: A Distributed Model of Speech Perception
Gaskell, M. G., & Marslen-Wilson, W. D. (1997) · Language and Cognitive Processes · doi:10.1080/016909697386646 · Cited by 543 · cited 1×
“Many other computational speech and word recognition models have been proposed that are both neurobiologically plausible and can explain experimental results [19,20,81–87].”
BackgroundLearned Birdsong and the Neurobiology of Human Language
JARVIS, E. D. (2004) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1298.038 · Cited by 536 · cited 1×
“ing and learning [1,2,7].”
Hasselmo, M. E., & McGaughy, J. (2004) · Progress in Brain Research · doi:10.1016/s0079-6123(03)45015-2 · Cited by 525 · cited 1×
“Such claims could be tested with a behavioral study while manipulating the neurotransmitter levels pharmaco-logically [96].”
BackgroundSongs to syntax: the linguistics of birdsong
Berwick, R. C., Okanoya, K., Beckers, G. J. L., & Bolhuis, J. J. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.01.002 · Cited by 467 · cited 1×
“Similarly, songbirds map song sound wave modulations to specific internal representations [5,6].”
BackgroundPhoneme and word recognition in the auditory ventral stream
DeWitt, I., & Rauschecker, J. P. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1113427109 · Cited by 465 · cited 1×
“For example, the auditory system in both humans and songbirds is organized hierarchically [8–10] where fast time scales are represented by lower levels and slow time scales by levels higher up in the hierarchy [11,12].”
BackgroundPrecise auditory–vocal mirroring in neurons for learned vocal communication
Prather, J. F., Peters, S., Nowicki, S., & Mooney, R. (2008) · Nature · doi:10.1038/nature06492 · Cited by 463 · cited 3×
“Much more is known experimentally about the exact neuronal mechanisms in songbirds than in humans, due to detailed electrophysiological studies which have shown that songbirds use a sequence of auditory dynamics to generate and recognize song in a highly effective manner [6,13].”
BackgroundAcetylcholine contributes through muscarinic receptors to attentional modulation in V1
Herrero, J. L., Roberts, M. J., Delicato, L. S., Gieselmann, M. A., Dayan, P., & Thiele, A. (2008) · Nature · doi:10.1038/nature07141 · Cited by 459 · cited 1×
“Neurobiologically, cholinergic neurons (whose main neurotransmitter is acetylcholine, ACh) are known to be involved in the modulation of perceptual processes [93,94].”
BackgroundAge of Second-Language Acquisition and Perception of Speech in Noise
Mayo, L. H., Florentine, M., & Buus, S. (1997) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jslhr.4003.686 · Cited by 454 · cited 1×
“This age factor is behaviorally relevant when second language learners are asked to recognize words or sentences embedded in background noise [66,67].”
BackgroundTwitter evolution: converging mechanisms in birdsong and human speech
Bolhuis, J. J., Okanoya, K., & Scharff, C. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2931 · Cited by 437 · cited 2×
“The similarities include anatomical and functional features that characterize the pathways for vocal production, auditory processing and learning [1,2,7].”
BackgroundLocal Cortical Circuits: An Electrophysiological Study
Abeles, M. (1982) · Medical Entomology and Zoology · Cited by 414
A computational model of filtering, detection, and compression in the cochlea
Lyon, R. (2005) · ICASSP '82. IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1982.1171644 · Cited by 411 · cited 1×
“Here, we use a classical model by R.F. Lyon [35] because it is simple and sufficient for our purposes, however note that more involved models exist in the literature (e.g. [36–40]).”
MethodSupport for a synaptic chain model of neuronal sequence generation
Long, M. A., Jin, D. Z., & Fee, M. S. (2010) · Nature · doi:10.1038/nature09514 · Cited by 399 · cited 1×
“The existence of sequentially activated, temporally precise, neuronal ensembles in the cortex has been proposed previously [74] and provides an explanation for findings of a precise spike timing which have been observed in experiments in different species, e.g. [ 75–77].”
ResultDynamical Encoding by Networks of Competing Neuron Groups: Winnerless Competition
Rabinovich, M., Volkovskii, A., Lecanda, P., Huerta, R., Abarbanel, H. D. I., & Laurent, G. (2001) · Physical Review Letters · doi:10.1103/physrevlett.87.068102 · Cited by 392
McDermott, J. H. (2009) · Current Biology · doi:10.1016/j.cub.2009.09.005 · Cited by 368 · cited 2×
“In humans, such periods of recognition may be useful to help recognize the target sentence [58].”
BackgroundTransient Cognitive Dynamics, Metastability, and Decision Making
Rabinovich, M. I., Huerta, R., Varona, P., & Afraimovich, V. S. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000072 · Cited by 349 · cited 1×
“Rabinovich et al. applied this idea to neuronal dynamics under the name of winnerless competition [24,27–30].”
BackgroundNeuronal activity in the human lateral temporal lobe: I. Responses to speech
Creutzfeldt, O., Ojemann, G., & Lettich, E. (1989) · Experimental Brain Research · doi:10.1007/bf00249600 · Cited by 334
Language Acquisition: The Age Factor
Robison, R. E., & Singleton, D. (1992) · The Modern Language Journal · doi:10.2307/329784 · Cited by 304
Phonetic priming, neighborhood activation, and PARSYN
Luce, P. A., Goldinger, S. D., Auer, E. T., & Vitevitch, M. S. (2000) · Perception & Psychophysics · doi:10.3758/bf03212113 · Cited by 302 · cited 1×
“Many other computational speech and word recognition models have been proposed that are both neurobiologically plausible and can explain experimental results [19,20,81–87].”
BackgroundSpatiotemporal Structure of Cortical Activity: Properties and Behavioral Relevance
Prut, Y., Vaadia, E., Bergman, H., Haalman, I., Slovin, H., & Abeles, M. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.79.6.2857 · Cited by 300 · cited 1×
“The existence of sequentially activated, temporally precise, neuronal ensembles in the cortex has been proposed previously [74] and provides an explanation for findings of a precise spike timing which have been observed in experiments in different species, e.g. [ 75–77].”
ResultTowards a New Neurobiology of Language
Poeppel, D., Emmorey, K., Hickok, G., & Pylkkänen, L. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3244-12.2012 · Cited by 289 · cited 1×
“, the speech sound wave) received by subjects and the dynamics of their hypothesized internal representation [97].”
BackgroundDEM: A variational treatment of dynamic systems
Friston, K. J., Trujillo-Barreto, N., & Daunizeau, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.054 · Cited by 278 · cited 4×
“Both levels adjust their internal predictions to minimize the prediction errors [42].”
BackgroundMethodInfluentialArticulation Rate and Its Variability in Spontaneous Speech: A Reanalysis and Some Implications
Miller, J. L., Grosjean, F., & Lomanto, C. (1984) · Phonetica · doi:10.1159/000261728 · Cited by 273 · cited 1×
“The human auditory system shows remarkable flexibility for variations in speech rate [52,53], whereas such variations pose a serious problem for automatic speech recognition models [50,54,55].”
BackgroundIsolated word recognition with the Liquid State Machine: a case study
Verstraeten, D., Schrauwen, B., Stroobandt, D., & Van Campenhout, J. (2005) · Information Processing Letters · doi:10.1016/j.ipl.2005.05.019 · Cited by 262 · cited 5×
“Note: DEM (Dynamic Expectation Maximization) is the recognition system used in this paper; LSTM (Long Short-Term Memory) network was introduced in [111], LSM (Liquid State Machine) with 1232 neurons was reported in [51] and was improved (LSM 2) in [18].”
BackgroundMethodResultInfluentialOkada, K., Rong, F., Venezia, J., Matchin, W., Hsieh, I.-H., Saberi, K., Serences, J. T., & Hickok, G. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp318 · Cited by 262 · cited 1×
“For example, the auditory system in both humans and songbirds is organized hierarchically [8–10] where fast time scales are represented by lower levels and slow time scales by levels higher up in the hierarchy [11,12].”
BackgroundPERCEIVING VOWELS IN A SECOND LANGUAGE
Flege, J. E., & MacKay, I. R. A. (2004) · Studies in Second Language Acquisition · doi:10.1017/s0272263104261010 · Cited by 261
Neural Mechanisms of Vocal Sequence Generation in the Songbird
FEE, M. S., KOZHEVNIKOV, A. A., & HAHNLOSER, R. H. R. (2004) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1298.022 · Cited by 248 · cited 2×
“Much more is known experimentally about the exact neuronal mechanisms in songbirds than in humans, due to detailed electrophysiological studies which have shown that songbirds use a sequence of auditory dynamics to generate and recognize song in a highly effective manner [6,13].”
BackgroundAre there interactive processes in speech perception?
MCCLELLAND, J., MIRMAN, D., & HOLT, L. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.007 · Cited by 246 · cited 1×
“An example for these word selection models is the hierarchical TRACE model [19,88].”
MethodLanguage Acquisition: The Age Factor
Singleton, D., & Ryan, L. (2004) · Multilingual Matters eBooks · doi:10.21832/9781853597596 · Cited by 244
PERCEIVING VOWELS IN A SECOND LANGUAGE
Flege, J. E., & MacKay, I. R. A. (2004) · Studies in Second Language Acquisition · doi:10.1017/s0272263104026117 · Cited by 238 · cited 1×
“In fact, as pointed out by one of the reviewers, many studies have concluded that the amount and variability of second language input [68–70] as well as the frequency of using the native language during learning [71] have considerable influence in the age of acquisition effects.”
BackgroundTemporal predictive codes for spoken words in auditory cortex
Gagnepain, P., Henson, R. N., & Davis, M. H. (2012) · Current Biology · doi:10.1016/j.cub.2012.02.015 · Cited by 235
Dynamical Encoding by Networks of Competing Neuron Groups
Abarbanel, H. D. I., Huerta, R., Lecanda, P., Rabinovich, M. I., & Volkovskii, A. (2001) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-10630 · Cited by 232
Neuronal activity in the human lateral temporal lobe: II. Responses to the subjects own voice
Creutzfeldt, O., Ojemann, G., & Lettich, E. (1989) · Experimental Brain Research · doi:10.1007/bf00249601 · Cited by 227
Fukai, T., & Tanaka, S. (1997) · Neural Computation · doi:10.1162/neco.1997.9.1.77 · Cited by 204 · cited 1×
“These dynamics can be obtained from a neural mass model of mean membrane potential and action firing potential [31], reviewed in [24].”
BackgroundDynamic causal modeling for EEG and MEG
Kiebel, S. J., Garrido, M. I., Moran, R., Chen, C., & Friston, K. J. (2009) · Human Brain Mapping · doi:10.1002/hbm.20775 · Cited by 203 · cited 1×
“This may be done using either a voxel-wise regressor-based approach, or a network analysis (Dynamic Causal Modeling [99,100]).”
MethodSelf-citationNonlinear Dynamics in the Resolution of Lexical Ambiguity: A Parallel Distributed Processing Account
Kawamoto, A. H. (1993) · Journal of Memory and Language · doi:10.1006/jmla.1993.1026 · Cited by 201 · cited 1×
“Many other computational speech and word recognition models have been proposed that are both neurobiologically plausible and can explain experimental results [19,20,81–87].”
BackgroundA revised model of the inner-hair cell and auditory-nerve complex
Sumner, C. J., Lopez-Poveda, E. A., O’Mard, L. P., & Meddis, R. (2002) · The Journal of the Acoustical Society of America · doi:10.1121/1.1453451 · Cited by 183 · cited 1×
“Here, we use a classical model by R.F. Lyon [35] because it is simple and sufficient for our purposes, however note that more involved models exist in the literature (e.g. [36–40]).”
MethodElemental gesture dynamics are encoded by song premotor cortical neurons
Amador, A., Perl, Y. S., Mindlin, G. B., & Margoliash, D. (2013) · Nature · doi:10.1038/nature11967 · Cited by 180 · cited 1×
“This fits well with a recent study [79] where the authors presented evidence that HVC activity is timed to particular time points of motor gestures during song production.”
BackgroundBILMES, J. A. (2006) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e89-d.3.869 · Cited by 172 · cited 2×
“This translation would not be possible with generic models such as are standard and widely used in automatic speech recognition, e.g. the hidden Markov model and, very recently, deep belief networks and liquid state machines [16–18].”
BackgroundMethodResonant neural dynamics of speech perception
Grossberg, S. (2003) · Journal of Phonetics · doi:10.1016/s0095-4470(03)00051-2 · Cited by 169 · cited 1×
“Many other computational speech and word recognition models have been proposed that are both neurobiologically plausible and can explain experimental results [19,20,81–87].”
BackgroundFactors affecting the recognition of words in a second language
Meador, D., Flege, J. E., & Mackay, I. R. A. (2000) · Bilingualism: Language and Cognition · doi:10.1017/s1366728900000134 · Cited by 167 · cited 5×
“A ) The behavioral results of an experiment [67] for the recognition of English words by three groups of native speakers of Italian who differed in their age of arrival in Canada: Early, Mid and Late arrival groups, also compared to a native English speaker (NE) group.”
BackgroundMethodInfluentialJia, G., Strange, W., Wu, Y., Collado, J., & Guan, Q. (2006) · The Journal of the Acoustical Society of America · doi:10.1121/1.2151806 · Cited by 160 · cited 1×
“In fact, as pointed out by one of the reviewers, many studies have concluded that the amount and variability of second language input [68–70] as well as the frequency of using the native language during learning [71] have considerable influence in the age of acquisition effects.”
BackgroundA computational model of the cochlea using the immersed boundary method
Beyer, R. P. (1992) · Journal of Computational Physics · doi:10.1016/0021-9991(92)90180-7 · Cited by 159 · cited 1×
“[36–40]).”
Towards a neurocomputational model of speech production and perception
Kröger, B. J., Kannampuzha, J., & Neuschaefer-Rube, C. (2009) · Speech Communication · doi:10.1016/j.specom.2008.08.002 · Cited by 158 · cited 1×
“Many other computational speech and word recognition models have been proposed that are both neurobiologically plausible and can explain experimental results [19,20,81–87].”
BackgroundOn the origin of reproducible sequential activity in neural circuits
Afraimovich, V., Zhigulin, V. P., & Rabinovich, M. I. (2004) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.1819625 · Cited by 144 · cited 1×
“applied this idea to neuronal dynamics under the name of winnerless competition [24,27–30].”
A cocktail party with a cortical twist: How cortical mechanisms contribute to sound segregation
Elhilali, M., & Shamma, S. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.3001672 · Cited by 143 · cited 1×
“Many other computational speech and word recognition models have been proposed that are both neurobiologically plausible and can explain experimental results [19,20,81–87].”
BackgroundHierarchical Organization of Auditory Temporal Context Sensitivity
Lewicki, M. S., & Arthur, B. J. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-21-06987.1996 · Cited by 139 · cited 1×
“For example, the auditory system in both humans and songbirds is organized hierarchically [8–10] where fast time scales are represented by lower levels and slow time scales by levels higher up in the hierarchy [11,12].”
BackgroundSong Selectivity in the Song System and in the Auditory Forebrain
Theunissen, F. E., Amin, N., Shaevitz, S. S., Woolley, S. M. N., Fremouw, T., & Hauber, M. E. (2004) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1298.023 · Cited by 137 · cited 1×
“For example, the auditory system in both humans and songbirds is organized hierarchically [8–10] where fast time scales are represented by lower levels and slow time scales by levels higher up in the hierarchy [11,12].”
BackgroundHETEROCLINIC CONTOURS IN NEURAL ENSEMBLES AND THE WINNERLESS COMPETITION PRINCIPLE
AFRAIMOVICH, V. S., RABINOVICH, M. I., & VARONA, P. (2004) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127404009806 · Cited by 136 · cited 2×
“One of the well-established ways for modeling the sequential activation of neuronal ensembles is the Lotka-Volterra type dynamics [26,27], which is well known in population biology.”
MethodMother and Stranger: An Electrophysiological Study of Voice Processing in Newborns
Beauchemin, M., Gonzalez-Frankenberger, B., Tremblay, J., Vannasing, P., Martinez-Montes, E., Belin, P., Beland, R., Francoeur, D., Carceller, A.-M., Wallois, F., et al. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq242 · Cited by 131 · cited 1×
“Before speech can be recognized, it has to be learned [48,49].”
BackgroundReservoir-based techniques for speech recognition
Verstraeten, D., Schrauwen, B., & Stroobandt, D. (2006) · The 2006 IEEE International Joint Conference on Neural Network Proceedings · doi:10.1109/ijcnn.2006.1716215 · Cited by 131 · cited 5×
“A different category of models has focused, like the present model, on the processing of auditory stimuli by single neurons or network of neurons [18,50,54].”
BackgroundMethodInfluentialExpected and Unexpected Uncertainty: ACh and NE in the Neocortex
Dayan, P., & Yu, A. J. (2002) · neural information processing systems · Cited by 124
Pitch and voiced/unvoiced determination with an auditory model
Immerseel, L. V., & Martens, J. (1992) · The Journal of the Acoustical Society of America · doi:10.1121/1.402840 · Cited by 120 · cited 1×
“[36–40]).”
Orthogonal acoustic dimensions define auditory field maps in human cortex
Barton, B., Venezia, J. H., Saberi, K., Hickok, G., & Brewer, A. A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213381109 · Cited by 119 · cited 1×
“Such a separation of temporal and spectral processing is also suggested for the human auditory system [25].”
BackgroundRecognizing Sequences of Sequences
Kiebel, S. J., von Kriegstein, K., Daunizeau, J., & Friston, K. J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000464 · Cited by 115 · cited 1×
“This would allow the modeling of sequences of phonemes and syllables [104], or even sentences as sequence of words [105].”
BackgroundSelf-citationWhat is a moment? “Cortical” sensory integration over a brief interval
Hopfield, J. J., & Brody, C. D. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.250483697 · Cited by 113 · cited 4×
“The human auditory system shows remarkable flexibility for variations in speech rate [52,53], whereas such variations pose a serious problem for automatic speech recognition models [50,54,55].”
BackgroundMethodInfluentialBiologically Plausible Speech Recognition with LSTM Neural Nets
Graves, A., Eck, D., Beringer, N., & Schmidhuber, J. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-27835-1_10 · Cited by 109 · cited 1×
“Note: DEM (Dynamic Expectation Maximization) is the recognition system used in this paper; LSTM (Long Short-Term Memory) network was introduced in [111], LSM (Liquid State Machine) with 1232 neurons was reported in [51] and was improved (LSM 2) in [18].”
MethodMultistability in auditory stream segregation: a predictive coding view
Winkler, I., Denham, S., Mill, R., Bőhm, T. M., & Bendixen, A. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0359 · Cited by 108 · cited 1×
“Using hierarchies, it would be useful to model the competition between possible alternative descriptions that emerge from partial stimuli where predictions provide constraints for the appropriate dynamics and therefore stable perception [108].”
On-line plasticity in spoken sentence comprehension: Adapting to time-compressed speech
Adank, P., & Devlin, J. T. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.07.032 · Cited by 107 · cited 1×
“The human auditory system shows remarkable flexibility for variations in speech rate [52,53], whereas such variations pose a serious problem for automatic speech recognition models [50,54,55].”
BackgroundA comprehensive three-dimensional model of the cochlea
Givelberg, E., & Bunn, J. (2003) · Journal of Computational Physics · doi:10.1016/s0021-9991(03)00319-x · Cited by 99 · cited 1×
“[36–40]).”
Neuromuscular control of vocalizations in birdsong: A model
Laje, R., Gardner, T. J., & Mindlin, G. B. (2002) · Physical Review E · doi:10.1103/physreve.65.051921 · Cited by 98 · cited 1×
“The current generative model does not include a vocal tract mechanism [80]; however such a mechanism could be readily”
BackgroundHeteroclinic Contours in Neural Ensembles and the Winnerless Competition PrinciplePreprint
Afraimovich, V., Rabinovich, M. I., Varona, P., & Óptica, C. (2002) · Cited by 96
Time-Warp–Invariant Neuronal Processing
Gütig, R., & Sompolinsky, H. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000141 · Cited by 84 · cited 2×
“The human auditory system shows remarkable flexibility for variations in speech rate [52,53], whereas such variations pose a serious problem for automatic speech recognition models [50,54,55].”
BackgroundSpatiotemporal Signatures of Large-Scale Synfire Chains for Speech Processing as Revealed by MEG
Pulvermüller, F., & Юрьевич, Ш. Ю. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn060 · Cited by 73 · cited 1×
“There do not seem to be equivalent neuronal studies in humans; however, speech processing activity, as observed with magnetoencephalography, has been explained as large-scale sequential activity [78].”
BackgroundA comprehensive three-dimensional model of the cochlea
Givelberg, E., & Bunn, J. (2003) · CaltechAUTHORS (California Institute of Technology) · Cited by 70
Varona, P., Rabinovich, M. I., Selverston, A. I., & Arshavsky, Y. I. (2002) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.1498155 · Cited by 64
Time Scale Hierarchies in the Functional Organization of Complex Behaviors
Perdikis, D., Huys, R., & Jirsa, V. K. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002198 · Cited by 62 · cited 1×
“This can be done either using the technique proposed in the present paper or by using carefully designed nonlinear dynamical systems, as exemplified in [106].”
MethodA Hierarchical Neuronal Model for Generation and Online Recognition of Birdsongs
Yildiz, I. B., & Kiebel, S. J. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002303 · Cited by 50 · cited 7×
“As previously described in [14], under mild assumptions on W [33], one can choose the input vector I appropriately to create a global attractor with desired firing rate values.”
BackgroundMethodInfluentialSelf-citationNeural Substrates for String-Context Mutual Segmentation: A Path to Human Language
Okanoya, K., & Merker, B. H. (2007) · Springer eBooks · doi:10.1007/978-1-84628-779-4_22 · Cited by 43 · cited 1×
“It has been suggested that Broca’s area in the inferior frontal gyrus (pars opercularis) in humans corresponds functionally to HVC in songbirds [2,72].”
BackgroundA reafferent and feed-forward model of song syntax generation in the Bengalese finch
Hanuschkin, A., Diesmann, M., & Morrison, A. (2011) · Journal of Computational Neuroscience · doi:10.1007/s10827-011-0318-z · Cited by 32 · cited 1×
“This would allow the modeling of sequences of phonemes and syllables [104], or even sentences as sequence of words [105].”
BackgroundRecognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks
Bitzer, S., & Kiebel, S. J. (2012) · Biological Cybernetics · doi:10.1007/s00422-012-0490-x · Cited by 25 · cited 1×
“The necessary computations can be described as the dynamics of a hierarchically structured recurrent neural network operating online on the continuous speech input [43,47].”
BackgroundSelf-citationEfficient Continuous-Time Asymmetric Hopfield Networks for Memory Retrieval
Zheng, P., Tang, W., & Zhang, J. (2010) · Neural Computation · doi:10.1162/neco.2010.05-09-1014 · Cited by 25 · cited 1×
“As previously described in [14], under mild assumptions on W [33], one can choose the input vector I appropriately to create a global attractor with desired firing rate values.”
BackgroundA Dynamic Field Account of Language-Related Brain Potentials
Graben, P. B., & Potthast, R. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/9108.003.0007 · Cited by 18 · cited 1×
“Such detailed sentence level representations could be used to model syntactic experiments as shown in [107].”
MethodBayesian representation learning in the cortex regulated by acetylcholine
Hirayama, J.-I., Yoshimoto, J., & Ishii, S. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.06.006 · Cited by 16 · cited 1×
“Neurobiologically, cholinergic neurons (whose main neurotransmitter is acetylcholine, ACh) are known to be involved in the modulation of perceptual processes [93,94].”
BackgroundA hierarchy of recurrent networks for speech recognition
Schrauwen, B., & Buesing, L. (2009) · Ghent University Academic Bibliography (Ghent University) · Cited by 13
A dynamical pattern recognition model of gamma activity in auditory cortex
Zavaglia, M., Canolty, R. T., Schofield, T. M., Leff, A. P., Ursino, M., Knight, R. T., & Penny, W. D. (2012) · Neural Networks · doi:10.1016/j.neunet.2011.12.007 · Cited by 11 · cited 2×
“OT (Occurrence Time) features were used in [103]. doi:10.1371/journal.pcbi.1003219.t002 A previous study examined the recognition of English words by three groups of native Italian speakers with different mean age of arrival (mAOA) when immigrating to Canada [67]: An early group (mAOA of 7 years),…”
BackgroundMethodInfluentialHow Is Time Represented in the Brain?
Herz, A. V. M. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195148220.003.0013 · Cited by 4
Research works printed but not linked: 2
- Flege J, MacKay I, Imai S (2010) What accounts for “age” effects on overall degree foreign accent? Wrembel, M Kul and K DziubalskaKolaczyk (eds) Achievements and Perspectives in SLA of Speech: New Sounds 2: 65.
- Friston K (2008) Hierarchical models in the brain. PLoS Comput Biol 4: e1000211. 18989391 PMC2570625 · DOI · Paper page
Cited by
Neuromorphic computing with nanoscale spintronic oscillators
Torrejon, J., Riou, M., Araujo, F. A., Tsunegi, S., Khalsa, G., Querlioz, D., Bortolotti, P., Cros, V., Yakushiji, K., Fukushima, A., et al. (2017) · Nature · doi:10.1038/nature23011 · Cited by 1,374
The Encoding of Speech Sounds in the Superior Temporal Gyrus
Yi, H. G., Leonard, M. K., & Chang, E. F. (2019) · Neuron · doi:10.1016/j.neuron.2019.04.023 · Cited by 417
“, forward transition probabilities for prediction) (Blank and Davis, 2016; Friston, 2005; Kiebel et al., 2009; Yildiz et al., 2013) and Hebbian learning processes for object recognition (Dan and Poo, 2004).”
BackgroundActive inference, communication and hermeneutics
Friston, K. J., & Frith, C. D. (2015) · Cortex · doi:10.1016/j.cortex.2015.03.025 · Cited by 266
“Using free energy minimisation, Yildiz, von Kriegstein, and Kiebel (2013) have shown that a hierarchy of nonlinear dynamical systems can learn speech samples rapidly and recognize them robustly, even in adverse conditions.”
BackgroundSpeech encoding by coupled cortical theta and gamma oscillations
Hyafil, A., Fontolan, L., Kabdebon, C., Gutkin, B., & Giraud, A.-L. (2015) · eLife · doi:10.7554/elife.06213 · Cited by 235
Ackermann, H., Hage, S. R., & Ziegler, W. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13003099 · Cited by 215
Metadata
- Authors
- Yildiz, I. B., von Kriegstein, K., & Kiebel, S. J.
- Affiliations
- École Normale Supérieure - PSL (FR)
- Max Planck Institute for Human Cognitive and Brain Sciences (DE)
- Corresponding author
- Yildiz, Izzet B.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-09-12
- Volume
- 9
- Issue
- 9
- Pages
- e1003219
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC3772045
- OpenAlex
- W2163460643
- Cited by
- 55
- References
- 119
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 5 · 2023: 6 · 2022: 1 · 2021: 8 · 2020: 2 · 2019: 3 · 2018: 2 · 2017: 9 · 2016: 3 · 2015: 10 · 2014: 4
- FWCI
- 6.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Funders
- Max-Planck-Institut für Kognitions- und Neurowissenschaften
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Animal Vocal Communication and Behavior
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Keywords
- speech recognition, speech learning, bird song, songbirds, Bayesian inference, online learning
- MeSH terms
- Animals, Animal Communication, Bayes Theorem, Birds, Humans, Speech
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.