Learning to Produce Syllabic Speech Sounds via Reward-Modulated Neural Plasticity
Open accessThe DOI matches its Crossref record; 105 of the 106 references it cites were found in a registry or an index.
Abstract
At around 7 months of age, human infants begin to reliably produce well-formed syllables containing both consonants and vowels, a behavior called canonical babbling. Over subsequent months, the frequency of canonical babbling continues to increase. How the infant's nervous system supports the acquisition of this ability is unknown. Here we present a computational model that combines a spiking neural network, reinforcement-modulated spike-timing-dependent plasticity, and a human-like vocal tract to simulate the acquisition of canonical babbling. Like human infants, the model's frequency of canonical babbling gradually increases. The model is rewarded when it produces a sound that is more auditorily salient than sounds it has previously produced. This is consistent with data from human infants indicating that contingent adult responses shape infant behavior and with data from deaf and tracheostomized infants indicating that hearing, including hearing one's own vocalizations, is critical for canonical babbling development. Reward receipt increases the level of dopamine in the neural network. The neural network contains a reservoir with recurrent connections and two motor neuron groups, one agonist and one antagonist, which control the masseter and orbicularis oris muscles, promoting or inhibiting mouth closure. The model learns to increase the number of salient, syllabic sounds it produces by adjusting the base level of muscle activation and increasing their range of activity. Our results support the possibility that through dopamine-modulated spike-timing-dependent plasticity, the motor cortex learns to harness its natural oscillations in activity in order to produce syllabic sounds. It thus suggests that learning to produce rhythmic mouth movements for speech production may be supported by general cortical learning mechanisms. The model makes several testable predictions and has implications for our understanding not only of how syllabic vocalizations develop in infancy but also for our understanding of how they may have evolved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Overview of the model. A: Schematic depiction of the groups of neurons in the spiking neural network and how they are connected. There is a reservoir of 1000 recurrently connected neurons, with 200 of those being inhibitory (red) and the rest excitatory (blue and black). 200 of the reservoir’s excitatory neurons are designated as output neurons (black). These output neurons connect to two groups of motor neurons, agonist motor neurons (blue) and antagonist motor neurons (red). The connection weights within the reservoir are set at the start of the simulation to random values and do not change over the course of the simulation. The connection weights from the reservoir output neurons to the motor neurons are initially set to random values and are modified throughout the simulation by dopamine (DA)-modulated STDP. All reservoir and motor neurons receive random input current at each time step (not shown). B: Raster plot of spikes in the reservoir over a 1 s time period. C: Raster plot of spikes in the motor neuron groups over the same 1 s time period. The agonist and antagonist motor neuron spikes are summed at each time step then are smoothed using a 100 ms moving average. The smoothed antagonist activity is subtracted from the smoothed agonist activity, creating a net smoothed muscle activity that is sent to the orbicularis and masseter muscles. D: The smoothed agonist, antagonist, and net activity for the same 1 s as in the raster plots. E: Effects of the orbicularis oris and masseter on the vocal tract’s shape (reprinted with permission from [61]). Orbicularis oris activity tends to round and close the lips and masseter activity tends to raise the jaw. F: Schematic illustration that the vocal tract is modeled as an air-filled tube bounded by walls made up of coupled mass-spring systems (reprinted with permission from [61]). The orbicularis oris and masseter affect the equilibrium positions at the front parts of the tube. The air pressure over time and space in the tube is calculated, and the air pressure at the lip end of the tube forms the sound waveform. The vocal tract shape is modeled more realistically than depicted here and also contains a nasal cavity that is not depicted. G: The sound synthesized by the vocal tract model is input to an algorithm that estimates auditory salience. The plot shows, for the same 1 s as in B–D, the synthesized vocalization waveform (in cyan) and the salience of that waveform over time (in black). Apart from a peak in salience at the sound’s onset, the most salient portion of the sound is around the place where the sound’s one consonant can be heard. The overall salience of this particular sound is 10.77. If the salience of the sound is above the model’s current threshold, a reward is given, which causes an increase in dopamine concentration in the neural network.](https://figures.cochat.ai/paper-figures/b4fe5923b5094ee69ef5e391294b97af/learning-to-produce-syllabic-speech-sounds-via-reward-modulated-neural-figure-1.jpg)




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Thus, experience with prototypical IDS prosody and vocal affect not only elicits greater responsiveness from the infant [13], but also fosters a positive interactive loop of social interaction between mother and child [2,6,14] which in turn scaffolds infant vocal communication [15–18], and supports healthy brain development.”
From Effect of maternal depression on infant-directed speech to prelinguistic infants: Implications for language development (2020) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This finding is important because exposure to speech, and the level of involvement that infants have with early conversations is associated with early language development [8,10,15,16,18].”
From Effect of maternal depression on infant-directed speech to prelinguistic infants: Implications for language development (2020) · cites this paper as [18]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simple model of spiking neurons
Izhikevich, E. M. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820440 · Cited by 4,828 · cited 1×
“The first subgroup was a reservoir of 1000 Izhikevich spiking neurons [62].”
BackgroundBi, G.-Q., & Poo, M.-M. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10464.1998 · Cited by 4,744 · cited 1×
“(STDP) is a form of Hebbian learning derived from a large number of both in vitro and in vivo studies on long term potentiation and depression, in both hippocampal and neocortical neurons [67, 68].”
BackgroundSynaptic plasticity: taming the beast
Abbott, L. F., & Nelson, S. B. (2000) · Nature Neuroscience · doi:10.1038/81453 · Cited by 2,263 · cited 1×
“This prevents the overall network connectivity from increasing over time, which would severely disrupt the network’s dynamics [72].”
BackgroundOxford handbook of deaf studies, language, and education
(2003) · Choice Reviews Online · doi:10.5860/choice.41-1628 · Cited by 1,066
Spike Timing-Dependent Plasticity of Neural Circuits
Dan, Y., & Poo, M.-M. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.007 · Cited by 1,040
Four-month-old infants prefer to listen to motherese
Fernald, A. (1985) · Infant Behavior and Development · doi:10.1016/s0163-6383(85)80005-9 · Cited by 1,015 · cited 1×
“It has been shown that infants prefer caregiverese to adult-directed speech [34], and that this preference appears to be driven by the salient frequency modulations in caregiverese [35].”
BackgroundThe frame/content theory of evolution of speech production
MacNeilage, P. F. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98001265 · Cited by 919 · cited 6×
“It is also consistent with the idea that more elaborate cortical circuitry for coordinated control of phonatory movements in humans compared to other primates is related to humans’ vocal learning abilities, and subsequently their capacity for speech [15, 24, 25].”
BackgroundResultInfluentialNeural modeling and imaging of the cortical interactions underlying syllable production
Guenther, F. H., Ghosh, S. S., & Tourville, J. A. (2006) · Brain and Language · doi:10.1016/j.bandl.2005.06.001 · Cited by 879 · cited 1×
“Guenther and colleagues [52] have provided a particularly compelling example of how subregions of the central nervous system can be incorporated into a (non-spiking) neural model of speech production, with model features and findings mapping directly to neuroimaging data.”
BackgroundNeural pathways underlying vocal control
Jürgens, U. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(01)00068-9 · Cited by 852 · cited 2×
“It is also consistent with the idea that more elaborate cortical circuitry for coordinated control of phonatory movements in humans compared to other primates is related to humans’ vocal learning abilities, and subsequently their capacity for speech [15, 24, 25].”
BackgroundResultAcoustic determinants of infant preference for motherese speech
Fernald, A., & Kuhl, P. (1987) · Infant Behavior and Development · doi:10.1016/0163-6383(87)90017-8 · Cited by 818 · cited 1×
“It has been shown that infants prefer caregiverese to adult-directed speech [34], and that this preference appears to be driven by the salient frequency modulations in caregiverese [35].”
BackgroundOn the quantal nature of speech
Stevens, K. N. (1989) · Journal of Phonetics · doi:10.1016/s0095-4470(19)31520-7 · Cited by 777 · cited 1×
“Auditory salience can be estimated automatically [36, 37], and tends to be higher when vocalizations contain both consonants and vowels than when vocalizations contain only vowels [38, 39].”
BackgroundTHE SUPPLEMENTARY MOTOR AREA OF THE CEREBRAL CORTEX: A Clinical and Experimental Study
PENFIELD, W. (1951) · A.M.A. Archives of Neurology & Psychiatry · doi:10.1001/archneurpsyc.1951.02320090038004 · Cited by 758 · cited 1×
“It has been found that direct stimulation of the supplementary motor area in adult humans can, at least in some cases, elicit reduplicated babbling sequences such as repetitions of the syllable “da” or “te” [15, 19, 20].”
BackgroundThe Emergence of the Speech Capacity
Oller, D. K. (2000) · Psychology Press eBooks · doi:10.4324/9781410602565 · Cited by 756 · cited 1×
“The most likely possibility may indeed be that the development of canonical babbling is so critical to modern human function that it has become canalized, supported by a robust combination of multiple neural and environmental processes [14, 26].”
BackgroundFunctional organization of human sensorimotor cortex for speech articulation
Bouchard, K. E., Mesgarani, N., Johnson, K., & Chang, E. F. (2013) · Nature · doi:10.1038/nature11911 · Cited by 686 · cited 3×
“Another worthwhile future direction would be to incorporate control of the various muscles of the tongue, in which case a good modeling target would be to simulate existing data on how tongue movements relate to activity in various cortical regions during speech [23] or to see if the neural model can account for the r…”
BackgroundMethodInfluentialSolving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling
Izhikevich, E. M. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl152 · Cited by 657
Social Feedback to Infants’ Babbling Facilitates Rapid Phonological Learning
Goldstein, M. H., & Schwade, J. A. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02117.x · Cited by 620
Phonological development: the origins of language in the child
(1996) · Choice Reviews Online · doi:10.5860/choice.34-0115 · Cited by 620
Praat script to detect syllable nuclei and measure speech rate automatically
de Jong, N. H., & Wempe, T. (2009) · Behavior Research Methods · doi:10.3758/brm.41.2.385 · Cited by 596 · cited 1×
“To provide an additional metric of the syllabicity of the sounds, as well as a metric that was independent of the development of the computational model, we utilized a Praat script for automatically identifying syllable nuclei in adult speech, developed by de Jong andWempe [74, 75].”
MethodThe Role of Audition in Infant Babbling
Oller, D. K., & Eilers, R. E. (1988) · Child Development · doi:10.2307/1130323 · Cited by 580
THE EMERGENCE OF THE SOUNDS OF SPEECH IN INFANCY
OLLER, D. K. (1980) · Child Phonology · doi:10.1016/b978-0-12-770601-6.50011-5 · Cited by 548
Owren, M. J., & Rendall, D. (2001) · Evolutionary Anthropology: Issues, News, and Reviews · doi:10.1002/evan.1014 · Cited by 421 · cited 1×
“Other work has shown that adults prefer infant vocalizations that are longer, less nasal, and contain intonational contours [29–31], all features that might be expected to correlate with auditory salience [32, 33].”
BackgroundA Social Feedback Loop for Speech Development and Its Reduction in Autism
Warlaumont, A. S., Richards, J. A., Gilkerson, J., & Oller, D. K. (2014) · Psychological Science · doi:10.1177/0956797614531023 · Cited by 388 · cited 1×
“If the model could be made, perhaps through some of the future directions suggested above, to vocalize not every second but at a rate that better matches infants’ actual volubility, and if social reinforcement patterns could be made, by reference to human data, to more accurately match the rates and temporal patterns…”
BackgroundSelf-citationDopaminergic Projections from Midbrain to Primary Motor Cortex Mediate Motor Skill Learning
Hosp, J. A., Pekanovic, A., Rioult-Pedotti, M. S., & Luft, A. R. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5411-10.2011 · Cited by 354
STARK, R. E. (1980) · Child Phonology · doi:10.1016/b978-0-12-770601-6.50010-3 · Cited by 349
Dopamine in Motor Cortex Is Necessary for Skill Learning and Synaptic Plasticity
Molina-Luna, K., Pekanovic, A., Röhrich, S., Hertler, B., Schubring-Giese, M., Rioult-Pedotti, M.-S., & Luft, A. R. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007082 · Cited by 348
Rhythmical behavior in infancy: An ethological perspective.
Thelen, E. (1981) · Developmental Psychology · doi:10.1037//0012-1649.17.3.237 · Cited by 327 · cited 2×
“For example, human infants exhibit many other types of rhythmic motor activities during the first year [18].”
BackgroundMothers provide differential feedback to infants' prelinguistic sounds
Gros-Louis, J., West, M. J., Goldstein, M. H., & King, A. P. (2006) · International Journal of Behavioral Development · doi:10.1177/0165025406071914 · Cited by 290 · cited 1×
“Indeed, observation of naturalistic motherinfant interactions has shown that infant utterances containing both consonants and vowels are more likely to receive interactive vocal responses from mothers than infant utterances that contain only vowel elements [28].”
BackgroundA neural network model of speech acquisition and motor equivalent speech production
Guenther, F. H. (1994) · Biological Cybernetics · doi:10.1007/bf00206237 · Cited by 263
Early Phonetic and Lexical Development: A Productivity Approach
McCune, L., & Vihman, M. M. (2001) · Journal of Speech, Language, and Hearing Research · doi:10.1044/1092-4388(2001/054 · Cited by 257
Development of vocal tract length during early childhood: A magnetic resonance imaging study
Vorperian, H. K., Kent, R. D., Lindstrom, M. J., Kalina, C. M., Gentry, L. R., & Yandell, B. S. (2005) · The Journal of the Acoustical Society of America · doi:10.1121/1.1835958 · Cited by 240
Babbling Development of Hearing-Impaired and Normally Hearing Subjects
Stoel-Gammon, C., & Otomo, K. (1986) · Journal of Speech and Hearing Disorders · doi:10.1044/jshd.5101.33 · Cited by 238 · cited 1×
“More convincing evidence for the role of learning in canonical babbling comes from the fact that infants with severe or profound hearing impairment but who are otherwise typically developing exhibit significant delays in canonical babbling onset [7–9] and produce fewer consonants per utterance [10].”
BackgroundEarly Stages in the Development of Speech Movements
Koopmans-van Beinum, F. J., & van der Stelt, J. M. (1986) · Precursors of Early Speech · doi:10.1007/978-1-349-08023-6_4 · Cited by 210
A new model of sensorimotor coupling in the development of speech
Westermann, G., & Reck Miranda, E. (2004) · Brain and Language · doi:10.1016/s0093-934x(03)00345-6 · Cited by 196
(1986) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-08023-6 · Cited by 194
The supplementary motor region and speech emission
Jonas, S. (1981) · Journal of Communication Disorders · doi:10.1016/0021-9924(81)90019-8 · Cited by 179 · cited 1×
“Patients with paroxysmal lesions to the same region have also been reported to exhibit these types of syllable repetitions [21].”
BackgroundMoulin-Frier, C., Nguyen, S. M., & Oudeyer, P.-Y. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.01006 · Cited by 162
The Motor Core of Speech: A Comparison of Serial Organization Patterns in Infants and Languages
MacNeilage, P. F., Davis, B. L., Kinney, A., & Matyear, C. L. (2000) · Child Development · doi:10.1111/1467-8624.00129 · Cited by 162 · cited 1×
“This is consistent with some work on human infant babbling, which has argued on the basis of phonetic transcription of infants’ canonical babble and first words that the most significant achievement in infant vocalization is the increased control over the movement of various vocal tract articulators, including the ton…”
ResultSchauwers, K., Gillis, S., Daemers, K., De Beukelaer, C., & Govaerts, P. J. (2004) · Otology & Neurotology · doi:10.1097/00129492-200405000-00011 · Cited by 161 · cited 2×
“8: h[11] r ▷ Update the recent reward history.”
BackgroundDo production patterns influence the processing of speech in prelinguistic infants?
DePaolis, R. A., Vihman, M. M., & Keren‐Portnoy, T. (2011) · Infant Behavior and Development · doi:10.1016/j.infbeh.2011.06.005 · Cited by 160 · cited 1×
“It would also be helpful to be able to simultaneously model perceptual and motor speech learning, as there is evidence that learning in each of these modalities affects learning in the other [26, 88, 89].”
BackgroundTowards a neurocomputational model of speech production and perception
Kröger, B. J., Kannampuzha, J., & Neuschaefer-Rube, C. (2009) · Speech Communication · doi:10.1016/j.specom.2008.08.002 · Cited by 158
Handbook of Mammalian Vocalization - An Integrative Neuroscience Approach
(2010) · Handbook of behavioral neuroscience · doi:10.1016/c2009-0-01826-1 · Cited by 155
Functional Neuroanatomy of Human Vocalization: An H215O PET Study
Schulz, G. M., Varga, M., Jeffires, K., Ludlow, C. L., & Braun, A. R. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi061 · Cited by 155
Speech perception is hearing sounds, not tongues
Ohala, J. J. (1996) · The Journal of the Acoustical Society of America · doi:10.1121/1.414696 · Cited by 149 · cited 1×
“The change in baseline activity is consistent with the phonetic research demonstrating that there are greater changes in vocal tract resonances when a change in vocal tract aperture occurs while the vocal tract is nearly closed than when the same change in aperture occurs while the vocal tract is relatively open [76].”
ResultHuang, C. S., Hiraba, H., Murray, G. M., & Sessle, B. J. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.3.635 · Cited by 136 · cited 2×
“Furthermore, direct stimulation of specific regions of the precentral motor cortex elicits vocal fairly specific movements of parts of the vocal tract, such as movements of the vocal folds, movements of the lips, and movements of the jaw, in primates [22, 24, 25], allowing for the possibility that the motor cortex is…”
BackgroundQuality of adult vocalizations affects the quality of infant vocalizations
Bloom, K. (1988) · Journal of Child Language · doi:10.1017/s0305000900012502 · Cited by 134 · cited 1×
“In particular, when adult responses are verbal or syllabic, this tends to promote future infant vocalizations having syllabic properties as well, more than when adult responses are nonverbal or nonsyllabic [73, 86].”
BackgroundBabbling and early speech: continuity and individual differences
Locke, J. L. (1989) · First Language · doi:10.1177/014272378900900606 · Cited by 131 · cited 1×
“Additionally, a case study of an infant who was tracheostomized from 5–20 months of age found that when decannulated at 20 months, the child’s pattern of babbling resembled that of an infant 6 months of age or younger, in that very few utterances contained canonical syllables and the child had a rather small consonant…”
BackgroundIverson, J. M., Hall, A. J., Nickel, L. R., & Wozniak, R. H. (2006) · Brain and Language · doi:10.1016/j.bandl.2006.11.004 · Cited by 121
Intuitive identification of infant vocal sounds by parents
Oller, D. K., Eilers, R. E., & Basinger, D. (2001) · Developmental Science · doi:10.1111/1467-7687.00148 · Cited by 120 · cited 1×
“The milestone of consistent production of canonical syllables has been shown to be a salient event for parents [6].”
BackgroundDevelopment of precursors to speech in infants exposed to two languages
KIMBROUGH OLLER, D., EILERS, R. E., URBANO, R., & COBO-LEWIS, A. B. (1997) · Journal of Child Language · doi:10.1017/s0305000997003097 · Cited by 119
Co‐occurences of preverbal vocal behavior and motor action in early infancy
Ejiri, K., & Masataka, N. (2001) · Developmental Science · doi:10.1111/1467-7687.00147 · Cited by 118
The neural circuitry underlying primate calls and human language
Deacon, T. W. (1989) · Human Evolution · doi:10.1007/bf02436435 · Cited by 115
The Neural Circuitry Underlying Primate Calls and Human Language
Deacon, T. W. (1992) · Springer eBooks · doi:10.1007/978-94-017-2039-7_8 · Cited by 113
Eckel, H. E., Sprinzl, G. M., Koebke, J., Pototschnig, C., Sittel, C., & Stennert, E. (1999) · Annals of Otology Rhinology & Laryngology · doi:10.1177/000348949910800303 · Cited by 112
Dopaminergic Meso-Cortical Projections to M1: Role in Motor Learning and Motor Cortex Plasticity
Hosp, J. A., & Luft, A. R. (2013) · Frontiers in Neurology · doi:10.3389/fneur.2013.00145 · Cited by 111
General cognitive principles for learning structure in time and space
Goldstein, M. H., Waterfall, H. R., Lotem, A., Halpern, J. Y., Schwade, J. A., Onnis, L., & Edelman, S. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.02.004 · Cited by 106 · cited 1×
“Future work should address this more complex issue of possible mechanisms whereby the perceptual content of adult vocalizations combines with the rewarding value of contingent responses to shape infant vocalization qualities (see [87] for a proposal on how some of this might be accomplished).”
BackgroundMonkey lipsmacking develops like the human speech rhythm
Morrill, R. J., Paukner, A., Ferrari, P. F., & Ghazanfar, A. A. (2012) · Developmental Science · doi:10.1111/j.1467-7687.2012.01149.x · Cited by 105 · cited 2×
“Lipsmacking may therefore be an evolutionary precursor to the upper vocal tract movement component of syllabic human speech production [16].”
BackgroundMoulin-Frier, C., Diard, J., Schwartz, J., & Bessìère, P. (2015) · Journal of Phonetics · doi:10.1016/j.wocn.2015.06.001 · Cited by 100
The emergence of the speech capacity
(2000) · Choice Reviews Online · doi:10.5860/choice.37-5483 · Cited by 99
Modeling the Development of Pronunciation in Infant Speech Acquisition
Howard, I. S., & Messum, P. (2011) · Motor Control · doi:10.1123/mcj.15.1.85 · Cited by 98 · cited 1×
“In the model presented here, reinforcement is based on auditory salience (see also [40, 41]).”
BackgroundOn the elicitability of vocalization from the cortical larynx area
Jürgens, U. (1974) · Brain Research · doi:10.1016/0006-8993(74)90853-1 · Cited by 97
Emergent Control of Manual and Vocal-Motor Activity in Relation to the Development of Speech
LOCKE, J. L., Bekken, K., Mcminnlarson, L., & Wein, D. (1995) · Brain and Language · doi:10.1006/brln.1995.1073 · Cited by 92
Role of Vocal Tract Morphology in Speech Development
Ménard, L., Schwartz, J., & Boë, L.-J. (2004) · Journal of Speech Language and Hearing Research · doi:10.1044/1092-4388(2004/079 · Cited by 88
A HUMAN CORTICAL AREA PRODUCING REPETITIVE PHENOMENA WHEN STIMULATED
Brickner, R. M. (1940) · Journal of Neurophysiology · doi:10.1152/jn.1940.3.2.128 · Cited by 86 · cited 1×
“It has been found that direct stimulation of the supplementary motor area in adult humans can, at least in some cases, elicit reduplicated babbling sequences such as repetitions of the syllable “da” or “te” [15, 19, 20].”
BackgroundPrespeech motor learning in a neural network using reinforcement
Warlaumont, A. S., Westermann, G., Buder, E. H., & Oller, D. K. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.11.012 · Cited by 82 · cited 2×
“This is by design, as the goal of the present work was to focus on how infants’ spontaneous vocalizations become more speech-like over the course of the first year of life (see [49] and [65] for further discussion).”
BackgroundSelf-citationFacial Expressions and the Evolution of the Speech Rhythm
Ghazanfar, A. A., & Takahashi, D. Y. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00575 · Cited by 77 · cited 1×
“If it is true that syllabic speech originates from primate lipsmacking, and perhaps that both originated from ingestive behaviors, then human speech may recruit existing central pattern generators for rhythmic oral movement located in the brainstem [15, 17].”
BackgroundLinguistic significance of babbling: evidence from a tracheostomized infant
Locke, J. L., & Pearson, D. M. (1990) · Journal of Child Language · doi:10.1017/s0305000900013076 · Cited by 69 · cited 1×
“Additionally, a case study of an infant who was tracheostomized from 5–20 months of age found that when decannulated at 20 months, the child’s pattern of babbling resembled that of an infant 6 months of age or younger, in that very few utterances contained canonical syllables and the child had a rather small consonant…”
BackgroundHoward, I. S., & Messum, P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110334 · Cited by 65 · cited 1×
“In the model presented here, reinforcement is based on auditory salience (see also [40, 41]).”
BackgroundIyer, S. N., & Oller, D. K. (2008) · The Volta Review · doi:10.17955/tvr.108.2.603 · Cited by 63
Critical branching neural networks.
Kello, C. T. (2013) · Psychological Review · doi:10.1037/a0030970 · Cited by 63 · cited 1×
“The number of subgroups of neurons, the degree of connectivity between neurons, the ways in which synaptic connectivity is scaled, and so on are all parameters that can be explored to see how they affect neural and motor dynamics as well as learning patterns [95, 96].”
BackgroundAdults' attributions of intentionality to vocalizing infants
Beaumont, S. L., & Bloom, K. (1993) · First Language · doi:10.1177/014272379301303805 · Cited by 63
Goldstein, M. H., & West, M. J. (1999) · Journal of Comparative Psychology · doi:10.1037//0735-7036.113.1.52 · Cited by 60 · cited 1×
“Other work has shown that adults prefer infant vocalizations that are longer, less nasal, and contain intonational contours [29–31], all features that might be expected to correlate with auditory salience [32, 33].”
BackgroundLöfgvist, A., & Lindblom, B. E. F. (1994) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(94)90129-5 · Cited by 60
POSSIBLE ANALOGIES IN THE CONTROL OF INNATE MOTOR ACTS AND THE PRODUCTION OF SOUND IN SPEECH
Grillner, S. E. (1982) · Elsevier eBooks · doi:10.1016/b978-0-08-028892-5.50022-0 · Cited by 56
Random graph theory and neuropercolation for modeling brain oscillations at criticality
Kozma, R., & Puljic, M. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.11.005 · Cited by 49 · cited 1×
“The number of subgroups of neurons, the degree of connectivity between neurons, the ways in which synaptic connectivity is scaled, and so on are all parameters that can be explored to see how they affect neural and motor dynamics as well as learning patterns [95, 96].”
BackgroundCentral pattern generators for orofacial movements and speech
Barlow, S. M., Lund, J. P., Radder, M. E., & Kolta, A. (2010) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-374593-4.00033-4 · Cited by 47
Acoustic properties that determine adults' preferences for 3-month-old infant vocalizations
Masataka, N., & Bloom, K. (1994) · Infant Behavior and Development · doi:10.1016/0163-6383(94)90038-8 · Cited by 47
An Articulatory Phonology Account of Preferred Consonant-Vowel Combinations
Giulivi, S., Whalen, D. H., Goldstein, L. M., Nam, H., & Levitt, A. G. (2011) · Language Learning and Development · doi:10.1080/15475441.2011.564569 · Cited by 41
Kröger, B. J., Kannampuzha, J., & Kaufmann, E. (2014) · EPJ Nonlinear Biomedical Physics · doi:10.1140/epjnbp15 · Cited by 39 · cited 1×
“Our model thus complements previous work on early vocal learning by addressing the question of how infants come to structure their vocalizations syllabically and by focusing on relating this to some key properties of human motor cortex; to do this we simplify the problem in a number of ways, leaving integration with p…”
ResultAdult preferences for syllabic vocalizations: Generalizations to parity and native language
Bloom, K., D’Odorico, L., & Beaumont, S. L. (1993) · Infant Behavior and Development · doi:10.1016/0163-6383(93)80032-4 · Cited by 39
An Emergence Approach to Speech Acquisition
Davis, B. L., & Bedore, L. M. (2013) · Psychology Press eBooks · doi:10.4324/9780203375303 · Cited by 39 · cited 4×
“It would also be helpful to be able to simultaneously model perceptual and motor speech learning, as there is evidence that learning in each of these modalities affects learning in the other [26, 88, 89].”
BackgroundResultInfluentialCuriosity-driven phonetic learning
Moulin-Frier, C., & Oudeyer, P.-Y. (2012) · 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL) · doi:10.1109/devlrn.2012.6400583 · Cited by 36
Murakami, M., Kröger, B. J., Birkholz, P., & Triesch, J. (2015) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2015.7346142 · Cited by 34
Silent Mandibular Oscillations in Vocal Babbling
Meier, R. P., McGarvin, L., Zakia, R. A. E., & Willerman, R. (1997) · Phonetica · doi:10.1159/000262219 · Cited by 32 · cited 1×
“Infants have been observed to produce silent jaw oscillations without phonation [84], perhaps reflecting that they are still in the process of exploring and learning about the relationship between the larynx and the jaw in sound production.”
BackgroundComputational simulation of CV combination preferences in babbling
Nam, H., Goldstein, L. M., Giulivi, S., Levitt, A. G., & Whalen, D. H. (2013) · Journal of Phonetics · doi:10.1016/j.wocn.2012.11.002 · Cited by 29
Interference and Shaping in Sensorimotor Adaptations with Rewards
Darshan, R., Leblois, A., & Hansel, D. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003377 · Cited by 26 · cited 1×
“rewards that are not binary on or off) [97] and the manner in which neural activity is smoothed or filtered prior to using it to control muscle activity.”
BackgroundVowel Acquisition Based on an Auto-Mirroring Bias with a Less Imitative Caregiver
Miura, K., Yoshikawa, Y., & Asada, M. (2012) · Advanced Robotics · doi:10.1163/016918611x607347 · Cited by 23
Ejiri, K., & Masataka, N. (1999) · The Japanese journal of psychology · doi:10.4992/jjpsy.69.433 · Cited by 23
Philippsen, A. K., Reinhart, F., & Wrede, B. (2014) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2014.6982981 · Cited by 21
Salience-based reinforcement of a spiking neural network leads to increased syllable production
Warlaumont, A. S. (2013) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2013.6652547 · Cited by 20 · cited 2×
“In previous work [59, 60], the syllabicity of the sounds produced by a similar model had been evaluated using two metrics.”
MethodResultSelf-citationArticulatory evidence for syllabic structure
Munhall, K. G., & Jones, J. A. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98391268 · Cited by 18
Iyer, S. N., & Oller, D. K. (2008) · Clinical Linguistics & Phonetics · doi:10.1080/02699200802316776 · Cited by 17
Model cortical responses for the detection of perceptual onsets and beat tracking in singing
Coath, M., Denham, S. L., Smith, L. M., Honing, H., Hazan, A., Holonowicz, P., & Purwins, H. (2009) · Connection Science · doi:10.1080/09540090902733905 · Cited by 17 · cited 3×
“Auditory salience can be estimated automatically [36, 37], and tends to be higher when vocalizations contain both consonants and vowels than when vocalizations contain only vowels [38, 39].”
BackgroundMethodChorley, P., & Seth, A. K. (2011) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2011.00021 · Cited by 16 · cited 1×
“See [64] for another example of an adaptation of such models to a reservoir architecture.”
BackgroundEvaluating parameters for mapping adult vowels to imitative babbling
Heintz, I., Beckman, M. E., Fosler‐Lussier, E., & Ménard, L. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-238 · Cited by 16
Continuous vocal imitation with self-organized vowel spaces in Recurrent Neural Network
Kanda, H., Ogata, T., TAKAHASHI, T. T., Komatani, K., & Okuno, H. G. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152818 · Cited by 15
A spiking neural network model of canonical babbling development
Warlaumont, A. S. (2012) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2012.6400842 · Cited by 14 · cited 2×
“In previous work [59, 60], the syllabicity of the sounds produced by a similar model had been evaluated using two metrics.”
MethodResultSelf-citationWarlaumont, A. S., Westermann, G., & Oller, D. K. (2011) · Lancaster EPrints (Lancaster University) · Cited by 10
Self-citationEndo, N., Kojima, T., Ishihara, H., Horii, T., & Asada, M. (2014) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2014.7041496 · Cited by 8 · cited 1×
“Additionally, headway is being made into creating a robotic model of an infant vocal tract [102].”
BackgroundModeling the emergence of syllabic structure
Warlaumont, A. S. (2015) · Journal of Phonetics · doi:10.1016/j.wocn.2015.06.004 · Cited by 6
Self-citationOhala, J. J. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98401262 · Cited by 4
Cyclicity in speech derived from call repetition rather than from intrinsic cyclicity of ingestion
Andrew, R. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98241264 · Cited by 3
Distributed neural substrates and the evolution of speech production
Ghazanfar, A. A., & Katz, D. B. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x9828126x · Cited by 3
REINFORCEMENT-MODULATED SELF-ORGANIZATION IN INFANT MOTOR SPEECH LEARNING
Warlaumont, A. S. (2013) · doi:10.1142/9789814458849_0009 · Cited by 3 · cited 1×
“This is by design, as the goal of the present work was to focus on how infants’ spontaneous vocalizations become more speech-like over the course of the first year of life (see [49] and [65] for further discussion).”
BackgroundSelf-citationWarlaumont, A. S. (2014) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2014.6982991 · Cited by 2 · cited 1×
“If the model could be made, perhaps through some of the future directions suggested above, to vocalize not every second but at a rate that better matches infants’ actual volubility, and if social reinforcement patterns could be made, by reference to human data, to more accurately match the rates and temporal patterns…”
BackgroundSelf-citationBarbero (2014) · doi:10.1016/j · Cited by 1
Research works printed but not linked: 4
- DK Oller, 1980, Child phonology, vol. 1: Production, 93
- RE Stark, 1980, Child phonology, vol. 1: Production, 73
- M Coath, 2007, Proceedings of the Neural Information Processing Systems Workshop on Music Processing in the Brain, 1
- Goldstein UG. An articulatory model for the vocal tracts of growing children [Sc.D. Thesis]. Massachusetts Institute of Technology; 1980.
Cited by
Silent Speech Interfaces for Speech Restoration: A Review
González, J. A., Gomez-Alanis, A., Martín-Doñas, J. M., Pérez-Córdoba, J. L., & Gomez, A. M. (2020) · IEEE Access · doi:10.1109/access.2020.3026579 · Cited by 188
“robotic prosthesis [304] and in computational models imitating vocal learning in infants [305], [306], with encouraging results.”
ResultLiu, S., Xiao, T., Yang, L., & Loprinzi, P. D. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16203912 · Cited by 121
“Behavioral addictions, a type of impulse control disorder [50], may be attenuated with chronic exercise engagement given the role of exercise on prefrontal cortex-dependent executive function.”
BackgroundPrediction of autism in infants: progress and challenges
Dawson, G., Rieder, A. D., & Johnson, M. H. (2022) · The Lancet Neurology · doi:10.1016/s1474-4422(22)00407-0 · Cited by 152
Albert, R. R., Schwade, J. A., & Goldstein, M. H. (2017) · Developmental Science · doi:10.1111/desc.12641 · Cited by 119
“…work using computational modeling has revealed evidence of neural mechanisms (e.g., spike-timing dependent plasticity) that could underlie changes in vocalizations as a result of contingent feedback (e.g., Takahashi et al., 2015; Takahaski, Liao, & Ghanzafar, 2017; Warlaumont & Finnegan, 2016).”
BackgroundLam-Cassettari, C., & Kohlhoff, J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236787 · Cited by 49
“This finding is important because exposure to speech, and the level of involvement that infants have with early conversations is associated with early language development [8,10,15,16,18].”
Background
Metadata
- Authors
- Warlaumont, A. S., & Finnegan, M. K.
- Affiliations
- University of California, Merced (US)
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Warlaumont, Anne S.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-01-25
- Volume
- 11
- Issue
- 1
- Pages
- e0145096
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4726623
- OpenAlex
- W2252657604
- Cited by
- 71
- References
- 106
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 3 · 2023: 4 · 2022: 3 · 2021: 4 · 2020: 38 · 2019: 4 · 2018: 5 · 2017: 5 · 2016: 2
- FWCI
- 12.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- National Science Foundation (1040962)
- University of California Merced
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Animal Vocal Communication and Behavior
- Keywords
- canonical babbling, syllable production, infant speech development, spike-timing-dependent plasticity, dopaminergic modulation, reinforcement learning, spiking neural networks, vocal tract modeling, auditory salience
- MeSH terms
- Machine Learning, Auditory Perception, Computer Simulation, Dopamine, Feedback, Humans, Infant, Jaw, Language Development, Laryngeal Muscles, Lip, Models, Neurological, Motor Cortex, Motor Neurons, Nerve Net, Neuronal Plasticity, Phonetics, Reward, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.