Learning words from sights and sounds: a computational model
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
This paper presents an implemented computational model of word acquisition which learns directly from raw multimodal sensory input. Set in an information theoretic framework, the model acquires a lexicon by finding and statistically modeling consistent cross‐modal structure. The model has been implemented in a system using novel speech processing, computer vision, and machine learning algorithms. In evaluations the model successfully performed speech segmentation, word discovery and visual categorization from spontaneous infant‐directed speech paired with video images of single objects. These results demonstrate the possibility of using state‐of‐the‐art techniques from sensory pattern recognition and machine learning to implement cognitive models which can process raw sensor data without the need for human transcription or labeling.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Language development relies on implicit learning of regularities in speech and their pairing with visual cues in the environment.(51–56)”
From Neglect as a violation of species-expectant experience: neurodevelopmental consequences (2017) · cites this paper as [54]
Citations
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 2×
“The Forward algorithm (Rabiner, 1989) can be used to compute P(␣ i ͉ j ) and P(␣ j ͉ i ), the probability that the HMM derived from speech segment ␣ i generated speech segment ␣ j and vice versa.”
MethodNeural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
(1960) · Medical Entomology and Zoology · Cited by 5,851
Statistical learning by 8-month-old infants
Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996) · Science · doi:10.1126/science.274.5294.1926 · Cited by 5,659
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Cognitive representations of semantic categories.
Rosch, E. H. (1975) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.104.3.192 · Cited by 4,756
The CHILDES project: tools for analyzing talk
MacWhinney, B. (1992) · Child Language Teaching and Therapy · doi:10.1177/026565909200800211 · Cited by 3,396
Research works printed but not linked: 5
- Aslin R., 1996, Signal to syntax, 117
- Garofolo J., 1988, Getting started with the DARPA TIMIT CD‐ROM: An acoustic phonetic continuous speech database.
- 10.1037/0096-3445.104.3.192 · doi:10.1037/0096-3445.104.3.192 · Paper page
- Roy D.(1999).Learning words from sights and sounds: A computational model. Unpublished doctoral dissertation Massachusetts Institute of Technology.
- 10.2307/1127555 · doi:10.2307/1127555 · Paper page
Cited by
Word learning as Bayesian inference.
Xu, F., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.245 · Cited by 1,033
Cognitive Developmental Robotics: A Survey
Asada, M., Hosoda, K., Kuniyoshi, Y., Ishiguro, H., Inui, T., Yoshikawa, Y., Ogino, M., & Yoshida, C. (2009) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2009.2021702 · Cited by 554
Affective Learning — A Manifesto
Picard, R. W., Papert, S., Bender, W., Blumberg, B., Breazeal, C., Cavallo, D., Machover, T., Resnick, M., Roy, D., & Strohecker, C. (2004) · BT Technology Journal · doi:10.1023/b:bttj.0000047603.37042.33 · Cited by 504
Self-citationSocial Interactions in HRI: The Robot View
Breazeal, C. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2004.826268 · Cited by 488
McMurray, B., Horst, J. S., & Samuelson, L. K. (2012) · Psychological Review · doi:10.1037/a0029872 · Cited by 457
Integrating experiential and distributional data to learn semantic representations.
Andrews, M., Vigliocco, G., & Vinson, D. (2009) · Psychological Review · doi:10.1037/a0016261 · Cited by 454
Self-supervised speech representation learning: A review
Mohamed, A., Lee, H.-Y., Borgholt, L., Havtorn, J. D., Edin, J., Igel, C., Kirchhoff, K., Li, S.-W., Livescu, K., Maaløe, L., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3207050 · Cited by 372
Unsupervised Pattern Discovery in Speech
Park, A. S., & Glass, J. R. (2008) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2007.909282 · Cited by 351
Grounded Language Learning in a Simulated 3D WorldPreprint
Hermann, K. M., Hill, F., Green, S., Wang, F., Faulkner, R., Soyer, H., Szepesvári, D., Czarnecki, W. M., Jaderberg, M., Teplyashin, D., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06551 · Cited by 326
Computational Generation of Referring Expressions: A Survey
Krahmer, E., & van Deemter, K. (2012) · Computational Linguistics · doi:10.1162/coli_a_00088 · Cited by 325
From the Lexicon to Expectations About Kinds: A Role for Associative Learning.
Colunga, E., & Smith, L. B. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.347 · Cited by 324
Statistical clustering and the contents of the infant vocabulary
Swingley, D. (2005) · Cognitive Psychology · doi:10.1016/j.cogpsych.2004.06.001 · Cited by 306
Neglect as a violation of species-expectant experience: neurodevelopmental consequences
McLaughlin, K. A., Sheridan, M. A., & Nelson, C. A. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.02.1096 · Cited by 295
The Coordinated Interplay of Scene, Utterance, and World Knowledge: Evidence From Eye Tracking
Knoeferle, P., & Crocker, M. W. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_65 · Cited by 279
Validating Human–Robot Interaction Schemes in Multitasking Environments
Crandall, J. W., Goodrich, M. A., Olsen, D. R., & Nielsen, C. W. (2005) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2005.850587 · Cited by 268
Reinforcement learning for mapping instructions to actions
Branavan, S. R. K., Chen, H., Zettlemoyer, L. S., & Barzilay, R. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - ACL-IJCNLP '09 · doi:10.3115/1687878.1687892 · Cited by 243
The Emergence of Words: Attentional Learning in Form and Meaning
Regier, T. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_31 · Cited by 233
Dynamic Self‐Organization and Early Lexical Development in Children
Li, P., Zhao, X., & Mac Whinney, B. (2007) · Cognitive Science · doi:10.1080/15326900701399905 · Cited by 232
Concepts as Semantic Pointers: A Framework and Computational Model
Blouw, P., Solodkin, E., Thagard, P., & Eliasmith, C. (2016) · Cognitive Science · doi:10.1111/cogs.12265 · Cited by 230
The challenges of joint attention
Kaplan, F., & Hafner, V. V. (2006) · Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.7.2.04kap · Cited by 225
Tellex, S., Gopalan, N., Kress-Gazit, H., & Matuszek, C. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-101119-071628 · Cited by 220
A unified model of early word learning: Integrating statistical and social cues
Yu, C., & Ballard, D. H. (2007) · Neurocomputing · doi:10.1016/j.neucom.2006.01.034 · Cited by 219
Semiotic schemas: A framework for grounding language in action and perception
Roy, D. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.04.007 · Cited by 215
Self-citationDupoux, E. (2018) · Cognition · doi:10.1016/j.cognition.2017.11.008 · Cited by 208
Variability and Consistency in Early Language Learning: The Wordbank Project
Frank, M. C., Braginsky, M., Yurovsky, D., & Marchman, V. A. (2021) · doi:10.7551/mitpress/11577.001.0001 · Cited by 206
Learning visually grounded words and syntax for a scene description task
Roy, D. K. (2002) · Computer Speech & Language · doi:10.1016/s0885-2308(02)00024-4 · Cited by 192
Self-citationGrounding words in perception and action: computational insights
Roy, D. K. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.06.013 · Cited by 190
Self-citationThe Role of Embodied Intention in Early Lexical Acquisition
Yu, C., Ballard, D. H., & Aslin, R. N. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_40 · Cited by 187
Grounded language acquisition through the eyes and ears of a single child
Vong, W. K., Wang, W., Orhan, A. E., & Lake, B. M. (2024) · Science · doi:10.1126/science.adi1374 · Cited by 186
DEVELOPMENTAL ROBOTICS: THEORY AND EXPERIMENTS
WENG, J. (2004) · International Journal of Humanoid Robotics · doi:10.1142/s0219843604000149 · Cited by 171
Grounded Semantic Composition for Visual Scenes
Gorniak, P., & Roy, D. K. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1327 · Cited by 171
Self-citationLearning to Win by Reading Manuals in a Monte-Carlo Framework
Branavan, S. R. K., Silver, D., & Barzilay, R. (2012) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3484 · Cited by 170
Connecting language to the world
Roy, D., & Reiter, E. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.06.002 · Cited by 169
Self-citationJointly Discovering Visual Objects and Spoken Words from Raw Sensory Input
Harwath, D., Recasens, A., Surís, D., Chuang, G., Torralba, A., & Glass, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_40 · Cited by 165
Zwaan, R. A., & Rapp, D. N. (2006) · Elsevier eBooks · doi:10.1016/b978-012369374-7/50019-5 · Cited by 154
Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervision
Tan, H. X., & Bansal, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.162 · Cited by 152
Roy, D. K., Patel, R., DeCamp, P., Kubat, R., Fleischman, M., Roy, B., Mavridis, N., Tellex, S., Salata, A., Guinness, J., et al. (2006) · Lecture notes in computer science · doi:10.1007/11880172_15 · Cited by 151
Self-citationSymbol emergence in robotics: a survey
Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., & Asoh, H. (2016) · Advanced Robotics · doi:10.1080/01691864.2016.1164622 · Cited by 150
Fine-grained sensitivity to statistical information in adult word learning
Vouloumanos, A. (2007) · Cognition · doi:10.1016/j.cognition.2007.08.007 · Cited by 149
From Action to Interaction: Infant Object Exploration and Mothers' Contingent Responsiveness
Tamis‐LeMonda, C. S., Kuchirko, Y. A., & Tafuro, L. (2013) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2013.2269905 · Cited by 148
Representations of language in a model of visually grounded speech signal
Chrupała, G., Gelderloos, L., & Alishahi, A. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1057 · Cited by 146
A multimodal learning interface for grounding spoken language in sensory perceptions
Yu, C., & Ballard, D. H. (2004) · ACM Transactions on Applied Perception · doi:10.1145/1008722.1008727 · Cited by 142
Reaching over the gap: A review of efforts to link human and automatic speech recognition research
Scharenborg, O. (2007) · Speech Communication · doi:10.1016/j.specom.2007.01.009 · Cited by 137
Multi-cue Zero-Shot Learning with Strong Supervision
Akata, Z., Malinowski, M., Fritz, M., & Schiele, B. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.14 · Cited by 134
Language comprehension is both embodied and symbolic
Louwerse, M. M., & Jeuniaux, P. P. J. M. H. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199217274.003.0015 · Cited by 133
Modeling embodied visual behaviors
Sprague, N. R., Ballard, D. H., & Robinson, A. E. (2007) · ACM Transactions on Applied Perception · doi:10.1145/1265957.1265960 · Cited by 130
Mental Imagery for a Conversational Robot
Roy, D. K., Hsiao, K.-Y., & Mavridis, N. (2004) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2004.823327 · Cited by 126
Self-citationDomain-General Learning Capacities
Saffran, J. R., & Thiessen, E. D. (2008) · Blackwell Publishing Ltd eBooks · doi:10.1002/9780470757833.ch4 · Cited by 117
Training personal robots using natural language instruction
Lauria, S., Bugmann, G., Kyriacou, T., Bos, J., & Klein, A. (2001) · IEEE Intelligent Systems · doi:10.1109/5254.956080 · Cited by 117
An Alternative to Mapping a Word onto a Concept in Language Acquisition: Pragmatic Frames
Rohlfing, K. J., Wrede, B., Vollmer, A.-L., & Oudeyer, P.-Y. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00470 · Cited by 113
A Statistical Associative Account of Vocabulary Growth in Early Word Learning
Yu, C. (2008) · Language Learning and Development · doi:10.1080/15475440701739353 · Cited by 113
Learning multi-modal grounded linguistic semantics by playing I Spy
Thomason, J., Sinapov, J., Svetlik, M., Stone, P., & Mooney, R. J. (2016) · International Joint Conference on Artificial Intelligence · Cited by 106
Tangible Words are Recognized Faster: The Grounding of Meaning in Sensory and Perceptual Systems
Juhasz, B. J., Yap, M. J.-M., Dicke, J., Taylor, S. C., & Gullick, M. M. (2011) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2011.605150 · Cited by 105
Frank, M. C., Tenenbaum, J. B., & Fernald, A. E. (2012) · Language Learning and Development · doi:10.1080/15475441.2012.707101 · Cited by 103
Emergent constraints on word-learning: a computational perspective
Regier, T. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00108-6 · Cited by 101
Learning to talk about events from narrated video in a construction grammar framework
Dominey, P. F., & Boucher, J.-D. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.06.007 · Cited by 98
New horizons in the study of child language acquisition
Roy, D. K. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-3 · Cited by 96
Self-citationWords in puddles of sound: modelling psycholinguistic effects in speech segmentation
Monaghan, P., & Christiansen, M. H. (2010) · Journal of Child Language · doi:10.1017/s0305000909990511 · Cited by 96
Grounded spoken language acquisition: experiments in word learning
Roy, D. K. (2003) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2003.811618 · Cited by 95
Self-citationJointly Discovering Visual Objects and Spoken Words from Raw Sensory Input
Harwath, D. F., Recasens, A., Surís, D., Chuang, G., Torralba, A. B., & Glass, J. R. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01205-0 · Cited by 92
Learning to connect language and perception
Mooney, R. J. (2008) · National Conference on Artificial Intelligence · Cited by 91
Active Information Selection: Visual Attention Through the Hands
Yu, C., Smith, L. B., Shen, H., Pereira, A. F., & Smith, T. G. (2009) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2009.2031513 · Cited by 89
Learning Hierarchical Discrete Linguistic Units from Visually-Grounded SpeechPreprint
Harwath, D. F., Hsu, W.-N., & Glass, J. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09602 · Cited by 87
Grounding of word meanings in multimodal concepts using LDA
Nakamura, T., Nagai, T., & Iwahashi, N. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354736 · Cited by 86
PRESENCE: A Human-Inspired Architecture for Speech-Based Human-Machine Interaction
Moore, R. K. (2007) · IEEE Transactions on Computers · doi:10.1109/tc.2007.1080 · Cited by 85
On the integration of grounding language and learning objects
Yu, C., & Ballard, D. H. (2004) · National Conference on Artificial Intelligence · Cited by 85
Steels, L., & Loetzsch, M. (2012) · Advances in interaction studies · doi:10.1075/ais.3.04ste · Cited by 81
PERUSE: An unsupervised algorithm for finding recurring patterns in time series
Oates, T. (2003) · Proceedings · doi:10.1109/icdm.2002.1183920 · Cited by 79
Clark, E. V. (2015) · Wiley eBooks · doi:10.1002/9781118346136.ch15 · Cited by 75
Encoding of phonology in a recurrent neural model of grounded speech
Alishahi, A., Barking, M., & Chrupała, G. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1037 · Cited by 74
Models of Semantic Representation with Visual Attributes
Silberer, C., Ferrari, V., & Lapata, M. (2013) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 73
Spoken language processing: Piecing together the puzzle
Moore, R. K. (2007) · Speech Communication · doi:10.1016/j.specom.2007.01.011 · Cited by 71
Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog
Thomason, J., Padmakumar, A., Sinapov, J., Walker, N., Jiang, Y., Yedidsion, H., Hart, J., Stone, P., & Mooney, R. J. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11485 · Cited by 68
Towards grounding concepts for transfer in goal learning from demonstration
Chao, C., Çakmak, M., & Thomaz, A. L. (2011) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2011.6037321 · Cited by 68
Semantic Speech Retrieval With a Visually Grounded Model of Untranscribed Speech
Kamper, H., Shakhnarovich, G., & Livescu, K. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2872106 · Cited by 66
Whitman, B., & Ellis, D. P. W. (2004) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1416645 · Cited by 64
The emergence of links between lexical acquisition and object categorization: a computational study
Yu, C. (2005) · Connection Science · doi:10.1080/09540090500281554 · Cited by 63
A computational model for unsupervised word discovery
ten Bosch, L., & Cranen, B. (2007) · Interspeech (USB) · doi:10.21437/interspeech.2007-429 · Cited by 62
Towards unsupervised speech processing
Glass, J. R. (2012) · International Conference on Information Science, Signal Processing and their Applications (ISSPA) · doi:10.1109/isspa.2012.6310546 · Cited by 62
Developmental stages of perception and language acquisition in a perceptually grounded robot
Dominey, P. F., & Boucher, J.-D. (2004) · Cognitive Systems Research · doi:10.1016/j.cogsys.2004.11.005 · Cited by 62
Updated MINDS report on speech recognition and understanding, Part 2 [DSP Education]
Baker, J. M., Deng, L., Khudanpur, S. P., Lee, C., Glass, J. R., Morgan, N., & O’Shaughnessy, D. D. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2009.932707 · Cited by 59
Vogt, P. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00353-6 · Cited by 56
SERKET: An Architecture for Connecting Stochastic Models to Realize a Large-Scale Cognitive Model
Nakamura, T., Nagai, T., & Taniguchi, T. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00025 · Cited by 55
Taniguchi, T., Nakamura, T., Suzuki, M., Kuniyasu, R., Hayashi, K., Taniguchi, A., Horii, T., & Nagai, T. (2020) · New Generation Computing · doi:10.1007/s00354-019-00084-w · Cited by 55
Symbolic Models and Emergent Models: A Review
Weng, J. (2011) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2011.2159113 · Cited by 55
Autonomous development of a grounded object ontology by a learning robot
Modayil, J., & Kuipers, B. J. (2007) · National Conference on Artificial Intelligence · Cited by 55
Whitman, B., & Vercoe, B. L. (2005) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 55
Chrupała, G. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12967 · Cited by 54
Learning Words in Space and Time: Probing the Mechanisms Behind the Suspicious-Coincidence Effect
Spencer, J. P., Perone, S., Smith, L. B., & Samuelson, L. K. (2011) · Psychological Science · doi:10.1177/0956797611413934 · Cited by 54
Protocols from perceptual observations
Needham, C. J., Santos, P. E., Magee, D., Devin, V., Hogg, D., & Cohn, A. G. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.04.006 · Cited by 54
Communicative Feedback in Language AcquisitionPreprint
Nikolaus, M., & Fourtassi, A. (2022) · PsyArXiv (OSF Preprints) · doi:10.1016/j.newideapsych.2022.100985 · Cited by 53
Steels, L., & Spranger, M. (2008) · Connection Science · doi:10.1080/09540090802413186 · Cited by 52
TOWARDS SPEECH TRANSLATION OF NON WRITTEN LANGUAGES
Besacier, L., Zhou, B., & Gao, Y. (2006) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2006.326795 · Cited by 52
Fitzpatrick, P., & Brooks, R. A. (2003) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 52
The Impact of Human–Robot Interfaces on the Learning of Visual Objects
Rouanet, P., Oudeyer, P., Danieau, F., & Filliat, D. (2013) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2228134 · Cited by 51
A well grounded education: The role of perception in science and mathematics
Goldstone, R. L., Landy, D. H., & Son, J. Y. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199217274.003.0016 · Cited by 51
Araki, T., Nakamura, T., Nagai, T., Nagasaka, S., Taniguchi, T., & Iwahashi, N. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385812 · Cited by 49
Social coordination in toddler's word learning: interacting systems of perception and action
Pereira, A. F., Smith, L. B., & Yu, C. (2008) · Connection Science · doi:10.1080/09540090802091891 · Cited by 49
Learning visually grounded words and syntax of natural spoken language
Roy, D. K. (2001) · Evolution of Communication · doi:10.1075/eoc.4.1.04roy · Cited by 47
Self-citationA system for interactive learning in dialogue with a tutor
Skočaj, D., Kristan, M., Vrečko, A., Mahnič, M., Janíček, M., Kruijff, G.-J. M., Hanheide, M., Hawes, N., Keller, T., Zillich, M., et al. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094926 · Cited by 45
Metadata
- Authors
- Roy, D. K., & Pentland, A. P.
- Affiliations
- MIT Media Lab (US)
- Corresponding author
- Roy, Deb K.
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 2002-01
- Volume
- 26
- Issue
- 1
- Pages
- 113-146
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2107917162
- Cited by
- 521
- References
- 51
- Citations by year
- 2025: 1 · 2024: 6 · 2023: 10 · 2022: 13 · 2021: 12 · 2020: 14 · 2019: 18 · 2018: 13 · 2017: 25 · 2016: 25 · 2015: 18 · 2014: 14 · 2013: 24 · 2012: 20
- FWCI
- 59.99
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cognitive Science (publishedVersion)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- vocabulary acquisition, cross-modal correspondence, information theory, speech segmentation, word discovery, visual categorization, infant-directed speech, object recognition, cognitive modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.