Learning words from sights and sounds: a computational model
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
This paper presents an implemented computational model of word acquisition which learns directly from raw multimodal sensory input. Set in an information theoretic framework, the model acquires a lexicon by finding and statistically modeling consistent cross‐modal structure. The model has been implemented in a system using novel speech processing, computer vision, and machine learning algorithms. In evaluations the model successfully performed speech segmentation, word discovery and visual categorization from spontaneous infant‐directed speech paired with video images of single objects. These results demonstrate the possibility of using state‐of‐the‐art techniques from sensory pattern recognition and machine learning to implement cognitive models which can process raw sensor data without the need for human transcription or labeling.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Language development relies on implicit learning of regularities in speech and their pairing with visual cues in the environment.(51–56)”
From Neglect as a violation of species-expectant experience: neurodevelopmental consequences (2017) · cites this paper as [54]
Citations
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 2×
“The Forward algorithm (Rabiner, 1989) can be used to compute P(␣ i ͉ j ) and P(␣ j ͉ i ), the probability that the HMM derived from speech segment ␣ i generated speech segment ␣ j and vice versa.”
MethodNeural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
(1960) · Medical Entomology and Zoology · Cited by 5,851
Statistical learning by 8-month-old infants
Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996) · Science · doi:10.1126/science.274.5294.1926 · Cited by 5,659
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Cognitive representations of semantic categories.
Rosch, E. H. (1975) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.104.3.192 · Cited by 4,756
The CHILDES project: tools for analyzing talk
MacWhinney, B. (1992) · Child Language Teaching and Therapy · doi:10.1177/026565909200800211 · Cited by 3,396
Research works printed but not linked: 5
- Aslin R., 1996, Signal to syntax, 117
- Garofolo J., 1988, Getting started with the DARPA TIMIT CD‐ROM: An acoustic phonetic continuous speech database.
- 10.1037/0096-3445.104.3.192 · doi:10.1037/0096-3445.104.3.192 · Paper page
- Roy D.(1999).Learning words from sights and sounds: A computational model. Unpublished doctoral dissertation Massachusetts Institute of Technology.
- 10.2307/1127555 · doi:10.2307/1127555 · Paper page
Cited by
Items 101–200 of 586
Computational models in the debate over language learnability
Kaplan, F., Oudeyer, P., & Bergen, B. K. (2008) · Infant and Child Development · doi:10.1002/icd.544 · Cited by 47
Yamada, T., Murata, S., Arie, H., & Ogata, T. (2016) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2016.00005 · Cited by 46
Grounding of Word Meanings in Latent Dirichlet Allocation-Based Multimodal Concepts
Nakamura, T., Araki, T., Nagai, T., & Iwahashi, N. (2011) · Advanced Robotics · doi:10.1163/016918611x595035 · Cited by 44
Pay no attention to that man behind the curtain: Explaining semantics without semantics
Westbury, C. F. (2016) · The Mental Lexicon · doi:10.1075/ml.11.3.02wes · Cited by 44
Emergence of Communication in an Interactive World with Consistent SpeakersPreprint
Bogin, B., Geva, M., & Berant, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.00549 · Cited by 44
Self-Understanding and Self-Extension: A Systems and Representational Approach
Wyatt, J. L., Aydemir, A., Brenner, M., Hanheide, M., Hawes, N., Jensfelt, P., Kristan, M., Kruijff, G.-J. M., Lison, P., Pronobis, A., et al. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2090149 · Cited by 38
Musical query-by-description as a multiclass learning problem
Whitman, B., & Rifkin, R. M. (2004) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2002.1203270 · Cited by 43
A Computational Model of Language Acquisition: the Emergence of Words
ten Bosch, L., Boves, L., hamme, H. V., & Moore, R. K. (2009) · Fundamenta Informaticae · doi:10.3233/fi-2009-0016 · Cited by 42
Towards Visually Grounded Sub-word Speech Unit Discovery
Harwath, D. F., & Glass, J. R. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682666 · Cited by 42
A Compositional Framework for Grounding Language Inference, Generation, and Acquisition in Video
Yu, H., Siddharth, N., Barbu, A., & Siskind, J. M. (2015) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4556 · Cited by 42
Taniguchi, T., Nagasaka, S., & Nakashima, R. (2016) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2550591 · Cited by 35
Credit Assignment in Multiple Goal Embodied Visuomotor Behavior
Rothkopf, C. A., & Ballard, D. H. (2010) · Frontiers in Psychology · doi:10.3389/fpsyg.2010.00173 · Cited by 37
Taniguchi, A., Taniguchi, T., & Inamura, T. (2016) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2565542 · Cited by 41
Robots That Learn Language: A Developmental Approach to Situated Human-Robot Conversations
Iwahashi, N. (2007) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.5772/5188 · Cited by 41
Cunillera, T., Laine, M., Càmara, E., & Rodríguez‐Fornells, A. (2010) · Journal of Memory and Language · doi:10.1016/j.jml.2010.05.003 · Cited by 41
ACORNS - towards computational modeling of communication and recognition skills
Boves, L., ten Bosch, L., & Moore, R. K. (2007) · IEEE International Conference on Cognitive Informatics · doi:10.1109/coginf.2007.4341909 · Cited by 40
Modelling early language acquisition skills: towards a general statistical learning mechanism
Aimetti, G. (2009) · Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop (EACL SRW) · doi:10.3115/1609179.1609180 · Cited by 39
ONLINE LEARNING OF OBJECTS IN A BIOLOGICALLY MOTIVATED VISUAL ARCHITECTURE
Wersing, H., Kirstein, S., Götting, M., Brandl, H., DUNN, M., Mikhailova, I., Goerick, C., Steil, J. J., Ritter, H. J., & Körner, E. (2007) · International Journal of Neural Systems · doi:10.1142/s0129065707001081 · Cited by 41
Visually Grounded Cross-Lingual Keyword Spotting in Speech
Kamper, H., & Roth, M. (2018) · Workshop Spoken Language Technologies for Under-resourced Languages · doi:10.21437/sltu.2018-53 · Cited by 39
Learning a language model from continuous speech
Neubig, G., Mimura, M., Mori, S., & Kawahara, T. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-345 · Cited by 38
Personalized multimedia retrieval: the new trend?
Sebe, N., & Tian, Q. C. (2007) · Multimedia Information Retrieval · doi:10.1145/1290082.1290124 · Cited by 38
Intelligent Management of Data Driven Simulations to Support Model Building in the Social Sciences
Kennedy, C. M., & Theodoropoulos, G. K. (2006) · Lecture notes in computer science · doi:10.1007/11758532_74 · Cited by 38
Understanding Early Word Learning in Situated Artificial AgentsPreprint
Hill, F., Clark, S. R. L., Hermann, K. M., & Blunsom, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09867 · Cited by 38
A biologically motivated visual memory architecture for online learning of objects
Kirstein, S., Wersing, H., & Körner, E. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.10.005 · Cited by 37
Bag of multimodal LDA models for concept formation
Nakamura, T., Nagai, T., & Iwahashi, N. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980324 · Cited by 36
Grounded Language Modeling for Automatic Speech Recognition of Sports Video
Fleischman, M., & Roy, D. K. (2008) · Cited by 35
Self-citationBayesian Learning of a Language Model from Continuous Speech
Neubig, G., Mimura, M., Mori, S., & Kawahara, T. (2012) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.e95.d.614 · Cited by 35
Gelderloos, L., & Chrupała, G. (2016) · Research portal (Tilburg University) · doi:10.48550/arxiv.1610.03342 · Cited by 35
Conversational robots: building blocks for grounding word meaning
Roy, D. K., Hsiao, K.-Y., & Mavridis, N. (2003) · doi:10.3115/1119212.1119222 · Cited by 34
Self-citationPersonalization in multimedia retrieval: A survey
Lu, Y., Sebe, N., Hytnen, R., & Tian, Q. C. (2010) · Multimedia Tools and Applications · doi:10.1007/s11042-010-0621-0 · Cited by 34
Robotic vocabulary building using extension inference and implicit contrast
Gold, K., Doniec, M. W., Crick, C., & Scassellati, B. M. (2008) · Artificial Intelligence · doi:10.1016/j.artint.2008.09.002 · Cited by 33
Symbolic Inductive Bias for Visually Grounded Learning of Spoken Language
Chrupała, G. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1647 · Cited by 32
How Much of Language Acquisition Does Operant Conditioning Explain?
Sturdy, C. B., & Nicoladis, E. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01918 · Cited by 31
World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models
Ma, Z., Pan, J., & Chai, J. Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.31 · Cited by 31
Integration of speech and vision using mutual information
Roy, D. K. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2000.859317 · Cited by 31
Self-citationCharacterizing and Processing Robot-Directed Speech
Varchavskaia, P., Fitzpatrick, P., & Breazeal, C. (2001) · Defense Technical Information Center (DTIC) · doi:10.21236/ada457057 · Cited by 31
Taniguchi, A., Taniguchi, T., & Cangelosi, A. (2017) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2017.00066 · Cited by 31
Learning audio-visual associations using mutual information
Roy, D. K., Schiele, B., & Pentland, A. (2003) · doi:10.1109/isiu.1999.824909 · Cited by 30
Self-citationEmergence of grammatical constructions: evidence from simulation and grounded agent experiments
Dominey, P. F. (2005) · Connection Science · doi:10.1080/09540090500270714 · Cited by 31
Kaiser, E. (2005) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1040830.1040851 · Cited by 30
Khorrami, K., & Räsänen, O. J. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/37zna · Cited by 31
Learning to interpret utterances using dialogue history
DeVault, D., & Stone, M. (2009) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/1609067.1609087 · Cited by 29
Generalized Grounding Graphs: A Probabilistic Framework for Understanding Grounded CommandsPreprint
Kollar, T., Tellex, S., Walter, M. R., Huang, A. S., Bachrach, A., Hemachandra, S. M., Brunskill, E., Banerjee, A. G., Roy, D. K., Teller, S. J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.01097 · Cited by 29
Self-citationCollective predictive coding hypothesis: symbol emergence as decentralized Bayesian inference
Taniguchi, T. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1353870 · Cited by 28
“Roy and Pentland (2002) developed a language-learning system based on the multi-modal perception model.”
BackgroundObstacle avoidance using predictive vision based on a dynamic 3D world model
Benjamin, D. P., Lyons, D. M., & Achtemichuk, T. (2006) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.686168 · Cited by 28
Segmenting words from natural speech: subsegmental variation in segmental cues
Rytting, C. A., BREW, C., & Fosler‐Lussier, E. (2010) · Journal of Child Language · doi:10.1017/s0305000910000085 · Cited by 28
Online Algorithm for Robots to Learn Object Concepts and Language Model
Nishihara, J., Nakamura, T., & Nagai, T. (2016) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2552579 · Cited by 28
Multimodal Hierarchical Dirichlet Process-Based Active Perception by a Robot
Taniguchi, T., Yoshino, R., & Takano, T. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00022 · Cited by 28
Learning Grammatical Constructions in a Miniature Language from Narrated Video Events
Dominey, P. F. (2003) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 28
Using spoken words to guide open-ended category formation
Chauhan, A., & Lopes, L. S. (2011) · Cognitive Processing · doi:10.1007/s10339-011-0407-y · Cited by 27
Word Recognition, Competition, and Activation in a Model of Visually Grounded Speech
Havard, W. N., Chevrot, J., & Besacier, L. (2019) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k19-1032 · Cited by 27
Meaning and compositionality as statistical induction of categories and constraints
Schmidt, L. A. (2009) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 27
Behavior-Based Early Language Development on a Humanoid Robot
Varshavskaya, P. (2002) · Defense Technical Information Center (DTIC) · doi:10.21236/ada434707 · Cited by 27
Learning to Ground Multi-Agent Communication with Autoencoders
Lin, T., Huh, M., Stauffer, C., Lim, S.-N., & Isola, P. (2021) · arXiv · doi:10.48550/arxiv.2110.15349 · Cited by 26
Cross‐Situational Word Learning With Multimodal Neural Networks
Vong, W. K., & Lake, B. M. (2022) · Cognitive Science · doi:10.1111/cogs.13122 · Cited by 27
MCA-NMF: Multimodal Concept Acquisition with Non-Negative Matrix Factorization
Mangin, O., Filliat, D., ten Bosch, L., & Oudeyer, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0140732 · Cited by 26
Infant learning is influenced by local spurious generalizations
Gerken, L., & Quam, C. (2016) · Developmental Science · doi:10.1111/desc.12410 · Cited by 26
Learning English with Peppa Pig
Nikolaus, M., Alishahi, A., & Chrupała, G. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00498 · Cited by 27
Task Transfer by a Developmental Robot
Zhang, Y., & Weng, J. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890269 · Cited by 26
Grounding Words in Perception and Action: Insights from Computational Models
Roy, D. K. (2005) · Cited by 26
Self-citationAnalysis of Audio-Visual Features for Unsupervised Speech Recognition
Drexler, J., & Glass, J. R. (2017) · doi:10.21437/glu.2017-12 · Cited by 25
Crossmodal Language Grounding in an Embodied Neurocognitive Model
Heinrich, S., Yao, Y., Hinz, T., Liu, Z., Hummel, T., Kerzel, M., Weber, C., & Wermter, S. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00052 · Cited by 25
A Hierarchical Modular Architecture for Embodied Cognition
Ballard, D. H., Kit, D. M., Rothkopf, C. A., & Sullivan, B. T. (2013) · Multisensory Research · doi:10.1163/22134808-00002414 · Cited by 28
A System for Continuous Learning of Visual Concepts
Skočaj, D., Berginc, G., Ridge, B., Štimec, A., Jogan, M., Vanek, O., Leonardis, A., Hutter, M., & Hawes, N. (2007) · doi:10.2390/biecoll-icvs2007-113 · Cited by 25
Grounded situation models for situated conversational assistants
Picard, R. W., & Mavridis, N. (2007) · Cited by 25
The Development of Hierarchical Knowledge in Robot Systems
Hart, S. W. (2009) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/782w-wa28 · Cited by 25
Multi-Cue Zero-Shot Learning with Strong SupervisionPreprint
Akata, Z., Malinowski, M., Fritz, M., & Schiele, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.08754 · Cited by 25
Mind's Eye: Grounded Language Model Reasoning through Simulation
Liu, R., Wei, J., Gu, S. S., Wu, T.-Y., Vosoughi, S., Cui, C., Zhou, D., & Dai, A. M. (2022) · arXiv · doi:10.48550/arxiv.2210.05359 · Cited by 24
Learning semantic components from subsymbolic multimodal perception
Mangin, O., & Oudeyer, P. (2013) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2013.6652563 · Cited by 24
Trends, Challenges and Adopted Strategies in RoboCup@Home
Matamoros, M., Seib, V., & Paulus, D. W. R. (2019) · IEEE International Conference on Autonomous Robot Systems and Competitions · doi:10.1109/icarsc.2019.8733622 · Cited by 24
Updated MINDS Report on Speech Recognition and Understanding
Baker, J., Deng, L., Khudanpur, S. P., Lee, C.-H., Glass, J. R., & Morgan, N. (2009) · IEEE Signal Processing Magazine · Cited by 23
Interpreting vague utterances in context
DeVault, D., & Stone, M. (2004) · International Conference on Computational Linguistics · doi:10.3115/1220355.1220536 · Cited by 23
A robot that uses existing vocabulary to infer non-visual word meanings from observation
Gold, K., & Scassellati, B. M. (2007) · National Conference on Artificial Intelligence · Cited by 23
A Multimodal Connectionist Architecture for Unsupervised Grounding of Spatial Language
Vavrečka, M., & Farkaš, I. (2013) · Cognitive Computation · doi:10.1007/s12559-013-9212-5 · Cited by 22
Concept formation by robots using an infinite mixture of models
Nakamura, T., Ando, Y., Nagai, T., & Kaneko, M. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7354031 · Cited by 22
CONSTRAINT BASED COMPOSITIONAL SEMANTICS
den Broeck, W. V. (2008) · The Evolution of Language · doi:10.1142/9789812776129_0043 · Cited by 22
Adaptive dialog based upon multimodal language acquisition
Dusan, S., & Flanagan, J. L. (2003) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1109/icmi.2002.1166982 · Cited by 22
Learning place-names from spoken utterances and localization results by mobile robot
Taguchi, R., Yamada, Y., Hattori, K., Umezaki, T., Hoguro, M., Iwahashi, N., Funakoshi, K., & Nakano, M. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-440 · Cited by 21
Stefanov, K., Beskow, J., & Salvi, G. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2019.2927941 · Cited by 21
Incremental Bayesian Category Learning From Natural Language
Frermann, L., & Lapata, M. (2015) · Cognitive Science · doi:10.1111/cogs.12304 · Cited by 21
Modeling Cross-Modal Interactions in Early Word Learning
Althaus, N., & Mareschal, D. (2013) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2013.2264858 · Cited by 21
He, X., Ogura, T., Akihiro, S., & Hasegawa, O. (2007) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2007.903447 · Cited by 21
Learning grounded semantics with word trees: Prepositions and pronouns
Gold, K., Doniec, M. W., & Scassellati, B. M. (2007) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2007.4354049 · Cited by 21
Augmenting user interfaces with adaptive speech commands
Gorniak, P., & Roy, D. K. (2003) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/958432.958467 · Cited by 21
Self-citationUsing redundant speech and handwriting for learning new vocabulary and understanding abbreviations
Kaiser, E. (2006) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1180995.1181060 · Cited by 21
A computational theory of child overextension
Pinto, R. F., & Xu, Y. (2020) · Cognition · doi:10.1016/j.cognition.2020.104472 · Cited by 20
An unsupervised algorithm for the induction of constructions
Gaspers, J., Cimiano, P., Griffiths, S., & Wrede, B. (2011) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2011.6037371 · Cited by 19
Regularization of languages by adults and children: A mathematical framework
Rische, J. L., & Komarova, N. L. (2015) · Cognitive Psychology · doi:10.1016/j.cogpsych.2015.10.001 · Cited by 20
Recent Trends in Online Learning for Cognitive Robotics
Steil, J. J., & Wersing, H. (2006) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 20
Finding the Words: How Young Children Develop Skill in Interpreting Spoken Language
Fernald, A. E., & Frank, M. C. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139029377.007 · Cited by 19
Signatures of cross-modal alignment in children’s early concepts
Aho, K., Roads, B. D., & Love, B. C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2309688120 · Cited by 20
A Computational Model for the Item‐Based Induction of Construction Networks
Gaspers, J., & Cimiano, P. (2014) · Cognitive Science · doi:10.1111/cogs.12114 · Cited by 19
Grounded lexicon acquisition — Case studies in spatial language
Spranger, M. (2013) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2013.6652534 · Cited by 19
Open-ended category learning for language acquisition
Lopes, L. S., & Chauhan, A. (2008) · Connection Science · doi:10.1080/09540090802413228 · Cited by 19
Context-based Word Acquisition for Situated Dialogue in a Virtual World
Qu, S., & Chai, J. Y. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2912 · Cited by 19
Unsupervised spatial lexical acquisition by updating a language model with place clues
Taniguchi, A., Taniguchi, T., & Inamura, T. (2017) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2017.10.013 · Cited by 19
Qu, S., & Chai, J. Y. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613750 · Cited by 19
Contribution tracking: participating in task-oriented dialogue under uncertainty
DeVault, D. (2008) · Rutgers University Community Repository (Rutgers University) · doi:10.7282/t35h7gmb · Cited by 19
MIMo: A Multimodal Infant Model for Studying Cognitive Development
Mattern, D., Schumacher, P., López, F. M., Raabe, M. C., Ernst, M., Aubret, A., & Triesch, J. (2024) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2024.3350448 · Cited by 18
Ensemble-of-Concept Models for Unsupervised Formation of Multiple Categories
Nakamura, T., & Nagai, T. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2745502 · Cited by 18
Metadata
- Authors
- Roy, D. K., & Pentland, A. P.
- Affiliations
- MIT Media Lab (US)
- Corresponding author
- Roy, Deb K.
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 2002-01
- Volume
- 26
- Issue
- 1
- Pages
- 113-146
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2107917162
- Cited by
- 521
- References
- 51
- Citations by year
- 2025: 1 · 2024: 6 · 2023: 10 · 2022: 13 · 2021: 12 · 2020: 14 · 2019: 18 · 2018: 13 · 2017: 25 · 2016: 25 · 2015: 18 · 2014: 14 · 2013: 24 · 2012: 20
- FWCI
- 59.99
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cognitive Science (publishedVersion)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- vocabulary acquisition, cross-modal correspondence, information theory, speech segmentation, word discovery, visual categorization, infant-directed speech, object recognition, cognitive modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.