Symbol emergence in robotics: a survey
Open accessThe DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.
Abstract
Humans can learn a language through physical interaction with their environment and semiotic communication with other people. It is very important to obtain a computational understanding of how humans can form symbol systems and obtain semiotic skills through their autonomous mental development. Recently, many studies have been conducted regarding the construction of robotic systems and machine learning methods that can learn a language through embodied multimodal interaction with their environment and other systems. Understanding human?-social interactions and developing a robot that can smoothly communicate with human users in the long term require an understanding of the dynamics of symbol systems. The embodied cognition and social interaction of participants gradually alter a symbol system in a constructive manner. In this paper, we introduce a field of research called symbol emergence in robotics (SER). SER represents a constructive approach towards a symbol emergence system. The symbol emergence system is socially self-organized through both semiotic communications and physical interactions with autonomous cognitive developmental agents, i.e. humans and developmental robots. In this paper, specifically, we describe some state-of-art research topics concerning SER, such as multimodal categorization, word discovery, and double articulation analysis. They enable robots to discover words and their embodied meanings from raw sensory-motor information, including visual information, haptic information, auditory information, and acoustic speech signals, in a totally unsupervised manner. Finally, we suggest future directions for research in SER.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Attempts to train models on multimodal sensorimotor data have yielded some success, with agents able to associate the sensory information of an object such as a cup with the signals that represent it [7,8,9].”
From Compression, The Fermi Paradox and Artificial Super-Intelligence (2022) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
POLANYI, M. (1997) · Knowledge in Organisations · doi:10.1016/b978-0-7506-9718-7.50010-x · Cited by 12,408
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
(2006) · Springer eBooks · Cited by 8,123
Barsalou, L. W. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002149 · Cited by 6,887
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049 · cited 1×
“for document-word clustering, to a model that can treat multimodal information.[3,58,59] Concrete illustrations of the graphical models of LDA and MLDA and its extended models are presented in Figure 3.”
BackgroundStatistical learning by 8-month-old infants
Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996) · Science · doi:10.1126/science.274.5294.1926 · Cited by 5,659
A theory of lexical access in speech production
Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99001776 · Cited by 5,136
Intelligence without representation
Brooks, R. A. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90053-m · Cited by 4,853
Harnad, S. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90087-6 · Cited by 4,235 · cited 1×
“He proposed the symbol grounding problem (SGP), which is one of the most famous problems in artificial intelligence.[13] The SGP focused on the relationship between a designed symbol system and real-world phenomena.”
BackgroundThe Tree of Knowledge: The Biological Roots of Human Understanding
Maturana, H. R., & Varela, F. J. (1992) · Medical Entomology and Zoology · Cited by 3,256
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/jmlr.2003.3.4-5.993 · Cited by 3,024
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Recently, deep learningmethods have yielded excellent results.[38,39] In contrast, category formation in a robot’s umwelt must be autonomously performed in an unsupervised manner.”
BackgroundLinguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 2,912
Eco, U. (1976) · Indiana University Press eBooks · doi:10.1007/978-1-349-15849-2 · Cited by 2,899
(2011) · Cited by 2,752
The developmental psychology of Jean Piaget.
Flavell, J. H. (1963) · D Van Nostrand eBooks · doi:10.1037/11449-000 · Cited by 2,368
Computer science as empirical inquiry: symbols and search
Newell, A., & Simon, H. A. (1976) · Communications of the ACM · doi:10.1145/360018.360022 · Cited by 2,350
Multiple paired forward and inverse models for motor control
Wolpert, D. M., & Kawato, M. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00066-5 · Cited by 2,151
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
How to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Chandler, D. (2007) · Routledge eBooks · doi:10.4324/9780203014936 · Cited by 1,740
Breazeal, C. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/2376.001.0001 · Cited by 1,553
Newell, A. (1980) · Cognitive Science · doi:10.1207/s15516709cog0402_2 · Cited by 1,458
Word Segmentation: The Role of Distributional Cues
Saffran, J. R., Newport, E. L., & Aslin, R. N. (1996) · Journal of Memory and Language · doi:10.1006/jmla.1996.0032 · Cited by 1,405
Brooks, R. A. (1990) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(05)80025-9 · Cited by 1,354
(1991) · Choice Reviews Online · doi:10.5860/choice.29-0605 · Cited by 1,284
Emotion and sociable humanoid robots
Breazeal, C. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00018-1 · Cited by 1,279
A unifying computational framework for motor control and social interaction
Wolpert, D. M., Doya, K., & Kawato, M. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1238 · Cited by 1,228
Pfeifer, R., & Scheier, C. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/6979.001.0001 · Cited by 1,155
Formal theory of creativity, fun, and intrinsic motivation (1990–2010)
Schmidhuber, J. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2056368 · Cited by 747
A stroll through the worlds of animals and men: A picture book of invisible worlds
VON UEXKÜLL, J. (1992) · Semiotica · doi:10.1515/semi.1992.89.4.319 · Cited by 721
The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies
Blei, D. M., Griffiths, T. L., & Jordan, M. I. (2010) · Journal of the ACM · doi:10.1145/1667053.1667056 · Cited by 646
Intrinsically Motivated Reinforcement Learning
Singh, S., Barto, A. G., & Chentanez, N. (2005) · doi:10.21236/ada440280 · Cited by 610
Thiessen, E. D., & Saffran, J. R. (2003) · Developmental Psychology · doi:10.1037/0012-1649.39.4.706 · Cited by 579
Cognitive Developmental Robotics: A Survey
Asada, M., Hosoda, K., Kuniyoshi, Y., Ishiguro, H., Inui, T., Yoshikawa, Y., Ogino, M., & Yoshida, C. (2009) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2009.2021702 · Cited by 554
Information Gain-based Exploration Using Rao-Blackwellized Particle Filters
Stachniss, C., Grisetti, G., & Burgard, W. (2005) · Robotics: Science and Systems I · doi:10.15607/rss.2005.i.009 · Cited by 542
Learning words from sights and sounds: A computational model
Roy, D. K., & Pentland, A. P. (2002) · Cognitive Science · doi:10.1207/s15516709cog2601_4 · Cited by 521
A hierarchical Bayesian language model based on Pitman-Yor processes
Teh, Y. W. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220299 · Cited by 489
Multiple model-based reinforcement learning
Doya, K., Samejima, K., Katagiri, K.-I., & Kawato, M. (2002) · Neural Computation · doi:10.1162/089976602753712972 · Cited by 476
Segmenting motion capture data into distinct behaviors
Barbič, J., Safonova, A., Pan, J.-Y., Faloutsos, C., Hodgins, J. K., & Pollard, N. S. (2004) · Graphics Interface · Cited by 441
A Bayesian framework for word segmentation: Exploring the effects of context
Goldwater, S., Griffiths, T. L., & Johnson, M. (2009) · Cognition · doi:10.1016/j.cognition.2009.03.008 · Cited by 431
Motion texture: a two-level statistical model for character motion synthesis
Li, Y., Wang, T., & Shum, H.-Y. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566604 · Cited by 392
An Efficient, Probabilistically Sound Algorithm for Segmentation and Word Discovery
Brent, M. R. (1999) · Machine Learning · doi:10.1023/a:1007541817488 · Cited by 351
Embodied Symbol Emergence Based on Mimesis Theory
Inamura, T., Toshima, I., Tanie, H., & Nakamura, Y. (2004) · The International Journal of Robotics Research · doi:10.1177/0278364904042199 · Cited by 326
Hierarchical Bayesian nonparametric models with applications
Teh, Y. W., & Jordan, M. I. (2010) · Bayesian Nonparametrics · doi:10.1017/cbo9780511802478.006 · Cited by 319
Automated Derivation of Primitives for Movement Classification
Fod, A., Matarić, M. J., & Jenkins, O. C. (2002) · Autonomous Robots · doi:10.1023/a:1013254724861 · Cited by 318
Contextual dependencies in unsupervised word segmentation
Goldwater, S., Griffiths, T. L., & Johnson, M. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220260 · Cited by 305
The Situated Nature of Concepts
Yeh, W., & Barsalou, L. W. (2006) · The American Journal of Psychology · doi:10.2307/20445349 · Cited by 276
Developmental Robotics: From Babies to Robots
Cangelosi, A., & Schlesinger, M. (2015) · The MIT Press eBooks · doi:10.7551/mitpress/9320.001.0001 · Cited by 268
Tani, J., & Nolfi, S. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00060-x · Cited by 259
Information theoretic sensor data selection for active object recognition and state estimation
Denzler, J., & Brown, C. M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982896 · Cited by 253
Hierarchical attentive multiple models for execution and recognition of actions
Demiris, Y., & Khadhouri, B. (2006) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2006.02.003 · Cited by 243
Solving the symbol grounding problem: a critical review of fifteen years of research
Taddeo, M., & Floridi, L. (2005) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/09528130500284053 · Cited by 240
Bayesian unsupervised word segmentation with nested Pitman-Yor language modeling
Mochihashi, D., Yamada, T., & Ueda, N. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - ACL-IJCNLP '09 · doi:10.3115/1687878.1687894 · Cited by 240
A sticky HDP-HMM with application to speaker diarization
Fox, E. B., Sudderth, E. B., Jordan, M. I., & Willsky, A. S. (2011) · The Annals of Applied Statistics · doi:10.1214/10-aoas395 · Cited by 231
The Principle of Semantic Compositionality
Pelletier, F. J. (1994) · Topoi · doi:10.1007/bf00763644 · Cited by 231
Kulić, D., Ott, C., Lee, D., Ishikawa, J., & Nakamura, Y. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911426178 · Cited by 222
Tani, J., Ito, M., & Sugita, Y. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.05.007 · Cited by 208
An Efficient, Probabilistically Sound Algorithm for Segmentation and Word DiscoveryPreprint
Brent, M. R. (1999) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/9905007 · Cited by 208
Object identification with tactile sensors using bag-of-features
Schneider, A., Sturm, J., Stachniss, C., Reisert, M., Burkhardt, H., & Burgard, W. (2009) · 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2009.5354648 · Cited by 200
Autonomous generation of complete 3D object models using next best view manipulation planning
Krainin, M., Curless, B., & Fox, D. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980429 · Cited by 199
Learning Semantic Combinatoriality from the Interaction between Linguistic and Behavioral Processes
Sugita, Y., & Tani, J. (2005) · Adaptive Behavior · doi:10.1177/105971230501300102 · Cited by 183
Integration of Action and Language Knowledge: A Roadmap for Developmental Robotics
Cangelosi, A., Metta, G., Sagerer, G., Nolfi, S., Nehaniv, C., Fischer, K., Tani, J., Belpaeme, T., Sandini, G., Nori, F., et al. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2053034 · Cited by 169
The symbol grounding problem has been solved, so what's next?
Steels, L. (2008) · Symbols and EmbodimentDebates on meaning and cognition · doi:10.1093/acprof:oso/9780199217274.003.0012 · Cited by 164
Building high-level features using large scale unsupervised learning
Le, Q. V., Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., & Ng, A. Y. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1112.6209 · Cited by 163
Cangelosi, A., & Riga, T. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_72 · Cited by 161
Active mobile robot localization
Burgard, W., Fox, D., & Thrun, S. (1997) · FreiDok plus (Universitätsbibliothek Freiburg) · Cited by 154
Coastal Navigation with Mobile Robots
Roy, N., & Thrun, S. (1999) · Cited by 146
Approaching the Symbol Grounding Problem with Probabilistic Graphical Models
Tellex, S., Kollar, T., Dickerson, S., Walter, M. R., Banerjee, A. G., Teller, S., & Roy, N. (2011) · AI Magazine · doi:10.1609/aimag.v32i4.2384 · Cited by 145
From robotic toil to symbolic theft: Grounding transfer from entry-level to higher-level categories1
Cangelosi, A., Greco, A., & Harnad, S. R. (2000) · Connection Science · doi:10.1080/09540090050129763 · Cited by 135
Describing Visual Scenes using Transformed Dirichlet Processes
Torralba, A. B., Willsky, A. S., Sudderth, E. B., & Freeman, W. T. (2005) · neural information processing systems · Cited by 134
Hierarchical MOSAIC for movement generation.
Haruno, M., Wolpert, D. M., & Kawato, M. (2003) · International Congress Series · doi:10.1016/s0531-5131(03)00190-0 · Cited by 132 · cited 1×
“[122,130] MTRNN and recurrent neural networks with parametric bias (RNNPB) are candidates for modeling contextually changing forward dynamics.”
BackgroundCost-sensitive feature acquisition and classification
Ji, S., & Carin, L. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.11.008 · Cited by 123
A Statistical Model for Word Discovery in Transcribed Speech
Venkataraman, A. (2001) · Computational Linguistics · doi:10.1162/089120101317066113 · Cited by 120
Johnson, M., & Goldwater, S. (2009) · Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics on - NAACL '09 · doi:10.3115/1620754.1620800 · Cited by 118
Unsupervised Lexicon Discovery from Acoustic Input
Lee, C.-Y., O’Donnell, T. J., & Glass, J. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00146 · Cited by 96
Using Dynamic Field Theory to extend the embodiment stance toward higher cognition
Sandamirskaya, Y., Zibner, S. K. U., Schneegans, S., & Schöner, G. (2013) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2013.01.002 · Cited by 81
Object Learning Through Active Exploration
Ivaldi, S., Nguyen, S. M., Lyubova, N., Droniou, A., Padois, V., Filliat, D., Oudeyer, P., & Sigaud, O. (2014) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2013.2280614 · Cited by 79
Ugur, E., & Piater, J. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139553 · Cited by 78
Grounding semantic categories in behavioral interactions: Experiments with 100 objects
Sinapov, J., Schenck, C., Staley, K., Sukhoy, V., & Stoytchev, A. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.10.007 · Cited by 76
Grounding of word meanings in multimodal concepts using LDA
Nakamura, T., Nagai, T., & Iwahashi, N. (2009) · 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2009.5354736 · Cited by 74
Self-citationMultimodal object categorization by a robot
Nakamura, T., Nagai, T., & Iwahashi, N. (2007) · 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2007.4399634 · Cited by 73
Self-citationHinaut, X., Petit, M., Pointeau, G., & Dominey, P. F. (2014) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2014.00016 · Cited by 71
Active perception and scene modeling by planning with probabilistic 6D object poses
Eidenberger, R., & Scharinger, J. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5651927 · Cited by 70
Two-way translation of compound sentences and arm motions by recurrent neural networks
Ogata, T., Murase, M., Tani, J., Komatani, K., & Okuno, H. G. (2007) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2007.4399265 · Cited by 61
Self-citationMulti-modal convergence maps: from body schema and self-representation to mental imagery
Lallée, S., & Dominey, P. F. (2013) · Adaptive Behavior · doi:10.1177/1059712313488423 · Cited by 60
Symbolic Models and Emergent Models: A Review
Weng, J. (2011) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2011.2159113 · Cited by 55
Inamura, T., Shibata, T., Sena, H., Hashimoto, T., Kawai, N., Miyashita, T., Sakurai, Y., Shimizu, M., Otake, M., Hosoda, K., et al. (2010) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii.2010.5708327 · Cited by 54
Iwahashi, N. (2003) · Information Sciences · doi:10.1016/s0020-0255(03)00167-1 · Cited by 53
Self-citationMovement extraction by detecting dynamics switches and repetitions
Chiappa, S., & Peters, J. (2011) · Max Planck Institute for Plasma Physics · Cited by 51
A Behavior-Grounded Approach to Forming Object Categories: Separating Containers From Noncontainers
Griffith, S., Sinapov, J., Sukhoy, V., & Stoytchev, A. (2011) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2011.2157504 · Cited by 51
Sequence Prediction of Driving Behavior Using Double Articulation Analyzer
Taniguchi, T., Nagasaka, S., Hitomi, K., Chandrasiri, N. P., Bando, T., & Takenaka, K. (2015) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2015.2465933 · Cited by 49
Self-citationStückler, J., & Behnke, S. (2009) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2009.5379529 · Cited by 47
Unsupervised drive topic finding from driving behavioral data
Bando, T., Takenaka, K., Nagasaka, S., & Taniguchi, T. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629467 · Cited by 46
Self-citationUnsupervised Hierarchical Modeling of Driving Behavior and Prediction of Contextual Changing Points
Taniguchi, T., Nagasaka, S., Hitomi, K., Takenaka, K., & Bando, T. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2376525 · Cited by 46
Self-citationObject category recognition by a humanoid robot using behavior-grounded relational learning
Sinapov, J., & Stoytchev, A. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980417 · Cited by 44
Rubin, J. M., & Richards, W. A. (1985) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 43
Semiotic prediction of driving behavior using unsupervised double articulation analyzer
Taniguchi, T., Nagasaka, S., Hitomi, K., Chandrasiri, N. P., & Bando, T. (2012) · 2012 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232243 · Cited by 43
Self-citationAraki, T., Nakamura, T., Nagai, T., Nagasaka, S., Taniguchi, T., & Iwahashi, N. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385812 · Cited by 43
Self-citationFully unsupervised small-vocabulary speech recognition using a segmental Bayesian model
Kamper, H., Jansen, A., & Goldwater, S. J. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-239 · Cited by 43
Contextual scene segmentation of driving behavior based on double articulation analyzer
Takenaka, K., Bando, T., Nagasaka, S., Taniguchi, T., & Hitomi, K. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385614 · Cited by 41
Self-citationAutonomous acquisition of multimodal information for online object concept formation by robots
Araki, T., Nakamura, T., Nagai, T., et al. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6048422 · Cited by 41
Self-citationMaximally informative interaction learning for scene exploration
van Hoof, H., Kroemer, O., Ben Amor, H., & Peters, J. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386008 · Cited by 40
Mutual learning of an object concept and language model based on MLDA and NPYLM
Nakamura, T., Nagai, T., Funakoshi, K., Nagasaka, S., Taniguchi, T., & Iwahashi, N. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942621 · Cited by 39
Self-citationA Joint Learning Model of Word Segmentation, Lexical Acquisition, and Phonetic Variability
Elsner, M., Goldwater, S., Feldman, N., & Wood, F. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1005 · Cited by 39
Emergence of hierarchical structure mirroring linguistic composition in a recurrent neural network
Hinoshita, W., Arie, H., Tani, J., Okuno, H. G., & Ogata, T. (2011) · Neural Networks · doi:10.1016/j.neunet.2010.12.006 · Cited by 37
Self-citationTuci, E., Ferrauto, T., Zeschel, A., Massera, G., & Nolfi, S. (2011) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2011.2114659 · Cited by 37
Bag of multimodal LDA models for concept formation
Nakamura, T., Nagai, T., & Iwahashi, N. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980324 · Cited by 36
Self-citationTaniguchi, T., Nagasaka, S., & Nakashima, R. (2016) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2550591 · Cited by 35
Self-citationTaniguchi, T., & Nagasaka, S. (2011) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii.2011.6147455 · Cited by 35
Self-citationBayesian Learning of a Language Model from Continuous Speech
Neubig, G., Mimura, M., Mori, S., & Kawahara, T. (2012) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.e95.d.614 · Cited by 35
Active Categorical Perception of Object Shapes in a Simulated Anthropomorphic Robotic Arm
Tuci, E., Massera, G., & Nolfi, S. (2010) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2010.2046174 · Cited by 32
Multimodal categorization by hierarchical dirichlet process
Nakamura, T., Nagai, T., & Iwahashi, N. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6094763 · Cited by 31
Self-citationSelf-Organization and Compositionality in Cognitive Brains: A Neurorobotics Study
Tani, J. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2308604 · Cited by 30
Multimodal Hierarchical Dirichlet Process-Based Active Perception by a Robot
Taniguchi, T., Yoshino, R., & Takano, T. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00022 · Cited by 28
Self-citationSymbolization and imitation learning of motion sequence using competitive modules
Samejima, K., Katagiri, K.-I., Doya, K., & Kawato, M. (2006) · Electronics and Communications in Japan (Part III Fundamental Electronic Science) · doi:10.1002/ecjc.20267 · Cited by 27
Kadone, H., & Nakamura, Y. (2006) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2006.321355 · Cited by 27
Hinaut, X., Lance, F., Droin, C., Petit, M., Pointeau, G., & Dominey, P. F. (2015) · Brain and Language · doi:10.1016/j.bandl.2015.08.002 · Cited by 27
MCA-NMF: Multimodal Concept Acquisition with Non-Negative Matrix Factorization
Mangin, O., Filliat, D., ten Bosch, L., & Oudeyer, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0140732 · Cited by 26
Formation of hierarchical object concept using hierarchical latent Dirichlet allocation
Ando, Y., Nakamura, T., Araki, T., & Nagai, T. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696674 · Cited by 24
Self-citation(2012) · Cited by 24
Learning semantic components from subsymbolic multimodal perception
Mangin, O., & Oudeyer, P. (2013) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2013.6652563 · Cited by 24
Integrating whole body motion primitives and natural language for humanoid robots
Takano, W., & Nakamura, Y. (2008) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2008.4755976 · Cited by 24
Drive video summarization based on double articulation structure of driving behavior
Takenaka, K., Bando, T., Nagasaka, S., et al. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2396410 · Cited by 23
A self-referential childlike model to acquire phones, syllables and words from acoustic speech
Brandl, H., Wrede, B., Joublin, F., & Goerick, C. (2008) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2008.4640801 · Cited by 23
Concept formation by robots using an infinite mixture of models
Nakamura, T., Ando, Y., Nagai, T., & Kaneko, M. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7354031 · Cited by 22
Self-citationMultiphase Learning for an Interval-Based Hybrid Dynamical System
宏彰, 川. (2005) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1093/ietfec/e88-a.11.3022 · Cited by 21
Unsupervised word segmentation from noisy input
Heymann, J., Walter, O., Haeb‐Umbach, R., & Raj, B. (2013) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2013.6707773 · Cited by 21
Iterative Bayesian word segmentation for unsupervised vocabulary discovery from phoneme lattices
Heymann, J., Walter, O., Haeb‐Umbach, R., et al. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854364 · Cited by 21
Learning place-names from spoken utterances and localization results by mobile robot
Taguchi, R., Yamada, Y., Hattori, K., Umezaki, T., Hoguro, M., Iwahashi, N., Funakoshi, K., & Nakano, M. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-440 · Cited by 21
Self-citationTuci, E., Ferrauto, T., Zeschel, A., Massera, G., & Nolfi, S. (2011) · University of Southern Denmark Research Portal (University of Southern Denmark) · Cited by 20
Taniguchi, T., & Sawaragi, T. (2007) · Advanced Robotics · doi:10.1163/156855307781389374 · Cited by 20
Self-citationLearning Novel Objects for Extended Mobile Manipulation
Nakamura, T., Sugiura, K., Nagai, T., Iwahashi, N., Toda, T., Okada, H., & Omori, T. (2011) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-011-9605-1 · Cited by 19
Self-citationInfomax control for acoustic exploration of objects by a mobile robot
Rebguns, A., Ford, D. A., & Fasel, I. (2011) · National Conference on Artificial Intelligence · Cited by 19
Interactive Learning of Spoken Words and Their Meanings Through an Audio-Visual Interface
Iwahashi, N. (2008) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e91-d.2.312 · Cited by 18
Self-citationA Joint Model for Unsupervised Chinese Word Segmentation
Chen, M., Chang, B., & Pei, W. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1092 · Cited by 18
Iwahashi, N., Sugiura, K., Taguchi, R., Nagai, T., & Taniguchi, T. (2010) · National Conference on Artificial Intelligence · Cited by 18
Self-citationAutomatic lane change extraction based on temporal patterns of symbolized driving behavioral data
Mori, M., Takenaka, K., Bando, T., Taniguchi, T., Miyajima, C., & Takeda, K. (2015) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2015.7225811 · Cited by 17
Self-citationSituated Spoken Dialogue with Robots Using Active Learning
Sugiura, K., Iwahashi, N., Kawai, H., et al. (2011) · Advanced Robotics · doi:10.1163/016918611x595044 · Cited by 16
Self-citationAnalysing the Multiple Timescale Recurrent Neural Network for Embodied Language Understanding
Heinrich, S., Magg, S., & Wermter, S. (2014) · Springer series in bio-/neuroinformatics · doi:10.1007/978-3-319-09903-3_8 · Cited by 15
Nakamura, T., Nagai, T., & Iwahashi, N. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385502 · Cited by 14
Self-citationAutomatic drive annotation via multimodal latent topic model
Bando, T., Takenaka, K., Nagasaka, S., & Taniguchi, T. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696744 · Cited by 14
Self-citationLearning and using context on a humanoid robot using latent dirichlet allocation
Çelikkanat, H., Orhan, G., Pugeault, N., Guérin, F., Şahin, E., & Kalkan, S. (2014) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2014.6982982 · Cited by 11
Self-organization of inner symbols for chase: symbol organization and embodiment
Taniguchi, T., & Sawaragi, T. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1400021 · Cited by 11
Self-citationStückler, J., Droeschel, D., Gräve, K., Holz, D., Klaess, J., Schreiber, M., Steffens, R., & Behnke, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-32060-6_5 · Cited by 10
Taniguchi, T., & Sawaragi, T. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.10.007 · Cited by 10
Self-citationMurata, S., Yamashita, Y., Arie, H., Ogata, T., Tani, J., & Sugano, S. (2014) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2014.6982988 · Cited by 7
Self-citationWhat do you expect from a robot that tells your future? The crystal ball
Takano, W., Imagawa, H., Kulić, D., et al. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5650682 · Cited by 7
Incremental learning of integrated semiotics based on linguistic and behavioral symbols
Takano, W., & Nakamura, Y. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354112 · Cited by 7
Cognitive robotics - active perception of the self and others
Saegusa, R., Natale, L., Giorgio Metta, B., & Sandini, G. (2011) · Conference on Human System Interactions · doi:10.1109/hsi.2011.5937403 · Cited by 7
Unsupervised determination of efficient Korean LVCSR units using a Bayesian Dirichlet process model
Sakti, S., Finch, A., Isotani, R., et al. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947395 · Cited by 7
Taniguchi, T., & Sawaragi, T. (2004) · doi:10.1109/cira.2003.1222102 · Cited by 7
Self-citationFiqh Lintas Madzhab (Menimbang KHI melalui Penelusuran terhadap Kitab-kitab Rujukannya)
Hefni, M. (2006) · AL-IHKAM Jurnal Hukum & Pranata Sosial · doi:10.19105/al-lhkam.v1i1.2547 · Cited by 7
Intersensory Causality Modeling Using Deep Neural Networks
Noda, K., Arie, H., Suga, Y., & Ogata, T. (2013) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2013.342 · Cited by 6
Self-citationFinding meaningful robust chunks from driving behavior based on double articulation analyzer
Nagasaka, S., Taniguchi, T., Yamashita, G., et al. (2012) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii.2012.6427376 · Cited by 6
Self-citationTowards a Model for Grounding Semantic Composition
Daoutis, M., & Mavridis, N. (2014) · Örebro University Library (Örebro University) · Cited by 5
Detecting robot-directed speech by situated understanding in object manipulation tasks
Zuo, X., Iwahashi, N., Taguchi, R., et al. (2010) · doi:10.1109/roman.2010.5598729 · Cited by 5
Self-citationOnline Exploratory Behavior Acquisition of Mobile Robot Based on Reinforcement Learning
Gouko, M., Kobayashi, Y., & Kim, C. H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38577-3_28 · Cited by 5
Takano, W., Imagawa, H., Kulić, D., et al. (2010) · 2022 9th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob) · doi:10.1109/biorob.2010.5626344 · Cited by 4
An Extended Mobile Manipulation Robot Learning Novel Objects
Nakamura, T., Attamimi, M., Sugiura, K., Nagai, T., Iwahashi, N., Toda, T., Okada, H., & Omori, T. (2012) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.30.213 · Cited by 3
Self-citationOhno, K., Yamazaki, K., & Shimosaka, M. (2015) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.33.97 · Cited by 1
Research works printed but not linked: 12
- Barsalou LW, 1999, Behav. Brain Sci, 22, 1
- 10.4324/9780203166277 · doi:10.4324/9780203166277
- Tagniguchi T, 2010, Can we create a robot that communicate with human? -constructive approach towards symbol emergence system
- Tagniguchi T, 2014, Symbol emergence in robotics - introduction to mechanism of intelligence
- de Saussure F, 1983, Course in general linguistics (trans. Roy Harris)
- Peirce CS, 1931, Collected writings
- Von Uexküll J, 1992, Semiotica, 89, 319
- Sturrock J, 1986, Structuralism
- Piaget J, 1971, Genetic epistemology
- Cy Lee, 2015, Linguistics, 3, 389
- Samejima K, 2002, IEICE Trans. Inform. Syst, 85, 90
- Iocchi L, 2015, Artif. Intell, 1, 1
Cited by
Symbol Emergence in Cognitive Developmental Systems: A Survey
Taniguchi, T., Piater, J., Worgotter, F., Ugur, E., Hoffmann, M., Jamone, L., Nagai, T., Rosman, B., Matsuka, T., Iwahashi, N., et al. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2867772 · Cited by 92
“Overview of a symbol emergence system [5].”
BackgroundMethodInfluentialSelf-citationPhilosophical Specification of Empathetic Ethical Artificial Intelligence
Bennett, M. T., & Maruyama, Y. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3099945 · Cited by 43
“unsupervised clustering of multimodal sensorimotor data [19].”
BackgroundSymbol Emergence and the Solutions to Any Task
Bennett, M. T. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-93758-4_4 · Cited by 43
Emergent communication through Metropolis-Hastings naming game with deep generative models
Taniguchi, T., Yoshida, Y., Matsui, Y., Le Hoang, N., Taniguchi, A., & Hagiwara, Y. (2023) · Advanced Robotics · doi:10.1080/01691864.2023.2260856 · Cited by 33
“The system is considered a complex system with an emergent property and referred to as symbol emergence system [4].”
BackgroundSelf-citationSymbol Emergence as an Interpersonal Multimodal Categorization
Hagiwara, Y., Kobayashi, H., Taniguchi, A., & Taniguchi, T. (2019) · Frontiers in Robotics and AI · doi:10.3389/frobt.2019.00134 · Cited by 31
“Taniguchi et al. (2016b) introduced a concept of symbol emergence system , which is a multi-agent system that dynamically organizes a symbol system, for example , by physical interaction with the environment and semiotic communication with other agents.”
BackgroundSelf-citation
Metadata
- Authors
- Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., & Asoh, H.
- Affiliations
- Ritsumeikan University (JP)
- University of Electro-Communications (JP)
- Okayama Prefectural University (JP)
- Waseda University (JP)
- Artificial Intelligence Research Center (JP)
- Corresponding author
- Taniguchi, Tadahiro
- Venue
- Advanced Robotics
- Publisher
- Informa UK Limited
- Published
- 2016-04-11
- Volume
- 30
- Issue
- 11-12
- Pages
- 706-728
- ISSN
- 0169-1864 (ISSN-L)
- 1568-5535
- OpenAlex
- W2220867547
- Cited by
- 150
- References
- 165
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 10 · 2023: 12 · 2022: 30 · 2021: 15 · 2020: 13 · 2019: 16 · 2018: 13 · 2017: 17 · 2016: 7
- FWCI
- 27.49
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Advanced Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Institutional Repositories DataBase (IRDB) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Japan Society for the Promotion of Science (15H05319)
- Core Research for Evolutional Science and Technology
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Cultural Studies › Language and cultural evolution
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Keywords
- symbol emergence, embodied cognition, semiotic communication, human-robot interaction, word discovery, double articulation, unsupervised learning, social self-organization, language acquisition, cognitive development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.