PreprintCited by 2,550Psychiatry, Mental Health, NeuroscienceAI-based Problem Solving and PlanningCognitive Computing and Networks

Building Machines That Learn and Think Like People

Open access
Lake, Brenden M., Ullman, Tomer D., Tenenbaum, Joshua B., Gershman, Samuel J.·2016·arXiv

Abstract

Recent progress in artificial intelligence (AI) has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video games, and board games, achieving performance that equals or even beats humans in some respects. Despite their biological inspiration and performance achievements, these systems differ from human intelligence in crucial ways. We review progress in cognitive science suggesting that truly human-like learning and thinking machines will have to reach beyond current engineering trends in both what they learn, and how they learn it. Specifically, we argue that these machines should (a) build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems; (b) ground learning in intuitive theories of physics and psychology, to support and enrich the knowledge that is learned; and (c) harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations. We suggest concrete challenges and promising routes towards these goals that can combine the strengths of recent neural network advances with more structured cognitive models.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1604.00289

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • ILP systems naturally support lifelong and transfer learning because of their symbolic nature.

    “Finally, because of their symbolic nature, ILP systems naturally support lifelong and transfer learning (Cropper 2020), which is considered essential for human-like AI (Lake et al. 2016).”

    From Learning programs by learning from failures (2021) · cites this paper as Lake et al. 2016

  • Lifelong and transfer learning is considered essential for human-like AI.

    “which is considered essential for human-like AI (Lake et al., 2016).”

    From Inductive Logic Programming At 30: A New Introduction (2022) · cites this paper as Lake et al., 2016

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 228 · Cited by 2,550

Research works printed but not linked: 557

  1. Will human-like machines make human-like mistakes? doi:10.1017/S0140525X1700019X, e270 · DOI
  2. Abelson, R. P. & Carroll, J. D. (1965) Computer simulation of individual belief systems. The American behavioral scientist (pre-1986) 8(9):24-30.
  3. Aitchison, L. & Lengyel, M. (2016) The Hamiltonian brain: Efficient probabilistic inference with excitatory-inhibitory neural circuit dynamics. PLoS Computa- tional Biology 12(12):e1005186.
  4. Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C. & Qin, Y. (2004) An integrated theory of the mind. Psychological Review 111:1036-60.
  5. Anderson, M. L. (2003) Embodied cognition: A field guide. Artificial Intelligence 149 (1):91-130.
  6. Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., Shillingford, B. & de Freitas, N. (2016). Learning to learn by gradient descent by gradient descent. Presented at the 2016 Neural Information Processing Systems conference, Barcelona, Spain, December 5-10, 2016. In: Advances in neural information processing systems 29 (NIPS 2016), ed.
  7. D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon & R. Garnett, pp. 3981-89). Neural Information Processing Systems. [aBML, MB]
  8. Ansermin, E., Mostafaoui, G., Beausse, N. & Gaussier, P. (2016). Learning to syn- chronously imitate gestures using entrainment effect. In: From Animals to Animats 14: Proceedings of the 14th International Conference on Simulation of Adaptive Behavior (SAB 2016), Aberystwyth, United Kingdom, August 23-26, 2016, ed.
  9. Tuci E, Giagkos A, Wilson M, Hallam J, pp. 219-31. Springer.
  10. Arbib, M. A. & Fellous, J. M. (2004) Emotions: From brain to robot. Trends in Cognitive Science 8(12):554-61.
  11. Arnold, T. & Scheutz, M. (2016) Against the moral Turing test: Accountable design and the moral reasoning of autonomous systems. Ethics and Information Technology 18(2):103-15. doi:10.1007/s10676-016-9389-x. · DOI
  12. Asada, M., Hosoda, K., Kuniyoshi, Y., Ishiguro, H., Inui, T., Yoshikawa, Y. & Yoshida, C. (2009) Cognitive developmental robotics: A survey. IEEE Trans- actions on Autonomous Mental Development 1(1):12-34.
  13. Bach, J. (2009) Principles of synthetic intelligence. PSI: An architecture of motivated cognition. Oxford University Press.
  14. Bahdanau, D., Cho, K. & Bengio, Y. (2015) Neural machine translation by jointly learning to align and translate. Presented at the International Conference on Learning Representations (ICLR), San Diego, CA, May 7-9, 2015. arXiv pre- print 1409.0473. Available at: http://arxiv.org/abs/1409.0473v3. · arXiv
  15. Baillargeon, R., Li, J., Ng, W. & Yuan, S. (2009) An account of infants physical reasoning. In: Learning and the infant mind, ed. A. Woodward & A. Neeham, pp. 66-116. Oxford University Press.
  16. Baily, M. N. & Bosworth, B. P. (2014) US manufacturing: Understanding its past and its potential future. The Journal of Economic Perspectives 28(1):3-25.
  17. Baker, C. L., Saxe, R. & Tenenbaum, J. B. (2009) Action understanding as inverse planning. Cognition 113(3):329-49.
  18. Baldassarre, G. (2011) What are intrinsic motivations? A biological perspective. In: Proceedings of the International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob-2011), ed.
  19. A. Cangelosi, J. Triesch, I. Fasel, K. Rohlfing, F. Nori, P.-Y. Oudeyer, M. Schlesinger & Y. Nagai, pp. E1-8. IEEE.
  20. Baldassarre, G., Caligiore, D. & Mannella, F. (2013a) The hierarchical organisation of cortical and basal-ganglia systems: A computationally-informed review and integrated hypothesis. In: Computational and robotic models of the hierarchical organisation of behaviour, ed. G. Baldassarre & M. Mirolli, pp. 237-70. Springer-Verlag.
  21. Baldassarre, G. & Mirolli, M., eds. (2013) Intrinsically motivated learning in natural and artificial systems. Springer. [GB, P-YO]
  22. Baranes, A. & Oudeyer, P.-Y. (2013) Active learning of inverse models with intrin- sically motivated goal exploration in robots. Robotics and Autonomous Systems 61(1):49-73.
  23. Barros, P. & Wermter, S. (2016) Developing crossmodal expression recognition based on a deep neural model. Adaptive Behavior 24(5):373-96.
  24. Barsalou, L. W. (1983) Ad hoc categories. Memory & Cognition 11(3):211-27.
  25. Barto, A. (2013) Intrinsic motivation and reinforcement learning. In: Intrinsically motivated learning in natural and artificial systems, ed. G. Baldassarre & M. Mirolli, pp. 17-47. Springer.
  26. Bartunov, S. & Vetrov, D. P. (2016) Fast adaptation in generative models with generative matching networks. arXiv preprint 1612.02192. · arXiv
  27. Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P. & Friston, K. J. (2012) Canonical microcircuits for predictive coding. Neuron 76:695-711. http://doi.org/10.1016/j.neuron.2012.10.038. [aBML, DGe] · DOI · Paper page
  28. Bates, C. J., Yildirim, I., Tenenbaum, J. B. & Battaglia, P. W. (2015) Humans predict liquid dynamics using probabilistic simulation. In: Proceedings of the 37th Annual Conference of the Cognitive Science Society, Pasadena, CA, July 22-25, 2015, pp. 172-77. Cognitive Science Society.
  29. Battaglia, P., Pascanu, R., Lai, M. & Rezende, D. J. (2016) Interaction networks for learning about objects, relations and physics. Presented at the 2016 Neural Information Processing Systems conference, Barcelona, Spain, December 5- 10, 2016. In: Advances in neural information processing systems 29 (NIPS 2016), ed. D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon & R. Garnett, pp. 4502-10. Neural Information Processing Systems.
  30. Battaglia, P. W., Hamrick, J. B. & Tenenbaum, J. B. (2013) Simulation as an engine of physical scene understanding. Proceedings of the National Academy of Sci- ences of the United States of America 110(45):18327-32.
  31. Baudiš, P. & Gailly, J.-l. (2012) PACHI: State of the art open source Go program. In: Advances in computer games: 13 th International Conference, ACG 2011, Till- burg, The Netherlands, November 20-22, 2011, Revised Selected Papers, ed. H. Jaap van den Herik & A. Plast, pp. 24-38. Springer.
  32. Bauer, J., Dávila-Chacón, J. & Wermter, S. (2015) Modeling development of natural multi-sensory integration using neural self-organisation and probabilistic pop- ulation codes. Connection Science 27(4):358-76.
  33. Baxter, J. (2000) A model of inductive bias learning. Journal of Artificial Intelligence Research 12:149-98.
  34. Bellemare, M., Srinivasan, S., Ostrovski, G., Schaul, T., Saxton, D. & Munos, R. (2016) Unifying count-based exploration and intrinsic motivation. Presented at the 2016 Neural Information Processing Systems conference, Barcelona, Spain, December 5-10, 2016. In: Advances in neural information processing systems 29 (NIPS 2016), ed. D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon & R. Garnett, pp. 1471-79. Neural Information Processing Systems.
  35. Bellemare, M. G., Naddaf, Y., Veness, J. & Bowling, M. (2013) The arcade learning environment: An evaluation platform for general agents. Journal of Artificial Intelligence Research 47:253-79.
  36. Bengio, J. (2009) Learning deep architectures for AI. Foundations and Trends in Machine Learning 2(1):1-127.
  37. Bengio, Y. (2016) Machines who learn. Scientific American 314(6):46-51.
  38. Bennis, W. M., Medin, D. L. & Bartels, D. M. (2010) The costs and benefits of calculation and moral rules. Perspectives on Psychological Science 5(2):187-202. doi:10.1177/1745691610362354. · DOI
  39. Berdahl, C. H. (2010) A neural network model of Borderline Personality Disorder. Neural Networks 23(2):177-88.
  40. Berlyne, D. E. (1966) Curiosity and exploration. Science 153(3731):25-33. doi:10.1126/science.153.3731.25 aBML, CDG] · DOI
  41. Berthiaume, V. G., Shultz, T. R. & Onishi, K. H. (2013) A constructivist connec- tionist model of transitions on false-belief tasks. Cognition 126(3): 441-58.
  42. Berwick, R. C. & Chomsky, N. (2016) Why only us: Language and evolution. MIT Press.
  43. Bi, G.-Q. & Poo, M.-M. (2001) Synaptic modification by correlated activity: Hebb's postulate revisited. Annual Review of Neuroscience 24:139-66.
  44. Biederman, I. (1987) Recognition-by-components: A theory of human image understanding. Psychological Review 94(2):115-47.
  45. Bienenstock, E., Cooper, L. N. & Munro, P. W. (1982) Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. The Journal of Neuroscience 2(1):32-48.
  46. Bienenstock, E., Geman, S. & Potter, D. (1997) Compositionality, MDL priors, and object recognition. Presented at the 1996 Neural Information Processing Systems conference, Denver, CO, December 2-5, 1996. In: Advances in neural information processing systems 9, ed. M. C. Mozer, M. I. Jordan & T. Petsche, pp. 838-44. Neural Information Processing Systems Foundation.
  47. Blackburn, S. (1984) Spreading the word: Groundings in the philosophy of language. Oxford University Press.
  48. Bloom, P. (2000) How children learn the meanings of words. MIT Press.
  49. Blundell, C., Uria, B., Pritzel, A., Li, Y., Ruderman, A., Leibo, J. Z., Rae, J., Wierstra, D. & Hassabis, D. (2016) Model-free episodic control. arXiv preprint 1606.04460. Available at: https://arxiv.org/abs/1606.04460. [aBML, MB] · arXiv
  50. Boden, M. A. (2006) Mind as machine: A history of cognitive science. Oxford Uni- versity Press.
  51. Bonawitz, E., Shafto, P., Gweon, H., Goodman, N. D., Spelke, E. & Schulz, L. (2011) The double-edged sword of pedagogy: Instruction limits spontaneous exploration and discovery. Cognition 120(3):322-30. Available at: http://doi.org/ 10.1016/j.cognition.2010.10.001. · DOI
  52. Bostrom, N. (2014) Superintelligence: Paths, dangers, strategies. Oxford University Press. ISBN 978-0199678112.
  53. Bottou, L. (2014) From machine learning to machine reasoning. Machine Learning 94(2):133-49.
  54. Boyd, R., Richerson, P. J. & Henrich, J. (2011) The cultural niche: Why social learning is essential for human adaptation. Proceedings of the National Academy of Sciences of the United States of America 108(suppl 2):10918-25.
  55. Braud, R., Mostafaoui, G., Karaouzene, A. & Gaussier, P. (2014). Simulating the emergence of early physical and social interactions: A developmental route through low level visuomotor learning. In: From Animal to Animats 13: Proceed- ings of the 13th International Conference on Simulation of Adaptive Behavior, Castellon, Spain, July 2014, ed.
  56. A. P. del Pobil, E. Chinalleto, E. Martinez-Martin, J. Hallam, E. Cervera & A. Morales, pp. 154-65. Springer.
  57. Breazeal, C. & Scassellati, B. (2002). Robots that imitate humans. Trends in Cog- nitive Sciences 6(11):481-87.
  58. Brenner, L. (2016) Exploring the psychosocial impact of Ekso Bionics Technology. Archives of Physical Medicine and Rehabilitation 97(10):e113.
  59. Briggs, F. & Usrey, W. M. (2007) A fast, reciprocal pathway between the lateral geniculate nucleus and visual cortex in the macaque monkey. The Journal of Neuroscience 27(20):5431-36.
  60. Buchsbaum, D., Gopnik, A., Griffiths, T. L. & Shafto, P. (2011) Children's imitation of causal action sequences is influenced by statistical and pedagogical evidence. Cognition 120(3):331-40. Available at: http://doi.org/10.1016/j.cognition.2010. 12.001. · DOI
  61. Buckingham, D. & Shultz, T. R. (2000) The developmental course of distance, time, and velocity concepts: A generative connectionist model. Journal of Cognition and Development 1(3):305-45.
  62. Burrell, J. (2016) How the machine 'thinks': Understanding opacity in machine learning algorithms. Big Data & Society 3(1):1-12. doi:10.1177/ 2053951715622512. · DOI · Paper page
  63. Buscema, M. (1995) Self-reflexive networks: Theory -topology -Applications. Quality and Quantity 29(4):339-403.
  64. Buscema, M. (1998) Metanet*: The theory of independent judges. Substance Use and Misuse 32(2):439-61.
  65. M. Buscema & W. J. Tastle, pp. 481-511. Springer.
  66. Buscema, M., Grossi, E., Montanini, L. & Street, M. E. (2015) Data mining of determinants of intrauterine growth retardation revisited using novel algorithms generating semantic maps and prototypical discriminating variable profiles. PLoS One 10(7):e0126020.
  67. Buscema, M., Tastle, W. J. & Terzi, S. (2013) Meta net: A new meta-classifier family. In: Data mining applications using artificial adaptive systems, ed. W. J. Tastle, pp. 141-82. Springer.
  68. Buscema, M., Terzi, S. & Tastle, W.J. (2010). A new meta-classifier. In: 2010 Annual Meeting of the North American Fuzzy Information Processing Society (NAFIPS), Toronto, ON, Canada, pp. 1-7. IEEE.
  69. Bushdid, C., Magnasco, M. O., Vosshall, L. B. & Keller, A. (2014) Humans can dis- criminate more than 1 trillion olfactory stimuli. Science 343(6177):1370-72.
  70. Caglar, L. R. & Hanson, S. J. (2016) Deep learning and attentional bias in human category learning. Poster presented at the Neural Computation and Psychology Workshop on Contemporary Neural Networks, Philadelphia, PA, August 8-10, 2016.
  71. Caligiore, D., Borghi, A., Parisi, D. & Baldassarre, G. (2010) TRoPICALS: A com- putational embodied neuroscience model of compatibility effects. Psychological Review 117(4):1188-228.
  72. Caligiore, D., Pezzulo, G., Baldassarre, G., Bostan, A. C., Strick, P. L., Doya, K., Helmich, R. C., Dirkx, M., Houk, J., Jörntell, H., Lago-Rodriguez, A., Galea, J. M., Miall, R. C., Popa, T., Kishore, A., Verschure, P. F. M. J., Zucca, R. & Herreros, I. (2016) Consensus paper: Towards a systems-level view of cerebellar function: The interplay between cerebellum, basal ganglia, and cortex. The Cerebellum 16(1):203-29. doi: 10.1007/s12311-016-0763-3. · DOI
  73. Calimera, A., Macii, E. & Poncino, M. (2013) The human brain project and neuro- morphic computing. Functional Neurology 28(3):191-96.
  74. Cangelosi, A. & Schlesinger, M. (2015) Developmental robotics: From babies to robots. MIT Press.
  75. Cardon, A. (2006) Artificial consciousness, artificial emotions, and autonomous robots. Cognitive Processes 7(4):245-67.
  76. Carey, S. (1978) The child as word learner. In: Linguistic theory and psychological reality, ed. J. Bresnan, G. Miller & M. Halle, pp. 264-93. MIT Press.
  77. Carey, S. (2004) Bootstrapping and the origin of concepts. Daedalus 133(1):59-68.
  78. Carey, S. (2009) The origin of concepts. Oxford University Press.
  79. Carey, S. (2011) The origin of concepts: A précis. Behavioral and Brain Sciences 34 (03):113-62.
  80. Chavajay, P. & Rogoff, B. (1999) Cultural variation in management of attention by children and their caregivers. Developmental Psychology 35(4):1079.
  81. Chen, X. & Yuille, A. L. (2014) Articulated pose estimation by a graphical model with image dependent pairwise relations. In: Advances in neural information pro- cessing systems 27 (NIPS 2014), ed. Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence & K. Q. Weinberger, pp. 1736-44. Neural Information Processing Systems Foundation.
  82. Chen, Z. & Klahr, D. (1999) All other things being equal: Acquisition and transfer of the control of variables strategy. Child Development 70(5):1098-120.
  83. P-YO] Chi, M. T., Slotta, J. D. & De Leeuw, N. (1994) From things to processes: A theory of conceptual change for learning science concepts. Learning and Instruction 4 (1):27-43.
  84. Chiandetti, C., Spelke, E. S. & Vallortigara, G. (2014) Inexperienced newborn chicks use geometry to spontaneously reorient to an artificial social partner. Develop- mental Science 18(6):972-78. doi:10.1111/desc.12277. · DOI
  85. Christiansen, M. H. & Chater, N. (2016) Creating language: Integrating evolution, acquisition, and processing. MIT Press.
  86. Ciresan, D., Meier, U. & Schmidhuber, J. (2012) Multi-column deep neural net- works for image classification. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, June 16-21, 2012, pp. 3642- 49. IEEE.
  87. Clark, K. B. (2012) A statistical mechanics definition of insight. In: Computational intelligence, ed. A. G. Floares, pp. 139-62. Nova Science. ISBN 978-1-62081- 901-2.
  88. Clark, K. B. (in press-a) Classical and quantum Hebbian learning in modeled cog- nitive processing. Frontiers in Psychology.
  89. Clark, K. B. (in press-b) Neural field continuum limits and the partitioning of cog- nitive-emotional brain networks. Molecular and Cellular Neuroscience.
  90. Clark, K. B. (in press-c) Psychometric "Turing test" of general intelligences in social robots. Information Sciences.
  91. Cleeremans, A. (1993) Mechanisms of implicit learning: Connectionist models of sequence processing. MIT Press.
  92. Clegg, J. M., Wen, N. J. & Legare, C. H. (2017) Is non-conformity WEIRD? Cul- tural variation in adults' beliefs about children's competency and conformity. Journal of Experimental Psychology: General 146(3):428-41.
  93. Cohen, E. H. & Tong, F. (2015) Neural mechanisms of object-based attention. Cerebral Cortex 25(4):1080-92. http://doi.org/10.1093/cercor/bht303. · DOI
  94. Collins, A. G. E. & Frank, M. J. (2013) Cognitive control over learning: Creating, clustering, and generalizing task-set structure. Psychological Review 120 (1):190-229.
  95. Collins, S., Ruina, A., Tedrake, R. & Wisse, M. (2005) Efficient bipedal robots based on passive-dynamic walkers. Science 307(5712):1082-85.
  96. Cook, C., Goodman, N. D. & Schulz, L. E. (2011) Where science starts: Sponta- neous experiments in preschoolers' exploratory play. Cognition 120(3):341-49.
  97. Cooper, R. P. (2016) Executive functions and the generation of "random" sequential responses: A computational account. Journal of Mathematical Psychology 73:153-68. doi: 10.1016/j.jmp.2016.06.002. · DOI
  98. Correa-Chávez, M. & Rogoff, B. (2009) Children's attention to interactions directed to others: Guatemalan Mayan and European American patterns. Developmental Psychology 45(3):630.
  99. Corriveau, K. H., Kim, E., Song, G. & Harris, P. L. (2013) Young children's defer- ence to a consensus varies by culture and judgment setting. Journal of Cognition and Culture 13(3-4):367-81.
  100. Coutinho, E., Deng, J. & Schuller, B. (2014) Transfer learning emotion manifestation across music and speech. In: Proceedings of the 2014 International Joint Confer- ence on Neural Networks (IJCNN), Beijing, China. pp. 3592-98. IEEE.
  101. Csibra, G. & Gergely, G. (2009) Natural pedagogy. Trends in Cognitive Sciences 13 (4):148-53.
  102. Davies, J. (2016) Program good ethics into artificial intelligence. Nature 538(7625). Available at: http://www.nature.com/news/program-good-ethics-into-artificial- intelligence-1.20821.
  103. Davis, E. & Marcus, G. (2014) The scope and limits of simulation in cognition. arXiv preprint 1506.04956. Available at: arXiv: http://arxiv.org/abs/1506.04956. · arXiv
  104. Davis, E. & Marcus, G. (2015) Commonsense reasoning and commonsense knowl- edge in artificial Intelligence. Communications of the ACM 58(9):92-103.
  105. Davoodi, T., Corriveau, K. H. & Harris, P. L. (2016) Distinguishing between realistic and fantastical figures in Iran. Developmental Psychology 52(2):221.
  106. Daw, N. D., Niv, Y. & Dayan, P. (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 8(12):1704-11. doi:10.1038/nn1560. · DOI · Paper page
  107. Dayan, P., Hinton, G. E., Neal, R. M. & Zemel, R. S. (1995) The Helmholtz machine. Neural Computation 7(5):889-904.
  108. Dehghani, M., Tomai, E., Forbus, K. & Klenk, M. (2008) An integrated reasoning approach to moral decision-making. In: Proceedings of the 23rd AAAI National Conference on Artificial Intelligence, vol. 3, pp. 1280-86. AAAI Press.
  109. DeJong, G. & Mooney, R. (1986) Explanation-based learning: An alternative view. Machine Learning 1(2):145-76.
  110. Denil, M., Agrawal, P., Kulkarni, T. D., Erez, T., Battaglia, P. & de Freitas, N. (2016). Learning to perform physics experiments via deep reinforcement learning. arXiv preprint:1611.01843. Available at: https://arxiv.org/abs/1611. 01843. · arXiv
  111. Dennett, D. C. (1987) The intentional stance. MIT Press.
  112. Dennett, D. C. (2013) Aching voids and making voids [Review of the book Incom- plete nature: How mind emerged from matter by T. Deacon]. The Quarterly Review of Biology 88(4):321-24.
  113. Denton, E., Chintala, S., Szlam, A. & Fergus, R. (2015) Deep generative image models using a Laplacian pyramid of adversarial networks. Presented at the 2015 Neural Information Processing Systems conference, Montreal, QC, Canada, In: Advances in neural information processing systems 28 (NIPS 2015), ed. C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama & R. Garnett [poster]. Neural Information Processing Systems Foundation.
  114. Di, G. Q. & Wu, S. X. (2015) Emotion recognition from sound stimuli based on back- projection neural networks and electroencephalograms. Journal of the Acoustics Society of America 138(2):994-1002.
  115. DiCarlo, J. J., Zoccolan, D. & Rust, N. C. (2012) How does the brain solve visual object recognition? Neuron 73(3):415-34.
  116. Dietvorst, B. J., Simmons, J. P. & Massey, C. (2015) Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology: General 144(1):114-26.
  117. Dietvorst, B. J., Simmons, J. P. & Massey, C. (2016) Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2616787.
  118. Diuk, C., Cohen, A. & Littman, M. L. (2008) An object-oriented representation for efficient reinforcement learning. In: Proceedings of the 25th International Conference on Machine Learning (ICML'08), Helsinki, Finland, pp. 240-47. ACM.
  119. DiYanni, C. J., Corriveau, K. H., Kurkul, K., Nasrini, J. & Nini, D. (2015) The role of consensus and culture in children's imitation of questionable actions. Journal of Experimental Child Psychology 137:99-110.
  120. Doeller, C. F., Barry, C. & Burgess, N. (2010) Evidence for grid cells in a human memory network. Nature 463(7281):657-61. doi:10.1038/nature08704. · DOI · Paper page
  121. Doeller, C. F. & Burgess, N. (2008) Distinct error-correcting and incidental learning of location relative to landmarks and boundaries. Proceedings of the National Academy of Sciences of the United States of America 105(15):5909-14.
  122. Doeller, C. F., King, J. A. & Burgess, N. (2008) Parallel striatal and hippocampal systems for landmarks and boundaries in spatial memory. Proceedings of the National Academy of Sciences of the United States of America 105(15):5915-20. doi:10.1073/pnas.0801489105. · DOI
  123. Don, H. J., Goldwater, M. B., Otto, A. R. & Livesey, E. J. (2016) Rule abstraction, model-based choice, and cognitive reflection. Psychonomic Bulletin & Review 23(5):1615-23.
  124. Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Saenko, K. & Darrell, T. (2015) Long-term recurrent convolutional networks for visual recognition and description. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, June 7-12, 2015, pp. 2625-34. IEEE.
  125. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E. & Darrell, T. (2014) DeCAF: A deep convolutional activation feature for generic visual rec- ognition. Presented at the International Conference on Machine Learning, Beijing, China, June 22-24, 2014. Proceedings of Machine Learning Research 32(1):647-55.
  126. Dörner, D. & Güss, C. D. (2013) PSI: A computational architecture of cognition, motivation, and emotion. Review of General Psycholog 17:297-317. doi:10.1037/a0032947. · DOI
  127. Doshi-Velez, F. & Kim, B. (2017) A roadmap for a rigorous science of interpret- ability. arXiv preprint 1702.08608. Available at: https://arxiv.org/abs/1702. 08608. · arXiv
  128. Doya, K. (1999) What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Networks 12(7-8):961-74.
  129. Duan, Y., Schulman, J., Chen, X., Bartlett, P. L., Sutskever, I. & Abbeel, P. (2016) RL 2 : Fast reinforcement learning via slow reinforcement learning. arXiv pre- print 1611.02779. Available at: https://arxiv.org/pdf/1703.07326.pdf. · arXiv
  130. Dunbar, K. (1995) How scientists really reason: Scientific reasoning in real-world laboratories. In: The nature of insight, ed. R. J. Sternberg & J. E. Davidson, pp. 365-95. MIT Press.
  131. Edelman, S. (2015) The minority report: Some common assumptions to reconsider in the modelling of the brain and behaviour. Journal of Experimental & Theo- retical Artificial Intelligence 28(4):751-76.
  132. Eden, M. (1962) Handwriting and pattern recognition. IRE Transactions on Infor- mation Theory 8:160-66.
  133. Eickenberg, M., Gramfort, A., Varoquaux, G. & Thirion, B. (2016) Seeing it all: Convolutional network layers map the function of the human visual system. NeuroImage 2017;152:184-94.
  134. Eliasmith, C., Stewart, T. C., Choo, X., Bekolay, T., DeWolf, T., Tang & Y. Rasmussen, D. (2012) A large-scale model of the functioning brain. Science 338(6111):1202-05.
  135. Elman, J. L. (1993) Learning and development in neural networks: The importance of starting small. Cognition 48(1):71-99.
  136. Elman, J. L. (2005) Connectionist models of cognitive development: Where next? Trends in Cognitive Sciences 9(3):111-17.
  137. Elman, J. L., Bates, E. A., Johnson, M. H., Karmiloff-Smith, A., Parisi, D. & Plun- kett, K. (1996) Rethinking innateness. MIT Press.
  138. Eslami, S. M., Heess, N., Weber, T., Tassa, Y., Kavukcuoglu, K. & Hinton, G. E. (2016) Attend, infer, repeat: Fast scene understanding with generative models. Presented at the 2016 Neural Information Processing Systems conference, Barcelona, Spain, December 5-10, 2016. In: Advances in Neural Information Processing Systems 29 (NIPS 2016), ed.
  139. D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon & R. Garnett, pp. 3225-33. Neural Information Processing Systems Foundation. [arBML, MB]
  140. Eslami, S. M. A., Tarlow, D., Kohli, P. & Winn, J. (2014) Just-in-time learning for fast and flexible inference. Presented at the 2014 Neural Information Processing Systems conference, Montreal, QC, Canada, December 8-13, 2014. In: Advances in neural information processing systems 27 (NIPS 2014), ed. Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence & K. Q. Weinberger, pp. 1736-44. Neural Information Processing Systems Foundation.
  141. Fasolo, A. (2011) The theory of evolution and its impact. Springer.
  142. Feigenbaum, E. & Feldman, J., eds. (1995) Computers and thought. AAAI Press.
  143. Flash, T., Hochner, B. (2005) Motor primitives in vertebrates and invertebrates. Current Opinion in Neurobiology 15(6):660-66.
  144. Fodor, J. A. (1975) The language of thought. Harvard University Press.
  145. Fodor, J. A. (1981) Representations: Philosophical essays on the foundations of cognitive science. MIT Press.
  146. Fodor, J. A. & Pylyshyn, Z. W. (1988) Connectionism and cognitive architecture: A critical analysis. Cognition 28(1-2):3-71. [
  147. Fogel, D. B. & Fogel, L. J. (1995) Evolution and computational intelligence. IEEE Transactions on Neural Networks 4:1938-41.
  148. Forbus, K. (2011) Qualitative modeling. Wiley Interdisciplinary Reviews: Cognitive Science 2(4):374-91.
  149. Forbus, K., Ferguson, R., Lovett, A. & Gentner, D. (2017) Extending SME to handle large-scale cognitive modeling. Cognitive Science 41(5):1152-201. doi:10.1111/cogs.12377. · DOI
  150. Forbus, K. & Gentner, D. 1997. Qualitative mental models: Simulations or memo- ries? Presented at the Eleventh International Workshop on Qualitative Rea- soning, Cortona, Italy, June 3-6, 1997.
  151. Forestier, S. & Oudeyer, P.-Y. (2016) Curiosity-driven development of tool use precursors: A computational model. In: Proceedings of the 38th Annual Con- ference of the Cognitive Science Society, Philadelphia, PA, ed.
  152. A. Papafragou, D. Grodner, D. Mirman & J. C. Trueswell, pp. 1859-1864. Cognitive Science Society.
  153. Fornito, A., Zalesky, A. & Bullmore, E. (2016) Fundamentals of brain network analysis. Academic Press.
  154. Fox, J., Cooper, R. P. & Glasspool, D. W. (2013) A canonical theory of dynamic decision-making. Frontiers in Psychology 4(150):1-19. doi: 10.3389/ fpsyg.2013.00150. · DOI
  155. Franklin, S. (2007) A foundational architecture for artificial general intelligence. In: Advances in artificial general intelligence: Concepts, architectures and algo- rithms: Proceedings of the AGI Workshop 2006, ed. P. Want & B. Goertzel, pp. 36-54. IOS Press.
  156. Freyd, J. (1983) Representing the dynamics of a static form. Memory and Cognition 11(4):342-46.
  157. Freyd, J. (1987) Dynamic mental representations. Psychological Review 94(4):427- 38.
  158. Friedman, S. E. and Forbus, K. D. (2010) An integrated systems approach to expla- nation-based conceptual change. In: Proceedings of the 24th AAAI Conference on Artificial Intelligence, Atlanta, GA, July 11-15, 2010. AAAI Press.
  159. Fung, P. (2015) Robots with heart. Scientific American 313(5):60-63.
  160. Gallese, V. & Lakoff, G. (2005) The brain's concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology 22(3-4):455-79.
  161. Gallistel, C. & Matzel, L. D. (2013) The neuroscience of learning: beyond the Hebbian synapse. Annual Review of Psychology 64:169-200.
  162. Gaussier, P., Moga, S., Quoy, M. & Banquet, J. P. (1998). From perception-action loops to imitation processes: A bottom-up approach of learning by imitation. Applied Artificial Intelligence 12(7-8):701-27.
  163. Gazzaniga, M. (2004) Cognitive neuroscience. MIT Press.
  164. Gelly, S. & Silver, D. (2008) Achieving master level play in 9 × 9 computer Go. In: Proceedings of the Twenty-third AAAI Conference on Artificial Intelligence, Chicago, Illinois, July 13-17, 2008, pp. 1537-40. AAAI Press.
  165. Gelly, S. & Silver, D. (2011) Monte-Carlo tree search and rapid action value esti- mation in computer go. Artificial Intelligence 175(11):1856-75.
  166. Gelman, A., Lee, D. & Guo, J. (2015) Stan: A probabilistic programming language for Bayesian inference and optimization. Journal of Educational and Behavioral Statistics 40:530-43.
  167. Gelman, S. A. (2009) Learning from others: Children's construction of concepts. Annual Review of Psychology 60:115-40.
  168. Gentner, D. (2010) Bootstrapping the mind: Analogical processes and symbol systems. Cognitive Science 34(5):752-75.
  169. Gentner, D., Loewenstein, J., Thompson, L. & Forbus, K. D. (2009) Reviving inert knowledge: Analogical abstraction supports relational retrieval of past events. Cognitive Science 33(8):1343-82.
  170. George, D. & Hawkins, J. (2009) Towards a mathematical theory of cortical micro- circuits. PLoS Computational Biology 5(10):e1000532. Available at: http://doi. org/10.1371/journal.pcbi.1000532. · DOI · Paper page
  171. Gershman, S. J. & Goodman, N. D. (2014) Amortized inference in probabilistic reasoning. In: Proceedings of the 36th Annual Conference of the Cognitive Science Society, Quebec City, QC, Canada, July 23-26, 2014, pp. 517-522. Cognitive Science Society.
  172. Gershman, S. J., Markman, A. B. & Otto, A. R. (2014) Retrospective revaluation in sequential decision making: A tale of two systems. Journal of Experimental Psychology: General 143:182-94.
  173. Gerstenberg, T., Goodman, N. D., Lagnado, D. A. & Tenenbaum, J. B. (2015) How, whether, why: Causal judgments as counterfactual contrasts. In: Proceedings of the 37th Annual Conference of the Cognitive Science Society, Pasadena, CA, July 22-25, 2015, ed. D. C. Noelle, R. Dale, A. S. Warlaumont, J. Yoshimi, T. Matlock, C. D. Jennings & P. P. Maglio, pp. 782-787. Cognitive Science Society. [aBML, ED]
  174. Giambene, G. (2005) Queuing theory and telecommunications networks and appli- cations. Springer Science + Business Media.
  175. Gick, M. L. & Holyoak, K. J. (1980) Analogical problem solving. Cognitive Psy- chology 12(3):306-55.
  176. Gigerenzer, G. (2001) The adaptive toolbox. In: Bounded rationality: The adaptive toolbox, ed. G. Gigerenzer & R. Selten, pp. 37-50. MIT Press.
  177. Gigerenzer, G. & Gaissmaier, W. (2011) Heuristic decision making. Annual Review of Psychology 62:451-82. doi:10.1146/annurev-psych-120709-145346. · DOI · Paper page
  178. Goldberg, A. E. (1995) Constructions: A construction grammar approach to argu- ment structure. University of Chicago Press.
  179. Goodfellow, I., Schlens, J. & Szegedy, C. (2015) Explaining and harnessing adver- sarial examples. Presented at International Conference on Learning Repre- sentations (ICLR), San Diego, CA, May 7-9, 2015. arXiv preprint 1412.6572. Available at: https://arxiv.org/abs/1412.6572. · arXiv
  180. Goodman, N. D. & Frank, M. C. (2016) Pragmatic language interpretation as probabilistic inference. Trends in Cognitive Sciences 20(11):818-29.
  181. Goodman, N. D., Mansinghka, V. K., Roy, D. M., Bonawitz, K. & Tenenbaum, J. B. (2008) Church: A language for generative models. In: Proceedings of the Twenty-Fourth Annual Conference on Uncertainty in Artificial Intelligence, Helsinki, Finland, July 9-12, 2008, pp. 220-29. AUAI Press.
  182. Goodman, N. D., Tenenbaum, J. B., Feldman, J. & Griffiths, T. L. (2008) A rational analysis of rule-based concept learning. Cognitive Science 32(1):108-54.
  183. Goodman, N. D., Tenenbaum, J. B. & Gerstenberg, T. (2015). Concepts in a proba- bilistic language of thought. In: The conceptual mind: New directions in the study of concepts, ed. E. Margolis & S. Laurence, pp. 623-54. MIT Press.
  184. Goodman, N. D., Ullman, T. D. & Tenenbaum, J. B. (2011) Learning a theory of causality. Psychological Review 118(1):110-19.
  185. Gopnik, A., Glymour, C., Sobel, D. M., Schulz, L. E., Kushnir, T. & Danks, D. (2004) A theory of causal learning in children: Causal maps and Bayes nets. Psychological Review 111(1):3-32.
  186. Gopnik, A. & Meltzoff, A. N. (1999) Words, thoughts, and theories. MIT Press.
  187. Gottlieb, J., Oudeyer, P-Y., Lopes, M. & Baranes, A. (2013) Information seeking, curiosity and attention:Computational and neural mechanisms. Trends in Cognitive Science 17(11):585-96.
  188. Graham, D. J. and Rockmore, D. N. (2011) The packet switching brain. Journal of Cognitive Neuroscience 23(2):267-76.
  189. Granger, R. (2006) Engines of the brain: The computational instruction set of human cognition. AI Magazine 27(2):15.
  190. Graves, A. (2014) Generating sequences with recurrent neural networks. arXiv preprint 1308.0850. Available at: http://arxiv.org/abs/1308.0850. · arXiv
  191. Graves, A., Mohamed, A.-R. & Hinton, G. (2013) Speech recognition with deep recurrent neural networks. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada, May 26-31, 2013, pp. 6645-49. IEEE.
  192. Graves, A., Wayne, G. & Danihelka, I. (2014) Neural Turing machines. arXiv pre- print 1410.5401v1. Available at: http://arxiv.org/abs/1410.5401v1. · arXiv
  193. Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwinśka, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., Badia, A. P., Hermann, K. M., Zwols, Y., Ostrovski, G., Cain, A., King, H., Summerfield, C., Blunsom, P., Kayukcuoglu, K. & Hassabis, D. (2016) Hybrid computing using a neural network with dynamic external memory. Nature 538(7626):471-76.
  194. Gray, H. M., Gray, K. & Wegner, D. M. (2007) Dimensions of mind perception. Science 315(5812):619.
  195. Gray, K. & Wegner, D. M. (2012) Feeling robots and human zombies: Mind per- ception and the uncanny valley. Cognition 125(1):125-30.
  196. Graybiel, A. M. (2005) The basal ganglia: learning new tricks and loving it. Current Opinion in Neurobiology 15(6):638-44.
  197. Grefenstette, E., Hermann, K. M., Suleyman, M. & Blunsom, P. (2015). Learning to transduce with unbounded memory. Presented at the 2015 Neural Information Processing Systems conference. In: Advances in Neural Information Processing Systems 28, ed. C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama & R. Garnett. Neural Information Processing Systems Foundation.
  198. Gregor, K., Besse, F., Rezende, D. J., Danihelka, I. & Wierstra, D. (2016) Towards conceptual compression. Presented at the 2016 Neural Information Processing Systems conference, Barcelona, Spain, December 5-10, 2016. In: Advances in Neural Information Processing Systems 29 (NIPS 2016), ed.
  199. D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon & R. Garnett [poster]. Neural Information Processing Systems Foundation.
  200. Gregor, K., Danihelka, I., Graves, A., Rezende, D. J. & Wierstra, D. (2015) DRAW: A recurrent neural network for image generation. Presented at the 32nd Annual International Conference on Machine Learning (ICML'15), Lille, France, July 7-9, 2015. Proceedings of Machine Learning Research 37:1462-71.

200 of 557 shown

Authors
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J.
Affiliations
  • New York University (US)
  • Massachusetts Institute of Technology (US)
  • Harvard University (US)
Venue
arXiv
Publisher
arXiv
Published
2016
Volume
40
Pages
e253-e253
ISSN
0140-525X (ISSN-L)
OpenAlex
W2328078142
Cited by
2,550
References
228
Citations by year
2026: 244 · 2025: 273 · 2024: 305 · 2023: 274 · 2022: 253 · 2021: 358 · 2020: 282 · 2019: 280 · 2018: 168 · 2017: 90 · 2016: 19
FWCI
152.60
Type
journal article
Language
en
Open access
Locations
  • Behavioral and Brain Sciences (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc-sa)
  • arXiv (Cornell University)
Funders
  • National Science Foundation (ES/K002201/1, RP2012-V-022, 1231216)
  • York University
  • Leverhulme Trust (RP2012-V022, ES/K002201/1)
  • Research Councils UK (EP/K039830/1)
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (146702, 144413)
  • Companhia Brasileira de Metalurgia e Mineração (CCF-1231216)
  • Economic and Social Research Council (ES/K002201/1, RP2012-V-022, K002201, ES/K002201/)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
  • Physical Sciences › Computer Science › Artificial Intelligence › Cognitive Computing and Networks
Keywords
human-like learning, artificial intelligence, causal models, explanation and understanding, intuitive theories, compositionality, meta-learning, knowledge generalization, cognitive models, deep neural network
MeSH terms
Achievement, Artificial Intelligence, Humans, Intelligence, Thinking, Visual Perception, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review