Computational Grounded Cognition: a new alliance between grounded cognition and computational modeling
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Grounded theories assume that there is no central module for cognition. According to this view, all cognitive phenomena, including those considered the province of amodal cognition such as reasoning, numeric, and language processing, are ultimately grounded in (and emerge from) a variety of bodily, affective, perceptual, and motor processes. The development and expression of cognition is constrained by the embodiment of cognitive agents and various contextual factors (physical and social) in which they are immersed. The grounded framework has received numerous empirical confirmations. Still, there are very few explicit computational models that implement grounding in sensory, motor and affective processes as intrinsic to cognition, and demonstrate that grounded theories can mechanistically implement higher cognitive abilities. We propose a new alliance between grounded cognition and computational modeling toward a novel multidisciplinary enterprise: Computational Grounded Cognition. We clarify the defining features of this novel approach and emphasize the importance of using the methodology of Cognitive Robotics, which permits simultaneous consideration of multiple aspects of grounding, embodiment, and situatedness, showing how they constrain the development and expression of cognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
The Ecological Approach to Visual Perception: Classic Edition
Gibson, J. J. (2014) · doi:10.4324/9781315740218 · Cited by 12,132
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
Barsalou, L. W. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093639 · Cited by 5,936 · cited 5×
“A large body of work (reviewed in Barsalou, 2008) strongly supports this view.”
BackgroundMethodInfluentialSelf-citationLearning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · cited 2×
“For example, a family of reinforcement learning algorithms (e.g., Temporal Difference Reinforcement Learning, Sutton, 1988) and statistical methods (e.g., drift diffusion models, Ratcliff, 1978) are widely used to analyze neural data and to develop process models of (perceptual and reward-based) learning and decision-…”
MethodSix views of embodied cognition
Wilson, M. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196322 · Cited by 4,782
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · cited 1×
“…learning algorithms (e.g., Temporal Difference Reinforcement Learning, Sutton, 1988) and statistical methods (e.g., drift diffusion models, Ratcliff, 1978) are widely used to analyze neural data and to develop process models of (perceptual and reward-based) learning and decision-making.”
MethodA Dynamic Systems Approach to the Development of Cognition and Action
Thelen, E., & Smith, L. B. (1994) · doi:10.7551/mitpress/2524.001.0001 · Cited by 3,470
A sensorimotor account of vision and visual consciousness
O'Regan, J. K., & Noë, A. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01000115 · Cited by 3,126 · cited 1×
“Furthermore, during learning strong interdependences among sensory and motor representations are established that incorporate sensory regularities created by an agent’s actions, forming sensorimotor contin-gencies (O’Regan and Noe, 2001) or emulators (Grush, 2004).”
BackgroundNeural simulation of action: a unifying mechanism for motor cognition.
Jeannerod, M. (2001) · NeuroImage · doi:10.1006/nimg.2001.0832 · Cited by 2,563 · cited 2×
“Cognitive robotic models can have realistic embodiment and can be used to investigate the reciprocal influences among the body, action and perception, such as, for instance, how action sculpts the body space (Rizzolatti et al., 1997).”
BackgroundGlenberg, A. M., & Kaschak, M. P. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196313 · Cited by 2,361
Supersizing the Mind: Embodiment, Action, and Cognitive Extension
Clark, A. (2008) · doi:10.1093/acprof:oso/9780195333213.001.0001 · Cited by 2,201
Brain mechanisms linking language and action
Pulvermüller, F. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1706 · Cited by 1,828 · cited 2×
“One challenge for Computational Grounded Cognition is the realization of design principles that take multiple levels and constraints into account and allows researchers to study many phenomena, but are also spe-cific enough to avoid losing contact with data obtained from animal or human experiments.”
BackgroundOn Distinguishing Epistemic from Pragmatic Action
Kirsh, D., & Maglio, P. (1994) · Cognitive Science · doi:10.1207/s15516709cog1804_1 · Cited by 1,641 · cited 2×
“Furthermore, embodiment can alleviate brain processing in multiple ways, for example by providing solutions to control problems (Pfeifer and Bongard, 2006), constraining choice to a space of possibilities that is body-scaled (Gibson, 1979), and implementing situated problem-solving strategies (Kirsh and Maglio, 1994).”
BackgroundNeural Mechanisms for Interacting with a World Full of Action Choices
Cisek, P., & Kalaska, J. F. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135409 · Cited by 1,543 · cited 2×
“…well with current theories in neuroscience that emphasize a continuity between the neuronal circuits that solve essential problems of action speci-fication and selection in early organisms, and those that solve more elaborated problems in humans (cf. Shadlen et al., 2008; Cisek and Kalaska, 2010).”
BackgroundDamasio, A. R. (1989) · Cognition · doi:10.1016/0010-0277(89)90005-x · Cited by 1,538 · cited 1×
“However, modalities are usually not isolated but form integrated and multimodal assemblies, plausibly in association areas or “convergence zones” (Damasio, 1989; Simmons and Barsalou, 2003).”
BackgroundEmbodiment in attitudes, social perception, and emotion
Niedenthal, P. M., Barsalou, L. W., Winkielman, P., Krauth-Gruber, S., & Ric, F. (2005) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0903_1 · Cited by 1,484
Self-citationBayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · cited 2×
“One computational method for integrating modalities is designing robot controllers composed of multiple, interlinked modal maps (e.g., Kohonen’s, 2001 self-organizing maps, or population codes, Ma et al., 2006; Morse et al., 2010).”
BackgroundMethodThe future of memory: remembering, imagining, and the brain
Schacter, D. L., Addis, D. R., Hassabis, D., Martin, V. C., Spreng, R. N., & Szpunar, K. K. (2012) · Neuron · doi:10.1016/j.neuron.2012.11.001 · Cited by 1,398
The emulation theory of representation: Motor control, imagery, and perception
Grush, R. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000093 · Cited by 1,387 · cited 2×
“…central aim is realizing complete robotic architectures that, on the one hand, include principles and constraints derived from animal and human cognition and, on the other hand, have realistic embodiment, sensors and effectors, and learn to act autonomously in complex, open-ended (and social).”
A unifying computational framework for motor control and social interaction
Wolpert, D. M., Doya, K., & Kawato, M. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1238 · Cited by 1,228
Movement-produced stimulation in the development of visually guided behavior.
Held, R., & Hein, A. (1963) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0040546 · Cited by 1,161 · cited 2×
“For example, Held and Hein (1963) showed that if cats experience the world only passively, they develop suboptimal perceptual representations.”
BackgroundHow the Body Shapes the Way We Think: A New View of Intelligence
Pfeifer, R., & Bongard, J. (2006) · doi:10.7551/mitpress/3585.001.0001 · Cited by 956
Corollary discharge across the animal kingdom
Crapse, T. B., & Sommer, M. A. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2457 · Cited by 789 · cited 2×
“One example is the importance of reentrant loops and efference copies in neural computational hierarchies (Crapse and Sommer, 2008), which suggests a possible way that action streams influence perception and cognition.”
BackgroundRizzolatti, G., Fadiga, L., Fogassi, L., & Gallese, V. (1997) · Science · doi:10.1126/science.277.5323.190 · Cited by 712
Probabilistic models of cognition: exploring representations and inductive biases
Griffiths, T. L., Chater, N., Kemp, C., Perfors, A., & Tenenbaum, J. B. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.004 · Cited by 568
The construction system of the brain
Hassabis, D., & Maguire, E. A. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0296 · Cited by 483 · cited 2×
“Forms of action simulation and mental imagery have been linked to comprehension, reasoning, prospection, object categorization, action recognition, and other complex cognitive tasks (Glenberg, 1997; Jeannerod, 2006; Hassabis and Maguire, 2009; Moulton and Kosslyn, 2009; Schacter et al., 2012).”
BackgroundImagining predictions: mental imagery as mental emulation
Moulton, S. T., & Kosslyn, S. M. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0314 · Cited by 421 · cited 2×
“Forms of action simulation and mental imagery have been linked to comprehension, reasoning, prospection, object categorization, action recognition, and other complex cognitive tasks (Glenberg, 1997; Jeannerod, 2006; Hassabis and Maguire, 2009; Moulton and Kosslyn, 2009; Schacter et al., 2012).”
BackgroundEmergence of a 'visual number sense' in hierarchical generative models
Stoianov, I., & Zorzi, M. (2012) · Nature Neuroscience · doi:10.1038/nn.2996 · Cited by 300 · cited 1×
“Alternatively, grounding could be expressed through the perception of the cardinality of a set (Stoianov and Zorzi, 2012 and references therein) which natively supports fundamental cognitive operations.”
Cited by
Consensus Paper: The Cerebellum's Role in Movement and Cognition
Koziol, L. F., Budding, D., Andreasen, N., D’Arrigo, S., Bulgheroni, S., Imamizu, H., Ito, M., Manto, M., Marvel, C., Parker, K., et al. (2014) · The Cerebellum · doi:10.1007/s12311-013-0511-x · Cited by 1,133
Self-citationWhy do you fear the bogeyman? An embodied predictive coding model of perceptual inference
Pezzulo, G. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-013-0227-x · Cited by 128
Self-citationCognition from the bottom up: on biological inspiration, body morphology, and soft materials
Pfeifer, R., Iida, F., & Lungarella, M. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.004 · Cited by 120
Clark, A. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00270 · Cited by 108
Generating meaning: active inference and the scope and limits of passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.10.002 · Cited by 80
“Thisembodied intelligence – and theearlyconnectiontosensorimotorreality – provides acommongroundfor conceptual and linguistic knowledge [72,73].”
Self-citation
Metadata
- Authors
- Pezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., McRae, K., & Spivey, M. J.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2013
- Volume
- 3
- Pages
- 612-612
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2141515093
- Cited by
- 210
- References
- 29
- FWCI
- 8.25
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.