Thinking as the control of imagination: a conceptual framework for goal-directed systems
Abstract
This paper offers a conceptual framework which (re)integrates goal-directed control, motivational processes, and executive functions, and suggests a developmental pathway from situated action to higher level cognition. We first illustrate a basic computational (control-theoretic) model of goal-directed action that makes use of internal modeling. We then show that by adding the problem of selection among multiple action alternatives motivation enters the scene, and that the basic mechanisms of executive functions such as inhibition, the monitoring of progresses, and working memory, are required for this system to work. Further, we elaborate on the idea that the off-line re-enactment of anticipatory mechanisms used for action control gives rise to (embodied) mental simulations, and propose that thinking consists essentially in controlling mental simulations rather than directly controlling behavior and perceptions. We conclude by sketching an evolutionary perspective of this process, proposing that anticipation leveraged cognition, and by highlighting specific predictions of our model.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The phylogenetic progression from primitive homeostatic control to goal-directed control rests on the hierarchical elaboration of more primitive architectures.
“This phylogenetic progression rests on the hierarchical elaboration of more primitive architectures (Cisek and Kalaska, 2010, Pezzulo and Castelfranchi, 2009).”
From Active Inference, homeostatic regulation and adaptive behavioural control (2015) · cites this paper as Pezzulo and Castelfranchi, 2009
The autonomisation of goals from primary drives is a key feature of higher animals like humans and becomes more evident in pathological conditions.
“The ‘autonomisation’ of goals from primary drives is a key feature of higher animals like humans (Pezzulo and Castelfranchi, 2009) and becomes more evident in pathological conditions, where certain goals such as gambling can become pathological and maladaptive (Montague et al., 2012).”
From Active Inference, homeostatic regulation and adaptive behavioural control (2015) · cites this paper as Pezzulo and Castelfranchi, 2009
Cites
The Ecological Approach to Visual Perception: Classic Edition
Gibson, J. J. (2014) · doi:10.4324/9781315740218 · Cited by 12,132 · see citing works
Rizzolatti, G., & Craighero, L. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144230 · Cited by 7,433 · see citing works
Barsalou, L. W. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093639 · Cited by 5,936 · cited 3× · see citing works
“and ends at a quite abstract level, although evidence that these mental operations are hardly fully detached from sensorimotor action continues to accumulate (Barsalou, 2008).”
BackgroundMethodInfluentialImplementation intentions: Strong effects of simple plans.
Gollwitzer, P. M. (1999) · American Psychologist · doi:10.1037/0003-066x.54.7.493 · Cited by 5,478 · see citing works
The unbearable automaticity of being
Bargh, J. A., & Chartrand, T. L. (1999) · American Psychologist · doi:10.1037/0003-066x.54.7.462 · Cited by 3,699 · see citing works
Cattaneo, L., & Rizzolatti, G. (2009) · Archives of Neurology · doi:10.1001/archneurol.2009.41 · Cited by 3,137 · see citing works
Das Reafferenzprinzip: Wechselwirkungen zwischen Zentralnervensystem und Peripherie
von Holst, E., & Mittelstaedt, H. (1950) · Naturwissenschaften · doi:10.1007/bf00622503 · Cited by 2,655 · see citing works
Behavior: The Control of Perception
Kuhn, A., & Powers, W. T. (1975) · Contemporary Sociology · doi:10.2307/2063243 · Cited by 2,398 · see citing works
A unifying view of the basis of social cognition
GALLESE, V, KEYSERS, C., & RIZZOLATTI, G. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.07.002 · Cited by 2,236 · see citing works
Grasping the intentions of others with one's own mirror neuron system
Iacoboni, M., Molnar-Szakacs, I., Gallese, V., Buccino, G., Mazziotta, J. C., & Rizzolatti, G. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030079 · Cited by 2,044 · see citing works
Perception and Action Planning
Prinz, W. (1997) · European Journal of Cognitive Psychology · doi:10.1080/713752551 · Cited by 2,013 · see citing works
Parietal Lobe: From Action Organization to Intention Understanding
Fogassi, L., Ferrari, P. F., Gesierich, B., Rozzi, S., Chersi, F., & Rizzolatti, G. (2005) · Science · doi:10.1126/science.1106138 · Cited by 1,990 · see citing works
A Closed-Loop Theory of Motor Learning
Adams, J. A. (1971) · Journal of Motor Behavior · doi:10.1080/00222895.1971.10734898 · Cited by 1,636 · see citing works
The emulation theory of representation: Motor control, imagery, and perception
Grush, R. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000093 · Cited by 1,387 · cited 8× · see citing works
“The idea of coupling between action execution and anticipation of its effects is also central to recent theories of internal modeling (Grush, 2004; Kawato, 1999; Ito, 1993; Miall and Wolpert, 1996; Oztop et al., 2006; Wolpert and Ghahramani, 2004), which we adopt here in continuity with the ideas…”
InfluentialForward modeling allows feedback control for fast reaching movements
Desmurget, M., & Grafton, S. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01537-0 · Cited by 1,300 · cited 2× · see citing works
“…and (multiple) schema(s), composed of inverse and forward models, inside the dotted square. this loops parallels the external feedback loop and supports states and inputs estimation and fast corrective command (Desmurget and Grafton, 2000) via feedback prediction (the part in gray inside the loop).”
BackgroundArbib, M. A. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000038 · Cited by 1,164 · see citing works
Brass, M., Bekkering, H., Wohlschläger, A., & Prinz, W. (2000) · Brain and Cognition · doi:10.1006/brcg.2000.1225 · Cited by 791 · see citing works
A normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251 · see citing works
Hierarchical MOSAIC for movement generation.
Haruno, M., Wolpert, D. M., & Kawato, M. (2003) · International Congress Series · doi:10.1016/s0531-5131(03)00190-0 · Cited by 132 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Neural Mechanisms for Interacting with a World Full of Action Choices
Cisek, P., & Kalaska, J. F. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135409 · Cited by 1,543 · see citing works
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731 · see citing works
Self-citationActive Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650 · see citing works
“…the same perceptual-motor loops – and internally generated brain dynamics – might realize increasingly complex cognitive functions such as planning, imagery, and conscious thought (Buzsa´ki et al., 2014; Grush, 2004; Hesslow, 2002; Jeannerod, 2001; Pezzulo, 2011; Pezzulo and Castelfranchi, 2009).”
InfluentialSelf-citationThe anatomy of choice: active inference and agency
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00598 · Cited by 340 · see citing works
Hierarchical active inference: A theory of motivated control
Pezzulo, G., Rigoli, F., & Friston, K. J. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.009 · Cited by 334 · see citing works
Self-citationEmbodied choice: how action influences perceptual decision making
Lepora, N. F., & Pezzulo, G. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004110 · Cited by 209 · see citing works
Self-citationPezzulo, G., Rigoli, F., & Chersi, F. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00092 · Cited by 163 · see citing works
Self-citationPezzulo, G., Barca, L., Bocconi, A. L., & Borghi, A. M. (2010) · Brain and Cognition · doi:10.1016/j.bandc.2010.03.002 · Cited by 138 · see citing works
Self-citationThe why, what, where, when and how of goal-directed choice: neuronal and computational principles
Verschure, P. F. M. J., Pennartz, C. M. A., & Pezzulo, G. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0483 · Cited by 131 · see citing works
“However, through the state space learning systems of the AL and the task learning systems of the CL, these goals become incrementally more abstracted from their homeostatic origins (see also [137,138]).”
BackgroundCaligiore, D., Pezzulo, G., Miall, R. C., & Baldassarre, G. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.07.016 · Cited by 87 · see citing works
Self-citationGenerating meaning: active inference and the scope and limits of passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.10.002 · Cited by 80 · see citing works
Self-citationAn Active Inference view of cognitive control
Pezzulo, G. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00478 · Cited by 68 · see citing works
“…such as planning, emulation, imagery, mental state inference, goal-directed decision-making, prospection, and the acquisition of declarative knowledge (Hesslow, 2002; Grush, 2004; Jeannerod, 2006; Pezzulo and Castelfranchi, 2007, 2009; Moulton and Kosslyn, 2009; Pezzulo, 2011; Clark, in press).”
Maisto, D., Donnarumma, F., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.1335 · Cited by 59 · see citing works
Self-citationThe principles of goal-directed decision-making: from neural mechanisms to computation and robotics
Pezzulo, G., Verschure, P. F. M. J., Balkenius, C., & Pennartz, C. M. A. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0470 · Cited by 35 · see citing works
Self-citationGenerating Meaning: Active Inference and the Scope and Limits of Passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2023) · doi:10.31234/osf.io/8xgzv · Cited by 8 · see citing works
Self-citation
- Authors
- Pezzulo, G., & Castelfranchi, C.
- Affiliations
- Institute for Computational Linguistics “A. Zampolli” (IT)
- Institute of Cognitive Sciences and Technologies (IT)
- Corresponding author
- Pezzulo, Giovanni
- Castelfranchi, Cristiano
- Venue
- Psychological Research Psychologische Forschung
- Published
- 2009-04-04
- Volume
- 73
- Issue
- 4
- Pages
- 559-577
- ISSN
- 0033-3026 (ISSN-L)
- 0340-0727
- 1430-2772
- OpenAlex
- W2002423417
- Cited by
- 141
- References
- 19
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 2 · 2023: 4 · 2022: 7 · 2021: 11 · 2020: 7 · 2019: 3 · 2018: 6 · 2017: 13 · 2016: 12 · 2015: 13 · 2014: 16 · 2013: 12 · 2012: 6
- FWCI
- 4.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Psychological Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Keywords
- goal-directed action, executive function, motivation, control-theoretic model, action selection, inhibition, working memory, progress monitoring, mental simulation, imagination, anticipation, cognitive development, situated action
- MeSH terms
- Animals, Attention, Culture, Decision Making, Goals, Higher Nervous Activity, Humans, Imagination, Inhibition, Psychological, Memory, Short-Term, Motivation, Problem Solving, Psychomotor Performance, Thinking, Neural Networks, Computer, Intention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review