Integrating cognitive map learning and active inference for planning in ambiguous environments
Open accessAbstract
Living organisms need to acquire both cognitive maps for learning the structure of the world and planning mechanisms able to deal with the challenges of navigating ambiguous environments. Although significant progress has been made in each of these areas independently, the best way to integrate them is an open research question. In this paper, we propose the integration of a statistical model of cognitive map formation within an active inference agent that supports planning under uncertainty. Specifically, we examine the clone-structured cognitive graph (CSCG) model of cognitive map formation and compare a naive clone graph agent with an active inference-driven clone graph agent, in three spatial navigation scenarios. Our findings demonstrate that while both agents are effective in simple scenarios, the active inference agent is more effective when planning in challenging scenarios, in which sensory observations provide ambiguous information about location.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Current reinforcement learning packages such as Gymnasium can also be used for Active Inference as they describe general control environments.
“Although these packages are designed explicitly for reinforcement learning, which involves computing a reward metric at every state, they can also be used for Active Inference as they describe general control environments [24,17].”
From Reactive Environments for Active Inference Agents with RxEnvironments.jl (2025) · cites this paper as [17]
There is no standardized way of defining environments for Active Inference agents.
“In general, we observe that there is no standardized way of defining environments for Active Inference agents.”
From Reactive Environments for Active Inference Agents with RxEnvironments.jl (2025) · cites this paper as [17]
Sections 3.1 and 3.3 describe particular environments used to evaluate the agents, but do not address whether there is a standardized way to define environments for Active Inference agents. Searches for standardized environments and common benchmarks found no passage making that broader claim. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 20
- J. O'Keefe and L. Nadel, "Précis of O'Keefe & Nadel's The hippocampus as a cognitive map," Behavioral and Brain Sciences, vol. 2, pp. 487-494, Dec. 1979.
- M. Peer, I. K. Brunec, N. S. Newcombe, and R. A. Epstein, "Structuring Knowledge with Cognitive Maps and Cognitive Graphs," Trends in Cognitive Sciences, vol. 25, pp. 37-54, Jan. 2021.
- J. C. R. Whittington, D. McCaffary, J. J. W. Bakermans, and T. E. J. Behrens, "How to build a cognitive map," Nature Neuroscience, vol. 25, pp. 1257-1272, Oct. 2022.
- J. C. Whittington, T. H. Muller, S. Mark, G. Chen, C. Barry, N. Burgess, and T. E. Behrens, "The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation," Cell, vol. 183, pp. 1249-1263.e23, Nov. 2020.
- D. George, R. V. Rikhye, N. Gothoskar, J. S. Guntupalli, A. Dedieu, and M. Lázaro- Gredilla, "Clone-structured graph representations enable flexible learning and vi- carious evaluation of cognitive maps," Nature Communications, vol. 12, p. 2392, Apr. 2021.
- T. Parr, G. Pezzulo, and K. J. Friston, Active Inference: The Free Energy Principle in Mind, Brain, and Behavior. The MIT Press, 2022.
- P. Schwartenbeck, J. Passecker, T. U. Hauser, T. H. FitzGerald, M. Kronbich- ler, and K. J. Friston, "Computational mechanisms of curiosity and goal-directed exploration," eLife, vol. 8, p. e41703, May 2019.
- S. P. Jadhav, C. Kemere, P. W. German, and L. M. Frank, "Awake Hippocampal Sharp-Wave Ripples Support Spatial Memory," Science, vol. 336, pp. 1454-1458, June 2012.
- K. Friston, L. Da Costa, D. Hafner, C. Hesp, and T. Parr, "Sophisticated Infer- ence," 2020. Publisher: arXiv Version Number: 1.
- C. F. J. Wu, "On the convergence properties of the em algorithm," The Annals of Statistics, vol. 11, no. 1, pp. 95-103, 1983.
- C. Heins, B. Millidge, D. Demekas, B. Klein, K. Friston, I. Couzin, and A. Tschantz, "pymdp: A Python library for active inference in discrete state spaces," 2022. Publisher: arXiv Version Number: 2.
- L. Da Costa, T. Parr, N. Sajid, S. Veselic, V. Neacsu, and K. Friston, "Active infer- ence on discrete state-spaces: A synthesis," Journal of Mathematical Psychology, vol. 99, p. 102447, Dec. 2020.
- K. Friston, T. FitzGerald, F. Rigoli, P. Schwartenbeck, and G. Pezzulo, "Active Inference: A Process Theory," Neural Computation, vol. 29, pp. 1-49, Jan. 2017.
- I. Stoianov, D. Maisto, and G. Pezzulo, "The hippocampal formation as a hier- archical generative model supporting generative replay and continual learning," Progress in Neurobiology, vol. 217, p. 102329, Oct. 2022.
- D. Hafner, T. Lillicrap, J. Ba, and M. Norouzi, "Dream to Control: Learning Behaviors by Latent Imagination," Mar. 2020. arXiv:1912.01603 [cs]. · arXiv
- O. C ¸atal, S. Wauthier, C. De Boom, T. Verbelen, and B. Dhoedt, "Learning Gen- erative State Space Models for Active Inference," Frontiers in Computational Neu- roscience, vol. 14, p. 574372, Nov. 2020.
- O. C ¸atal, T. Verbelen, T. Van De Maele, B. Dhoedt, and A. Safron, "Robot nav- igation as hierarchical active inference," Neural Networks, vol. 142, pp. 192-204, Oct. 2021.
- A. Tschantz, M. Baltieri, A. K. Seth, and C. L. Buckley, "Scaling active inference," 2019. Publisher: arXiv Version Number: 1.
- Z. Fountas, N. Sajid, P. A. M. Mediano, and K. Friston, "Deep active inference agents using Monte-Carlo methods," Oct. 2020. arXiv:2006.04176 [cs, q-bio, stat]. · arXiv
- R. Kaplan and K. J. Friston, "Planning and navigation as active inference," Bio- logical Cybernetics, vol. 112, pp. 323-343, Aug. 2018.
Cited by
Sorted by citations
Reactive Environments for Active Inference Agents with RxEnvironments.jl
Nuijten, W. W. L., & de Vries, B. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-77138-5_10
“Although these packages are designed explicitly for reinforcement learning, which involves computing a reward metric at every state, they can also be used for Active Inference as they describe general control environments [24,17].”
- Authors
- Van de Maele, T., Dhoedt, B., Verbelen, T., & Pezzulo, G.
- Affiliations
- Ghent University (BE)
- VERSES (United States) (US)
- National Research Council (IT)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 204-217
- ISSN
- 1865-0929 (ISSN-L)
- arXiv
- 2308.08307
- OpenAlex
- W4388705626
- Cited by
- 5
- References
- 0
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3
- FWCI
- 2.57
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Communications in computer and information science (publishedVersion)
- Ghent University Academic Bibliography (Ghent University) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion, other-oa)
- arXiv (Cornell University) (cc-by)
- Funders
- Fonds Wetenschappelijk Onderzoek
- Vlaamse regering
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
- Keywords
- cognitive maps, active inference, planning under uncertainty, spatial navigation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
