The DOI matches its DataCite record.
Active Inference in Hebbian Learning Networks
Open accessAbstract
This work studies how brain-inspired neural ensembles equipped with local Hebbian plasticity can perform active inference (AIF) in order to control dynamical agents. A generative model capturing the environment dynamics is learned by a network composed of two distinct Hebbian ensembles: a posterior network, which infers latent states given the observations, and a state transition network, which predicts the next expected latent state given current state-action pairs. Experimental studies are conducted using the Mountain Car environment from the OpenAI gym suite, to study the effect of the various Hebbian network parameters on the task performance. It is shown that the proposed Hebbian AIF approach outperforms the use of Q-learning, while not requiring any replay buffer, as in typical reinforcement learning systems. These results motivate further investigations of Hebbian learning for the design of AIF networks that can learn environment dynamics without the need for revisiting past buffered experiences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is no standardized way of defining environments for Active Inference agents.
“In general, we observe that there is no standardized way of defining environments for Active Inference agents.”
From Reactive Environments for Active Inference Agents with RxEnvironments.jl (2025) · cites this paper as [20]
Section 4.1, “Mountain Car Environment” (page unavailable), describes the OpenAI Gym environment used in this study. The Introduction and Conclusion (pages unavailable) discuss the agent architecture and results, but none of these passages addresses whether there is a standardized way to define environments for Active Inference agents. Searches for that claim and for environment standards or benchmarks found no such statement. (LLM, conf=0.73)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 25
- Bruno A. Olshausen, David J. Field (1997). "Sparse coding with an overcomplete basis set: A strategy employed by V1?." Vision Research, 37(23), 3311-3325.
- Fang, M.S., Mudigonda, M., Zarcone, R., Khosrowshahi, A., Olshausen, B. (2022). "Learning and Inference in Sparse Coding Models With Langevin Dynamics." Neural Computation, 34(8), 1676-1700.
- Lee, H., Battle, A., Raina, R., Ng, A. (2006). "Efficient sparse coding algorithms." In Advances in Neural Information Processing Systems. MIT Press.
- Friston, K., Kiebel, S. (2009). "Predictive coding under the free-energy principle." Philosophical transactions of the Royal Society of London. Series B, Biological sciences, 364, 1211-21.
- Friston, K. Does predictive coding have a future?. Nat Neurosci 21, 1019-1021 (2018). https://doi.org/10.1038/s41593-018-0200-7 · DOI · Paper page
- Safa, A., Ocket, I., Bourdoux, A., Sahli, H., Catthoor, F., Gielen, G. (2022). "Event Camera Data Classification Using Spiking Networks with Spike-Timing-Dependent Plasticity." In 2022 International Joint Conference on Neural Networks (IJCNN) (pp. 1-8).
- Guo-qiang Bi, Mu-ming Poo (1998). "Synaptic Modifications in Cultured Hippocam- pal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type." Journal of Neuroscience, 18(24), 10464-10472.
- Rao, R., Ballard, D. (1999). "Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects." Nature neuroscience, 2(1), 79-87.
- A. Safa, I. Ocket, A. Bourdoux, H. Sahli, F. Catthoor and G. G. E. Gielen, "STDP-driven Development of Attention-based People Detection in Spiking Neural Networks," in IEEE Transactions on Cognitive and Developmental Systems, 2022, doi: 10.1109/TCDS.2022.3210278. · DOI
- Dmitry Krotov, John J. Hopfield (2019). "Unsupervised learning by competing hidden units." Proceedings of the National Academy of Sciences, 116(16), 7723-7731.
- Parr, T., Pezzulo, G., Friston, K. (2022). "Active Inference: The Free Energy Principle in Mind, Brain, and Behavior." The MIT Press.
- Isomura, T., Shimazaki, H. Friston, K.J. "Canonical neural networks perform active inference." Commun Biol 5, 55 (2022). https://doi.org/10.1038/s42003-021-02994-2 · DOI
- Ueltzhöffer, K. "Deep active inference." Biol Cybern 112, 547-573 (2018). https://doi.org/10.1007/s00422-018-0785-7 · DOI · Paper page
- Fountas, Z., Sajid, N., Mediano, P., Friston, K. (2020). "Deep active inference agents using Monte-Carlo methods." In Advances in Neural Information Processing Systems (pp. 11662-11675).
- Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., Zaremba, W. (2016). "Openai gym." arXiv preprint arXiv:1606.01540. · arXiv
- Sutton, R., Barto, A. (2018 ). "Reinforcement Learning: An Introduction." The MIT Press.
- Ororbia, A. G., Mali, A. (2022). "Backprop-Free Reinforcement Learning with Active Neural Generative Coding." Proceedings of the AAAI Conference on Artificial Intelligence, 36(1), 29-37.
- Alexander Ororbia, Ankur Mali. "Active Predicting Coding: Brain-Inspired Rein- forcement Learning for Sparse Reward Robotic Control Problems." IEEE Interna- tional Conference on Robotics and Automation (ICRA) 2023.
- Yuchen Liang, Chaitanya Ryali, Benjamin Hoover, Leopold Grinberg, Saket Navlakha, Mohammed J Zaki, Dmitry Krotov (2021). "Can a Fruit Fly Learn Word Embeddings?." In International Conference on Learning Representations.
- Ablin, P., Moreau, T., Massias, M., Gramfort, A. (2019). "Learning step sizes for unfolded sparse coding." In Advances in Neural Information Processing Systems.
- Tsung-Han Lin, Ping Tak Peter Tang (2019). "Sparse Dictionary Learning by Dy- namical Neural Networks." In International Conference on Learning Representations.
- Friston, K. "The free-energy principle: a unified brain theory?." Nat Rev Neurosci 11, 127-138 (2010). https://doi.org/10.1038/nrn2787 · DOI · Paper page
- J. R. Hershey and P. A. Olsen, "Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models," 2007 IEEE International Conference on Acous- tics, Speech and Signal Processing -ICASSP '07, Honolulu, HI, USA, 2007, pp. IV-317-IV-320, doi: 10.1109/ICASSP.2007.366913. · DOI
- Kim, E., Lawson, E., Sullivan, K., Kenyon, G. (2019). "Spatiotemporal Sequence Memory for Prediction Using Deep Sparse Coding." In Proceedings of the 7th Annual Neuro-Inspired Computational Elements Workshop. Association for Computing Machinery.
- P. J. Werbos, "Backpropagation through time: what it does and how to do it," in Pro- ceedings of the IEEE, vol. 78, no. 10, pp. 1550-1560, Oct. 1990, doi: 10.1109/5.58337. · DOI · Paper page
Cited by
Sorted by citations
Reactive Environments for Active Inference Agents with RxEnvironments.jl
Nuijten, W. W. L., & de Vries, B. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-77138-5_10
“While some implementations use Gymnasium [24,17,20], others use specialized toolboxes for implementing Active Inference agents for their environment simulation [5,10].”
Metadata
- Authors
- Safa, A., Verbelen, T., Keuninckx, L., Ocket, I., Bourdoux, A., Catthoor, F., Gielen, G., & Cauwenberghs, G.
- Affiliations
- VERSES (United States) (US)
- KU Leuven (BE)
- IMEC (BE)
- University of California San Diego (US)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2306.05053
- OpenAlex
- W4380136417
- Cited by
- 2
- References
- 0
- Citations by year
- 2024: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Fonds Wetenschappelijk Onderzoek
- Vlaamse regering
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Keywords
- active inference, Hebbian learning, Q-learning, cognitive architecture, memory encoding, memory retrieval, attention, reinforcement learning, latent state inference, state transition networks, belief dynamics, biological plausibility, unsupervised learning, dynamic environments, maze navigation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
