Predictive Coding Enhances Meta-RL To Achieve Interpretable Bayes-Optimal Belief Representation Under Partial Observability
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
Expectation in perceptual decision making: neural and computational mechanisms
Summerfield, C., & de Lange, F. P. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3838 · Cited by 832
Learning to reinforcement learn
Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M. (2016) · arXiv · doi:10.48550/arxiv.1611.05763 · Cited by 579
RL$^2$: Fast Reinforcement Learning via Slow Reinforcement Learning
Duan, Y., Schulman, J., Chen, X., Bartlett, P. L., Sutskever, I., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1611.02779 · Cited by 503
Reinforcement Learning with Unsupervised Auxiliary Tasks
Jaderberg, M., Mnih, V., Czarnecki, W. M., Schaul, T., Leibo, J. Z., Silver, D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05397 · Cited by 247
A Tutorial on Meta-Reinforcement Learning
Beck, J., Vuorio, R., Zheran Liu, E., Xiong, Z., Zintgraf, L., Finn, C., & Whiteson, S. (2025) · Foundations and Trends in Machine Learning · doi:10.1561/2200000080 · Cited by 93
Meta reinforcement learning as task inference
Humplik, J., Galashov, A., Hasenclever, L., Ortega, P. A., Teh, Y. W., & Heess, N. (2019) · arXiv · doi:10.48550/arxiv.1905.06424 · Cited by 82
Variational Recurrent Models for Solving Partially Observable Control Tasks
Han, D., Doya, K., & Tani, J. (2019) · Institutional Repositories DataBase (IRDB) · doi:10.48550/arxiv.1912.10703 · Cited by 61
Meta-learning of Sequential Strategies
Ortega, P. A., Wang, J. X., Rowland, M., Genewein, T., Kurth-Nelson, Z., Pascanu, R., Heess, N., Veness, J., Pritzel, A., Sprechmann, P., et al. (2019) · arXiv · doi:10.48550/arxiv.1905.03030 · Cited by 47
Predictive auxiliary objectives in deep RL mimic learning in the brain
Fang, C., & Stachenfeld, K. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.06089 · Cited by 16
Recurrent networks, hidden states and beliefs in partially observable environmentsPreprint
Lambrechts, G., Bolland, A., & Ernst, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.03520 · Cited by 8
Metadata
- Authors
- Kuo, P.-C., Hou, H., Dabney, W., & Walker, E.
- Affiliations
- University of Washington (US)
- Allen Institute for Neural Dynamics (US)
- Google DeepMind (United Kingdom) (GB)
- Venue
- Advances in Neural Information Processing Systems 38
- Published
- 2025
- Pages
- 31829-31860
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7196980702
- Cited by
- 0
- References
- 12
- FWCI
- 0.00
- Type
- conference paper
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- predictive coding, meta-reinforcement learning, belief representation, partial observability, interpretability, hierarchical reinforcement learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.