The DOI matches its DataCite record; 17 of the 22 references it cites were found in a registry or an index.
Neural Map: Structured Memory for Deep Reinforcement Learning
Open accessAbstract
A critical component to enabling intelligent reasoning in partially observable environments is memory. Despite this importance, Deep Reinforcement Learning (DRL) agents have so far used relatively simple memory architectures, with the main methods to overcome partial observability being either a temporal convolution over the past k frames or an LSTM layer. More recent work (Oh et al., 2016) has went beyond these architectures by using memory networks which can allow more sophisticated addressing schemes over the past k frames. But even these architectures are unsatisfactory due to the reason that they are limited to only remembering information from the last k frames. In this paper, we develop a memory system with an adaptable write operator that is customized to the sorts of 3D environments that DRL agents typically interact with. This architecture, called the Neural Map, uses a spatially structured 2D memory image to learn to store arbitrary information about the environment over long time lags. We demonstrate empirically that the Neural Map surpasses previous DRL memories on a set of challenging 2D and 3D maze environments and show that it is capable of generalizing to environments that were not seen during training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This mechanism mimics the human memory process, allowing AI NPC to forget short-term memory, thereby freeing up memory space [16].”
From MemoryRepository for AI NPC (2024) · cites this paper as [16]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
End-to-End Training of Deep Visuomotor PoliciesPreprint
Levine, S., Finn, C., Darrell, T., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 2,641
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
Deep Recurrent Q-Learning for Partially Observable MDPsPreprint
Hausknecht, M., & Stone, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06527 · Cited by 1,450
Hybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412
(2016) · doi:10.18653/v1/d16-1147 · Cited by 1,035
Cited by
Sorted by citations
Items 101–178 of 178
To Learn or Not to Learn: Analyzing the Role of Learning for Navigation in Virtual EnvironmentsPreprint
Kojima, N., & Deng, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.11770 · Cited by 13
Simultaneous Mapping and Target Driven NavigationPreprint
Georgakis, G., Li, Y., & Košecká, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07980 · Cited by 13
Exploiting Human Social Cognition for the Detection of Fake and Fraudulent Faces via Memory NetworksPreprint
Fernando, T., Fookes, C., Denman, S., & Sridharan, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07844 · Cited by 13
Graph Attention Memory for Visual Navigation
Li, D., Zhang, Q., & Zhao, D. (2022) · International Conference on Data-driven Optimization of Complex Systems (DOCS) · doi:10.1109/docs55193.2022.9967733 · Cited by 13
Situational Fusion of Visual Representation for Visual NavigationPreprint
Shen, B., Xu, D., Zhu, Y., Guibas, L. J., Fei-Fei, L., & Savarese, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.09073 · Cited by 12
Learning and Planning with a Semantic ModelPreprint
Wu, Y., Wu, Y., Tamar, A., Russell, S., Gkioxari, G., & Tian, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.10842 · Cited by 15
Learning to Visually Navigate in Photorealistic Environments Without any SupervisionPreprint
Mezghani, L., Sukhbaatar, S., Szlam, A. D., Joulin, A., & Bojanowski, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.04954 · Cited by 11
Reinforcement Learning-Based Coverage Path Planning with Implicit Cellular DecompositionPreprint
Heydari, J., Saha, O., & Ganapathy, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09018 · Cited by 17
Learning Robot Exploration Strategy With 4D Point-Clouds-Like Information as Observations
Li, Z., Li, T., Wang, J., & Meng, M. Q. ‐. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3116703 · Cited by 10
Linton, P., Morgan, M. J., Read, J. C. A., Vishwanath, D., Creem-Regehr, S. H., & Domini, F. (2022) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0443 · Cited by 11
AMRL: Aggregated Memory For Reinforcement Learning
Beck, J., Ciosek, K., Devlin, S., Tschiatschek, S., Zhang, C., & Hofmann, K. (2020) · International Conference on Learning Representations · Cited by 10
Floyd-Warshall Reinforcement Learning: Learning from Past Experiences to Reach New GoalsPreprint
Dhiman, V., Banerjee, S., Siskind, J. M., & Corso, J. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.09318 · Cited by 10
Giving Commands to a Self-driving Car: A Multimodal Reasoner for Visual GroundingPreprint
Deruyttere, T., Collell, G., & Moens, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08717 · Cited by 11
Combining long and short spatiotemporal reasoning for deep reinforcement learning
Liu, P., Liu, P., & Bai, C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129165 · Cited by 10
Lyapunov-Based Long Short-Term Memory (Lb-LSTM) Neural Network-Based Adaptive Observer
Griffis, E. J., Patil, O. S., Hart, R. G., & Dixon, W. E. (2023) · IEEE Control Systems Letters · doi:10.1109/lcsys.2023.3348706 · Cited by 12
AlignNet: Unsupervised Entity AlignmentPreprint
Creswell, A., Nikiforou, K., Vinyals, O., Saraiva, A., Kabra, R., Matthey, L., Burgess, C., Reynolds, M., Tanburn, R., Garnelo, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08973 · Cited by 9
Curriculum learning-driven PIELMs for fluid flow simulations
Dwivedi, V., Sixou, B., & Sigovan, M. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130924 · Cited by 8
Deep Reinforcement Learning for Adaptive Exploration of Unknown Environments
Peake, A., McCalmon, J., Zhang, Y., Myers, D., Alqahtani, S., & Pauca, P. (2021) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas51884.2021.9476756 · Cited by 8
Karkus, P., Angelova, A., Vanhoucke, V., & Jonschkowski, R. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197452 · Cited by 8
Multi-Goal Audio-Visual Navigation Using Sound Direction Map
Kondoh, H., & Kanezaki, A. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341819 · Cited by 7
Chen, Y., Zhang, Y., Wang, H., Feng, N., Yang, L., & Huang, Z. (2023) · IEEE Transactions on Electromagnetic Compatibility · doi:10.1109/temc.2023.3273724 · Cited by 7
Memory Augmented Deep Generative models for Forecasting the Next Shot Location in Tennis
Fernando, T., Denman, S., Sridharan, S., & Fookes, C. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2911507 · Cited by 36
A survey of benchmarks for reinforcement learning algorithms
Stapelberg, B., & Malan, K. M. (2020) · South African Computer Journal · doi:10.18489/sacj.v32i2.746 · Cited by 9
Learning to Navigate Efficiently and Precisely in Real Environments
Bono, G., Poirier, H., Antsfeld, L., Monaci, G., Chidlovskii, B., & Wolf, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01689 · Cited by 9
Coupling Vision and Proprioception for Navigation of Legged Robots
Fu, Z., Kumar, A., Agarwal, A., Qi, H., Malik, J., & Pathak, D. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00206 · Cited by 7
Gomes, G. F., Vidal, C. A., Cavalcante-Neto, J. B., & Nogueira, Y. L. B. (2021) · Brazilian Symposium on Computer Games and Digital Entertainment (SBGames) · doi:10.1109/sbgames54170.2021.00030 · Cited by 6
Multi-Object Navigation in real environments using hybrid policies
Sadek, A., Bono, G., Chidlovskii, B., Baskurt, A. M., & Wolf, C. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161030 · Cited by 6
Modality-Agnostic Topology Aware Localization
Zanjani, F. G., Karmanov, I., Ackermann, H., Dijkman, D., Merlin, S., Welling, M., & Porikli, F. (2021) · neural information processing systems · Cited by 5
Coupling Vision and Proprioception for Navigation of Legged Robots
Fu, Z., Kumar, A., Agarwal, A., Qi, H., Malik, J., & Pathak, D. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00508 · Cited by 5
Towards real-world navigation with deep differentiable planners
Ishida, S., & Henriques, J. F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01681 · Cited by 5
Mapping High-level Semantic Regions in Indoor Environments without Object Recognition
Bigazzi, R., Baraldi, L., Kousik, S., Cucchiara, R., & Pavone, M. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610897 · Cited by 5
Where to Look Next: Unsupervised Active Visual Exploration on 360° InputPreprint
Seifi, S., & Tuytelaars, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.10304 · Cited by 5
Environment Predictive Coding for Embodied AgentsPreprint
Ramakrishnan, S. K., Nagarajan, T., Al-Halah, Z., & Grauman, K. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.02337 · Cited by 10
Irshad, M. Z., Mithun, N. C., Seymour, Z., Chiu, H.-P., Samarasekera, S., & Kumar, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.11945 · Cited by 5
Learning Sample-Efficient Target Reaching for Mobile Robots
Khan, A., Kumar, V., & Ribeiro, A. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594168 · Cited by 5
Zhang, M., Ma, K. T., Yen, S., Lim, J., Zhao, Q., & Feng, J. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593435 · Cited by 4
CSLM: Convertible Short-Term and Long-Term Memory in Differential Neural Computers
Xiang, S., & Tang, B. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3016632 · Cited by 4
Incremental Scene SynthesisPreprint
Planche, B., Rong, X., Wu, Z., Karanam, S., Harald Kosch, A., Tian, Y., Ernst, J., & Hutter, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12297 · Cited by 4
Scene-Intuitive Agent for Remote Embodied Visual GroundingPreprint
Lin, X., Li, G., & Yu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.12944 · Cited by 4
R2D2: Remembering, Replaying and Dynamic Decision Making with a Reflective Agentic Memory
Huang, T., Basu, K., Abdelaziz, I., Kapanipathi, P., May, J., & Chen, M. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1464 · Cited by 4
“The Remember paradigm aims to build a replay buffer from O all , allowing the agent to store and revisit past observations and experiences (Blun-dell et al., 2016; Schaul et al., 2016; Parisotto and Salakhutdinov, 2018; Savinov et al., 2018).”
SCALE: Self-Correcting Visual Navigation for Mobile Robots via Anti-Novelty Estimation
Chen, C., Liu, Y., Zhuang, Y., Mao, S., Xue, K., & Zhou, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610847 · Cited by 3
Fast Counterfactual Inference for History-Based Reinforcement Learning
Gao, H., Zhang, T., Yang, Z., Guo, Y., Ren, J., Guo, S., & Chen, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25924 · Cited by 3
Zhao, Y., Moerland, T. M., Preuß, M., & Plaat, A. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333131 · Cited by 4
RSMPNet: Relationship Guided Semantic Map Prediction
Sun, J., Wu, J., Ji, Z., & Lai, Y. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00037 · Cited by 3
Bi, T., & D’Andrea, R. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610577 · Cited by 5
Working Memory Augmentation for Improved Learning in Neural Adaptive Control
Muthirayan, D. R. P., & Khargonekar, P. P. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9029549 · Cited by 3
Review, Analysis and Design of a Comprehensive Deep Reinforcement Learning FrameworkPreprint
Nguyen, N. D., Nguyen, T. T., Nguyen, V., Creighton, D., & Nahavandi, S. (2020) · arXiv (Cornell University) · doi:10.13140/rg.2.2.16789.06883 · Cited by 7
MaAST: Map Attention with Semantic Transformersfor Efficient Visual NavigationPreprint
Seymour, Z., Thopalli, K., Mithun, N. C., Chiu, H.-P., Samarasekera, S., & Kumar, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11374 · Cited by 3
Memory-based Exploration-value Evaluation Model for Visual Navigation
Feng, Y., Xu, L., Li, M., Jin, R., Huang, D., Yang, S., & Yang, W. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160665 · Cited by 2
Enhancing Autonomous Driving With Spatial Memory and Attention in Reinforcement Learning
Gerasyov, M., Savchenko, A. V., & Makarov, I. (2024) · IEEE Access · doi:10.1109/access.2024.3486602 · Cited by 2
Cognitive Robotics and Adaptive Behaviors
Habib, M. K. (2022) · IntechOpen eBooks · doi:10.5772/intechopen.95128 · Cited by 3
Learning Landmark-Oriented Subgoals for Visual Navigation Using Trajectory Memory
Qu, J., Miwa, S., & Domae, Y. (2022) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci51031.2022.10022285 · Cited by 2
Learning to generate classifiersPreprint
Guttenberg, N., & Ryota Kanai, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.11373 · Cited by 2
Continual and Multi-task Reinforcement Learning With Shared Episodic MemoryPreprint
Sorokin, A. Y., & Burtsev, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.02662 · Cited by 6
Beyond Tabula-Rasa: a Modular Reinforcement Learning Approach for Physically Embedded 3D SokobanPreprint
Karkus, P., Mirza, M., Guez, A., Jaegle, A., Lillicrap, T., Buesing, L., Heess, N., & Weber, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01298 · Cited by 6
End-to-End Egospheric Spatial MemoryPreprint
Lenton, D., James, S., Clark, R., & Davison, A. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07764 · Cited by 3
Mobile Robots through Task-Based Human Instructions using Incremental Curriculum Learning
Muttaqien, M. A., Yorozu, A., & Ohya, A. (2024) · IEEE Conference on Cybernetics and Intelligent Systems · doi:10.1109/cis-ram61939.2024.10673231 · Cited by 1
Causal dreamer for partially observable model-based reinforcement learning
Gao, H., Xu, T., Zhang, T., Guo, Y., Zhao, C., Ren, J., Jiang, Y., Guo, S., & Chen, F. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131012 · Cited by 2
Localising In Complex Scenes Using Balanced Adversarial Adaptation
Avraham, G., Zuo, Y., & Drummond, T. W. (2020) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00116 · Cited by 1
Sable, S., & Ikar, M. (2024) · Information systems engineering and management · doi:10.1007/978-3-031-68256-8_2 · Cited by 1
Memory Augmented Neural Network Adaptive Controller for Strict Feedback Nonlinear SystemsPreprint
Muthirayan, D. R. P., & Khargonekar, P. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05421 · Cited by 1
Pedestrian Trajectory Prediction with Structured Memory HierarchiesPreprint
Fernando, T., Denman, S., Sridharan, S., & Fookes, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.08381 · Cited by 1
EgoMap: Projective mapping and structured egocentric memory for Deep RLPreprint
Beeching, E., Wolf, C., Dibangoye, J., & Simonin, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02286 · Cited by 1
A short note on the decision tree based neural turing machinePreprint
Chen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14753 · Cited by 1
Variational State-Space Models for Localisation and Dense 3D Mapping in 6 DoFPreprint
Mirchev, A., Kayalibay, B., van der Smagt, P., & Bayer, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10178 · Cited by 1
Graph Convolutional Memory for Deep Reinforcement Learning.Preprint
Morad, S., Liwicki, S., & Prorok, A. (2021) · arXiv (Cornell University) · Cited by 1
Self-Learning AI for Adaptive Humanoid Robotics: Towards Generalized AutonomyPreprint
Khemani, K. (2025) · doi:10.22541/au.174802371.13279686/v1 · Cited by 1
Deep Reinforcement Learning for Autonomous Model-Free Navigation with Partial Observability
Tapia, D., Parras, J., & Zazo, S. (2019) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2019.8902933
Celotti, L., Brodeur, S., & Rouat, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.02002
On Building Generalizable Learning Agents
Wu, Y. (2019) · eScholarship (California Digital Library)
Learning Synthetic to Real Transfer for Localization and Navigational TasksPreprint
Pietrantoni, M., Chidlovskii, B., & Silander, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.10274
Improving Image Similarity Learning by Adding External Memory
Gao, X., Mu, T., Goulermas, J. Y., Song, J., & Wang, M. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3047104
Hard Attention Control By Mutual Information MaximizationPreprint
Sahni, H., & Isbell, C. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06371
Graph Convolutional Memory using Topological PriorsPreprint
Morad, S., Liwicki, S., Kortvelesy, R., Mecca, R., & Prorok, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14117 · Cited by 1
Scalable Spatial Memory for Scene Rendering and Navigation
Chen, W., Chen, C., Chiu, W.-C., & Hu, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25110
INCORPORATING ATTENTION SCORE TO IMPROVE FORESIGHT PRUNING ON TRANSFORMER MODELS
Melnychenko, A. V., & Zdor, K. (2023) · Computer Science and Applied Mathematics · doi:10.26661/2786-6254-2023-2-03 · Cited by 1
SDMA-Net: Swin Transformer-Based Dynamic Memory-Attention Network for Endoscopic Navigation
Zhang, R., Tian, Q., Chu, J., & Lu, W. D. (2025) · IEEE Access · doi:10.1109/access.2025.3576739
Metadata
- Authors
- Parisotto, E., & Salakhutdinov, R.
- Affiliations
- University of Toronto (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1702.08360
- OpenAlex
- W2594903727
- Cited by
- 178
- References
- 22
- Citations by year
- 2025: 4 · 2024: 12 · 2023: 16 · 2022: 18 · 2021: 32 · 2020: 37 · 2019: 34 · 2018: 18 · 2017: 6
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- neural maps, structured memory, memory networks, deep reinforcement learning, partial observability, long-term memory, 3D environments, maze navigation, memory addressing, generalization to unseen environments
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
