PreprintCited by 1,058Neural Networks and ApplicationsNeural Networks and Reservoir ComputingAdvanced Memory and Neural Computing

Neural Turing Machines

Open access
Graves, Alex, Wayne, Greg, Danihelka, Ivo·2014·arXiv

Abstract

We extend the capabilities of neural networks by coupling them to external memory resources, which they can interact with by attentional processes. The combined system is analogous to a Turing Machine or Von Neumann architecture but is differentiable end-to-end, allowing it to be efficiently trained with gradient descent. Preliminary results demonstrate that Neural Turing Machines can infer simple algorithms such as copying, sorting, and associative recall from input and output examples.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1410.5401

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Cosine attention removes magnitude information, which could be meaningful in transformer embeddings.

    “The Cosine Attention (Graves et al., 2014), using cosine similarity as the attention score between 𝑞 and 𝑘 , removes the magnitude info, which could be meaningful in transformer embeddings.”

    From Can "consciousness" be observed from large language model (LLM) internal states? Dissecting LLM representations obtained from Theory of Mind test with Integrated Information Theory and Span Representation analysis (2025) · cites this paper as Graves et al., 2014

    Section 3.3.1 (p. 8) says the Neural Turing Machine uses cosine similarity to compare key and memory vectors for content-based attention. That supports the cited mechanism, but our copy does not discuss magnitude information or whether it matters in transformer embeddings. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Memory-augmented neural networks (MemN2N, NTM, DNC) focus on algorithmic tasks rather than long-term personalization.

    “MemN2N [20], NTM [21], and DNC [22] introduced differentiable external memory for neural networks. However, these focus on algorithmic tasks rather than long-term personalization.”
  • Earlier work introduced end-to-end trainable memory layers and incorporated them into neural computational systems.

    “Earlier works introduced end-to-end trainable memory layers (Sukhbaatar et al., 2015) and incorporated them as part of neural computational systems (Graves et al., 2014).”

    From Memory Layers at Scale (2024) · cites this paper as Graves et al., 2014

  • The survey by Savya et al. provides a broader analysis of neural network models, including Transformers and Neural Turing Machines, and examines the implications of human memory theories, such as the Atkinson-Shiffrin Model, for AI memory.

    “The survey by Savya et al. [54] provides a broader analysis of neural network models, including Transformers [3] and Neural Turing Machines [55], and examines the implications of human memory theories, such as the Atkinson-Shiffrin Model [6], for AI memory.”

    From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [55]

  • NTMs combined end-to-end differentiable controllers with an external memory matrix, enabling read and write operations via differentiable attention mechanisms.

    “Graves et al. (2014) introduced Neural Turing Machines (NTMs), which combined end-to-end differentiable controllers with an external memory matrix, enabling read and write operations via differentiable attention mechanisms.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 33

  1. Baddeley, A., Eysenck, M., and Anderson, M. (2009). Memory . Psychology Press.
  2. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. abs/1409.0473. · arXiv
  3. Barrouillet, P., Bernardin, S., and Camos, V. (2004). Time constraints and resource sharing in adults' working memory spans. Journal of Experimental Psychology: General , 133(1):83.
  4. Chomsky, N. (1956). Three models for the description of language. Information Theory, IEEE Transactions on , 2(3):113-124.
  5. Das, S., Giles, C. L., and Sun, G.-Z. (1992). Learning context-free grammars: Capabilities and limitations of a recurrent neural network with an external stack memory. In Proceedings of The Fourteenth Annual Conference of Cognitive Science Society. Indiana University .
  6. Dayan, P. (2008). Simple substrates for complex cognition. Frontiers in neuroscience , 2(2):255.
  7. Eliasmith, C. (2013). How to build a brain: A neural architecture for biological cognition . Oxford University Press.
  8. Fitch, W., Hauser, M. D., and Chomsky, N. (2005). The evolution of the language faculty: clarifications and implications. Cognition , 97(2):179-210.
  9. Frasconi, P., Gori, M., and Sperduti, A. (1998). A general framework for adaptive processing of data structures. Neural Networks, IEEE Transactions on , 9(5):768-786.
  10. Gallistel, C. R. and King, A. P. (2009). Memory and the computational brain: Why cognitive science will transform neuroscience , volume 3. John Wiley & Sons.
  11. Goldman-Rakic, P. S. (1995). Cellular basis of working memory. Neuron , 14(3):477-485.
  12. Graves, A. (2013). Generating sequences with recurrent neural networks. arXiv preprint arXiv:1308.0850 . · arXiv
  13. Graves, A. and Jaitly, N. (2014). Towards end-to-end speech recognition with recurrent neural networks. In Proceedings of the 31st International Conference on Machine Learning (ICML-14) , pages 1764-1772.
  14. Graves, A., Mohamed, A., and Hinton, G. (2013). Speech recognition with deep recurrent neural networks. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on , pages 6645-6649. IEEE.
  15. Hadley, R. F. (2009). The problem of rapid variable creation. Neural computation , 21(2):510-532.
  16. Hinton, G. E. (1986). Learning distributed representations of concepts. In Proceedings of the eighth annual conference of the cognitive science society , volume 1, page 12. Amherst, MA.
  17. Hochreiter, S., Younger, A. S., and Conwell, P. R. (2001b). Learning to learn using gradient descent. In Artificial Neural Networks?ICANN 2001 , pages 87-94. Springer.
  18. Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences , 79(8):25542558.
  19. Jackendoff, R. and Pinker, S. (2005). The nature of the language faculty and its implications for evolution of language (reply to fitch, hauser, and chomsky). Cognition , 97(2):211225.
  20. Kanerva, P. (2009). Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors. Cognitive Computation , 1(2):139-159.
  21. Marcus, G. F. (2003). The algebraic mind: Integrating connectionism and cognitive science . MIT press.
  22. Miller, G. A. (1956). The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological review , 63(2):81.
  23. Miller, G. A. (2003). The cognitive revolution: a historical perspective. Trends in cognitive sciences , 7(3):141-144.
  24. Murphy, K. P. (2012). Machine learning: a probabilistic perspective . MIT press.
  25. Pollack, J. B. (1990). Recursive distributed representations. Artificial Intelligence , 46(1):77-105.
  26. Rumelhart, D. E., McClelland, J. L., Group, P. R., et al. (1986). Parallel distributed processing , volume 1. MIT press.
  27. Seung, H. S. (1998). Continuous attractors and oculomotor control. Neural Networks , 11(7):1253-1258.
  28. Siegelmann, H. T. and Sontag, E. D. (1995). On the computational power of neural nets. Journal of computer and system sciences , 50(1):132-150.
  29. Socher, R., Huval, B., Manning, C. D., and Ng, A. Y. (2012). Semantic compositionality through recursive matrix-vector spaces. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning , pages 1201-1211. Association for Computational Linguistics.
  30. Sutskever, I., Martens, J., and Hinton, G. E. (2011). Generating text with recurrent neural networks. In Proceedings of the 28th International Conference on Machine Learning (ICML-11) , pages 1017-1024.
  31. Sutskever, I., Vinyals, O., and Le, Q. V . (2014). Sequence to sequence learning with neural networks. arXiv preprint arXiv:1409.3215 . · arXiv
  32. Touretzky, D. S. (1990). Boltzcons: Dynamic symbol structures in a connectionist network. Artificial Intelligence , 46(1):5-46.
  33. Wang, X.-J. (1999). Synaptic basis of cortical persistent activity: the importance of nmda receptors to working memory. The Journal of Neuroscience , 19(21):9587-9603.

Cited by

Sorted by citations

Authors
Graves, A., Wayne, G., & Danihelka, I.
Affiliations
Google (United States) (US)
Venue
arXiv
Publisher
arXiv
Published
2014
ISSN
2331-8422 (ISSN-L)
OpenAlex
W2167839676
Cited by
1,058
References
5
Citations by year
2026: 12 · 2025: 45 · 2024: 77 · 2023: 119 · 2022: 133 · 2021: 144 · 2020: 133 · 2019: 119 · 2018: 127 · 2017: 93 · 2016: 30 · 2015: 25 · 2014: 1
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
Keywords
neural Turing machines, external memory, attention, end-to-end learning, algorithm learning, copying, sorting, associative recall, artificial neural networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review