Distributed representations

Open access

Geoffrey E. Hinton·2018·KiltHub Repository

DOI 10.1184/r1/6604925

Open this paper in CoChat — free account

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

OpenAlex · 10.1184/r1/6604925

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Finding structure in time
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
Connectionism and cognitive architecture: A critical analysis
Fodor, J. A., & Pylyshyn, Z. W. (1988) · Cognition · doi:10.1016/0010-0277(88)90031-5 · Cited by 4,022
A cognitive-affective system theory of personality: Reconceptualizing situations, dispositions, dynamics, and invariance in personality structure
Mischel, W., & Shoda, Y. (1995) · Psychological Review · doi:10.1037/0033-295x.102.2.246 · Cited by 3,889
A distributed, developmental model of word recognition and naming.
Seidenberg, M. S., & McClelland, J. L. (1989) · Psychological Review · doi:10.1037/0033-295x.96.4.523 · Cited by 3,909
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Understanding normal and impaired word reading: Computational principles in quasi-regular domains.
Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996) · Psychological Review · doi:10.1037/0033-295x.103.1.56 · Cited by 2,698
Catastrophic forgetting in connectionist networks
French, R. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01294-2 · Cited by 2,311
The lexical nature of syntactic ambiguity resolution
MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.676 · Cited by 2,259
The reviewing of object files: Object-specific integration of information
Kahneman, D., Treisman, A., & Gibbs, B. J. (1992) · Cognitive Psychology · doi:10.1016/0010-0285(92)90007-o · Cited by 2,218
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564
Distributed representations, simple recurrent networks, and grammatical structure
Elman, J. L. (1991) · Machine Learning · doi:10.1007/bf00114844 · Cited by 1,354
Darwin's mistake: Explaining the discontinuity between human and nonhuman minds
Penn, D. C., Holyoak, K. J., & Povinelli, D. J. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x08003543 · Cited by 1,174
Tensor product variable binding and the representation of symbolic structures in connectionist systems
Smolensky, P. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90007-m · Cited by 959
Interpreting Neuronal Population Activity by Reconstruction: Unified Framework With Application to Hippocampal Place Cells
Zhang, K., Ginzburg, I., McNaughton, B. L., & Sejnowski, T. J. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.79.2.1017 · Cited by 741
What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated
Kumaran, D., Hassabis, D., & McClelland, J. L. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.05.004 · Cited by 759
PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning
Wang, Y., Wu, H., Zhang, J., Gao, Z., Wang, J., Yu, P. S., & Long, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3165153 · Cited by 677
Holographic reduced representations
Plate, T. A. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.377968 · Cited by 657
Temporal binding, binocular rivalry, and consciousness
Engel, A. K., Fries, P., König, P., Brecht, M., & Singer, W. (1999) · Consciousness and Cognition · doi:10.1006/ccog.1999.0389 · Cited by 379
Direct Fit to Nature: An Evolutionary Perspective on Biological and Artificial Neural Networks
Hasson, U., Nastase, S. A., & Goldstein, A. (2020) · Neuron · doi:10.1016/j.neuron.2019.12.002 · Cited by 387
Learning to Segment Speech Using Multiple Cues: A Connectionist Model
Christiansen, M. H., Allen, J., & Seidenberg, M. S. (1998) · Language and Cognitive Processes · doi:10.1080/016909698386528 · Cited by 356
The influence of context boundaries on memory for the sequential order of events
DuBrow, S., & Davachi, L. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0034024 · Cited by 289
Learning and applying contextual constraints in sentence comprehension
St. John, M. F., & McClelland, J. L. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90008-n · Cited by 322
Inductive biases for deep learning of higher-level cognition
Goyal, A., & Bengio, Y. (2022) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2021.0068 · Cited by 300
Complementary learning systems
O’Reilly, R. C., Bhattacharyya, R., Howard, M. D., & Ketz, N. (2014) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01214.x · Cited by 259
A distributed representation of internal time
Howard, M. W., Shankar, K. H., Aue, W. R., & Criss, A. H. (2015) · Psychological Review · doi:10.1037/a0037840 · Cited by 133
Hierarchical coding for sequential task events in the monkey prefrontal cortex
Sigala, N., Kusunoki, M., Nimmo-Smith, I., Gaffan, D., & Duncan, J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802569105 · Cited by 140
Emergence in Cognitive Science
McClelland, J. L. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01116.x · Cited by 135
On the approximation capability of recurrent neural networks
Hammer, B. (2000) · Neurocomputing · doi:10.1016/s0925-2312(99)00174-5 · Cited by 132
Interactive Activation and Mutual Constraint Satisfaction in Perception and Cognition
McClelland, J. L., Mirman, D., Bolger, D. J., & Khaitan, P. (2014) · Cognitive Science · doi:10.1111/cogs.12146 · Cited by 122
A Survey of Machine Learning for Big Code and Naturalness
Allamanis, M., Barr, E. T., Devanbu, P., & Sutton, C. (2019) · ACM Computing Surveys · doi:10.1145/3212695 · Cited by 150
A Disentangling Invertible Interpretation Network for Explaining Latent Representations
Esser, P., Rombach, R., & Ommer, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00924 · Cited by 72
On the Binding Problem in Artificial Neural Networks
Greff, K., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv · doi:10.48550/arxiv.2012.05208 · Cited by 102
Some Bodies are Easier to Read: The Effect of Consistency and Regularity on Children's Reading
Laxon, V., Masterson, J., & Coltheart, V. (1991) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640749108400958 · Cited by 35
Deep Predictive Learning: A Comprehensive Model of Three Visual Streams
O'Reilly, R. C., Wyatte, D. R., & Rohrlich, J. (2017) · arXiv · doi:10.48550/arxiv.1709.04654 · Cited by 26
Judging the typicality of an instance: Should the category be accessed first?
Schul, Y., & Burnstein, E. (1990) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.58.6.964 · Cited by 15
Modeling a multidimensional model of memory performance in obsessive-compulsive disorder: A multilevel meta-analytic review.
Persson, S., Yates, A., Kessler, K., & Harkin, B. (2021) · Journal of Abnormal Psychology · doi:10.1037/abn0000660 · Cited by 9
Transient localist representations in critical branching networks
Rodny, J. J., Shea, T. M., & Kello, C. T. (2017) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2016.1242760 · Cited by 4

Authors: Hinton, G. E.
Venue: KiltHub Repository
Publisher: Carnegie Mellon University
Published: 2018-01-01
Pages: 77-109
DOI: 10.1184/r1/6604925
OpenAlex: W2912225506
Cited by: 1,025
References: 0
FWCI: 19.24
Type: journal article
Language: en
Open access: green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review