The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Rethinking Eliminative Connectionism
Open accessAbstract
Humans routinely generalize universal relationships to unfamiliar instances. If we are told "if glork then frum," and "glork," we can infer "frum"; any name that serves as the subject of a sentence can appear as the object of a sentence. These universals are pervasive in language and reasoning. One account of how they are generalized holds that humans possess mechanisms that manipulate symbols and variables; an alternative account holds that symbol-manipulation can be eliminated from scientific theories in favor of descriptions couched in terms of networks of interconnected nodes. Can these "eliminative" connectionist models offer a genuine alternative? This article shows that eliminative connectionist models cannot account for how we extend universals to arbitrary items. The argument runs as follows. First, if these models, as currently conceived, were to extend universals to arbitrary instances, they would have to generalize outside the space of training examples. Next, it is shown that the class of eliminative connectionist models that is currently popular cannot learn to extend universals outside the training space. This limitation might be avoided through the use of an architecture that implements symbol manipulation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Self-Organization and Associative Memory
Kohonen, T. (1989) · Springer Series in Information Sciences · doi:10.1007/978-3-642-88163-3 · Cited by 8,740
Anderson, J. R. (2013) · doi:10.4324/9781315799438 · Cited by 6,761
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · Psychology of Learning and Motivation · doi:10.1016/c2009-0-62209-1 · Cited by 5,994
(1983) · Cited by 5,041
Fodor, J. A. (1975) · Medical Entomology and Zoology · Cited by 4,588
Madden, E. H., Goodman, N., & Melsen, A. G. V. (1955) · Philosophy and Phenomenological Research · doi:10.2307/2103789 · Cited by 4,377
(1991) · Choice Reviews Online · doi:10.5860/choice.28-5376 · Cited by 4,207
Connectionism and cognitive architecture: A critical analysis
Fodor, J. A., & Pylyshyn, Z. W. (1988) · Cognition · doi:10.1016/0010-0277(88)90031-5 · Cited by 4,022
A distributed, developmental model of word recognition and naming.
Seidenberg, M. S., & McClelland, J. L. (1989) · Psychological Review · doi:10.1037/0033-295x.96.4.523 · Cited by 3,909
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“Simulations by Geman, Bienstock, and Doursat (1992), Pavel, Gluck, and Henkle (1988), Pazzani and Dyer (1987), Prasada and Pinker (1993), De- Losh, Busemeyer, and McDaniel (1997), and Busemeyer, McDaniel, and Byun (1997) are consistent with the suggestion of Denker and others that eliminative…”
ResultRumelhart, D. E., & McClelland, J. L. (1986) · The MIT Press eBooks · Cited by 2,909
Advances in Neural Information Processing Systems 37
(2024) · doi:10.52202/079017 · Cited by 2,791
Understanding normal and impaired word reading: Computational principles in quasi-regular domains.
Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996) · Psychological Review · doi:10.1037/0033-295x.103.1.56 · Cited by 2,698
On the proper treatment of connectionism
Smolensky, P. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00052432 · Cited by 2,441
The Cascade-Correlation learning architecture
Fahlman, S. E., & Lebiere, C. J. (2018) · doi:10.1184/r1/6610403 · Cited by 2,372
Computer science as empirical inquiry: symbols and search
Newell, A., & Simon, H. A. (1976) · Communications of the ACM · doi:10.1145/360018.360022 · Cited by 2,350
Mullin, A. A., & Rosenblatt, F. (1963) · The American Mathematical Monthly · doi:10.2307/2312103 · Cited by 2,209
Boer, S. E., & Jackendoff, R. (1985) · The Philosophical Review · doi:10.2307/2184719 · Cited by 2,170
Handbook of mathematical psychology: I.
Luce, R. D., Bush, R. R., & Galanter, E. (1963) · Wiley eBooks · Cited by 1,999
Learning and development in neural networks: the importance of starting small
Elman, J. L. (1993) · Cognition · doi:10.1016/0010-0277(93)90058-4 · Cited by 1,988 · cited 1×
“A third example is the simple recurrent network (henceforth, SRN) account of learning aspects of language by Elman (1990, 1991, 1993).”
BackgroundHandbook Of Mathematical Psychology
Galanter, & Eugène (1963) · Cited by 1,956
Pinker, S., & Prince, A. (1988) · Cognition · doi:10.1016/0010-0277(88)90032-7 · Cited by 1,620
Parallel Networks that Learn to Pronounce English Text
B, T. J. S. A. (1987) · Cited by 1,514
Connectionist models and their properties
FELDMAN, J., & BALLARD, D. (1982) · Cognitive Science · doi:10.1016/s0364-0213(82)80001-3 · Cited by 1,474
Newell, A. (1980) · Cognitive Science · doi:10.1207/s15516709cog0402_2 · Cited by 1,458
On Learning the Past Tenses of English Verbs
(1986) · Parallel Distributed Processing · doi:10.7551/mitpress/5236.003.0008 · Cited by 1,458
Distributed representations, simple recurrent networks, and grammatical structure
Elman, J. L. (1991) · Machine Learning · doi:10.1007/bf00114844 · Cited by 1,354
Rule Learning by Seven-Month-Old Infants
Marcus, G. F., Vijayan, S., Bandi Rao, S., & Vishton, P. M. (1999) · Science · doi:10.1126/science.283.5398.77 · Cited by 1,244
Self-citationMcClelland, J. L., & Rumelhart, D. E. (1986) · The MIT Press eBooks · Cited by 1,227
On computation and cognition: Toward a foundation of cognitive science
Pylyshyn, Z. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90062-3 · Cited by 1,132
The Correlation Theory of Brain Function
von der Malsburg, C. (1994) · Physics of Neural Networks · doi:10.1007/978-1-4612-4320-5_2 · Cited by 1,089
Pinker, S. (1991) · Science · doi:10.1126/science.1857983 · Cited by 1,056
Hinton, G. E. (2018) · KiltHub Repository · doi:10.1184/r1/6604925 · Cited by 1,025
Dynamic binding in a neural network for shape recognition.
Hummel, J. E., & Biederman, I. (1992) · Psychological Review · doi:10.1037/0033-295x.99.3.480 · Cited by 924
Distributed representations of structure: A theory of analogical access and mapping.
Hummel, J. E., & Holyoak, K. J. (1997) · Psychological Review · doi:10.1037/0033-295x.104.3.427 · Cited by 910
(1963) · Cited by 855
Recursive distributed representations
Pollack, J. B. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90005-k · Cited by 852
Learning distributed representations of concepts.
Hinton, G. E. (1989) · eScholarship (California Digital Library) · Cited by 827
German Inflection: The Exception That Proves the Rule
Marcus, G. F., Brinkmann, U., Clahsen, H., Wiese, R., & Pinker, S. (1995) · Cognitive Psychology · doi:10.1006/cogp.1995.1015 · Cited by 719
Self-citationThe Algebraic Mind: Integrating Connectionism and Cognitive Science
Marcus, G. F. (2001) · Cited by 636
Self-citationShastri, L., & Ajjanagadde, V. (1993) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00030910 · Cited by 634
Freeman, W. (1989) · eScholarship (California Digital Library) · Cited by 573
Generalisation of regular and irregular morphological patterns
Prasada, S., & Pinker, S. (1993) · Language and Cognitive Processes · doi:10.1080/01690969308406948 · Cited by 534
Jacobs, R. A., Jordan, M. I., & Barto, A. G. (1991) · Cognitive Science · doi:10.1207/s15516709cog1502_2 · Cited by 490
Psychological and biological models
McClelland, J. L., & Rumelhart, D. E. (1986) · Medical Entomology and Zoology · Cited by 416
Parallel Distributed Processing: Implications for Psychology and Neurobiology
Wolters, G. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90131-s · Cited by 415
The Appeal of Parallel Distributed Processing
(2002) · Foundations of Cognitive Psychology · doi:10.7551/mitpress/3080.003.0007 · Cited by 415
Athanasopoulos, P., & Bylund, E. (2024) · The Routledge Handbook of Second Language Acquisition, Morphosyntax, and Semantics · doi:10.4324/9781003412373-45 · Cited by 381
Trading spaces: Computation, representation, and the limits of uninformed learning
Clark, A., & Thornton, C. (1997) · Behavioral and Brain Sciences · doi:10.1017/s0140525x97000022 · Cited by 297
On the particulate principle of self-diversifying systems
ABLER, W. (1989) · Journal of Social and Biological Systems · doi:10.1016/0140-1750(89)90015-8 · Cited by 276
Lachter, J., & Bever, T. G. (1988) · Cognition · doi:10.1016/0010-0277(88)90033-9 · Cited by 251
Large Automatic Learning, Rule Extraction, and Generalization.
Denker, J. S., Schwartz, D., Wittner, B. S., Solla, S. A., Howard, R. E., Jackel, L. D., & Hopfield, J. J. (1987) · Complex Systems · Cited by 248
The case for rules in reasoning
Smith, E. (1992) · Cognitive Science · doi:10.1016/0364-0213(92)90016-n · Cited by 246
Parallel Distributed Processing: Implications for Psychology and Neurobiology
Morris, R. (1990) · Oxford University Press eBooks · Cited by 242
A Distributed Model of Human Learning and Memory
(1986) · Parallel Distributed Processing · doi:10.7551/mitpress/5236.003.0007 · Cited by 241
Developing Cognitive Competence
(2015) · Psychology Press eBooks · doi:10.4324/9781315785271 · Cited by 234
Connectionism and the Philosophy of Mind
(1991) · Studies in Cognitive Systems · doi:10.1007/978-94-011-3524-5 · Cited by 223
Extrapolation: The sine qua non for abstraction in function learning.
DeLosh, E. L., Busemeyer, J. R., & McDaniel, M. A. (1997) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.23.4.968 · Cited by 210
The Perception of Multiple Objects: A Connectionist Approach
Mozer, M. C. (1991) · Medical Entomology and Zoology · Cited by 208
Generalization to Local Remappings of the Visuomotor Coordinate Transformation
Ghahramani, Z., Wolpert, D. M., & Jordan, M. I. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-21-07085.1996 · Cited by 204
Syntactic Transformations on Distributed Representations
Chalmers, D. J. (1992) · Connectionist Natural Language Processing · doi:10.1007/978-94-011-2624-3_3 · Cited by 184
Networks and Theories: The Place of Connectionism in Cognitive Science
McCloskey, M. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00173.x · Cited by 183
Pattern Recognition by Humans and Machines
(1986) · Elsevier eBooks · doi:10.1016/c2013-0-07579-2 · Cited by 173
Parallel distributed processing : implications for cognition and development
McClelland, J. L., & Project., A. I. A. P. (2018) · doi:10.1184/r1/6617408 · Cited by 160
Crick, F. H. C. (1988) · Cited by 146
Certain Aspects of the Anatomy and Physiology of the Cerebral Cortex
(1987) · The MIT Press eBooks · doi:10.7551/mitpress/5237.003.0011 · Cited by 144
Default generalisation in connectionist networks
Hare, M. L., Elman, J. L., & Daugherty, K. G. (1995) · Language and Cognitive Processes · doi:10.1080/01690969508407115 · Cited by 140
Syntactic Transformations on Distributed Representations
Chalmers, D. J. (1990) · Connection Science · doi:10.1080/09540099008915662 · Cited by 139
Systematicity in Connectionist Language Learning
Hadley, R. F. (1994) · Mind & Language · doi:10.1111/j.1468-0017.1994.tb00225.x · Cited by 132
Computational Architectures Integrating Neural And Symbolic Processes
Sun, R., & Bookman, L. A. (1994) · Springer eBooks · doi:10.1007/b102608 · Cited by 116
Connectionism: Debates on Psychological Explanation
Macdonald, C., & Macdonald, G. (1995) · Research Explorer (The University of Manchester) · Cited by 109
Twenty-Three-Month-Old Children Have a Grammatical Category of Noun.
Tomasello, M., & Olguin, R. (1993) · Cognitive Development · doi:10.1016/s0885-2014(05)80004-8 · Cited by 102
On Variable Binding in Connectionist Networks
Sun, R. (1992) · Connection Science · doi:10.1080/09540099208946607 · Cited by 83
On Being Systematically Connectionist
Niklasson, L., & van Gelder, T. (1994) · Mind & Language · doi:10.1111/j.1468-0017.1994.tb00227.x · Cited by 78
Connectionist Symbol Processing
(1991) · The MIT Press eBooks · doi:10.7551/mitpress/2102.001.0001 · Cited by 58
Dominey, P. F. (1997) · Brain and Language · doi:10.1006/brln.1997.1813 · Cited by 39
Connectionism and compositional semantics
Touretzky, D. S. (2018) · doi:10.1184/r1/6604406 · Cited by 26
Distributing structure over time
Hummel, J. E., & Holyoak, K. J. (1993) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00031083 · Cited by 24
Connectionist Natural Language Processing: A Status Report
Dyer, M. G. (2007) · Springer eBooks · doi:10.1007/978-0-585-29599-2_12 · Cited by 23
Pazzani, M. J., & Dyer, M. G. (1987) · Cited by 15
Must we solve the binding problem in neural hardware?
Garson, J. W. (1993) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00031022 · Cited by 7
Parallel reasoning in structured connectionist networks: Signatures versus temporal synchrony
Lange, T. E., & Dyer, M. G. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042953 · Cited by 1
Cited by
Foundations of Language: Brain, Meaning, Grammar, Evolution
Jackendoff, R. (2002) · doi:10.1093/acprof:oso/9780198270126.001.0001 · Cited by 3,244
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557
Chang, F., Dell, G. S., & Bock, K. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.234 · Cited by 984
Metadata
- Authors
- Marcus, G. F.
- Venue
- Cognitive Psychology
- Publisher
- Elsevier BV
- Published
- 1998-12
- Volume
- 37
- Issue
- 3
- Pages
- 243-282
- ISSN
- 0010-0285 (ISSN-L)
- OpenAlex
- W1966678693
- Cited by
- 348
- References
- 86
- FWCI
- 25.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.