The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Parallel Distributed Processing at 25: Further Explorations in the Microstructure of Cognition
Abstract
This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing(PDP), a two‐volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
ASPECTS OF THE THEORY OF SYNTAX
Chomsky, N. (1964) · doi:10.21236/ad0616323 · Cited by 13,587
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Complex brain networks: graph theoretical analysis of structural and functional systems
Bullmore, E., & Sporns, O. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2575 · Cited by 11,820
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Fodor, J. A. (1983) · doi:10.7551/mitpress/4737.001.0001 · Cited by 7,734
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
Self-citationGreedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Research works printed but not linked: 186
- 10.1016/S0010-0277(03)00146-X · DOI · Paper page
- 10.1126/science.284.5416.875a · DOI
- Anderson J. R., 1975, Information processing and cognition: The loyola symposium, 295
- Anderson J. R., 1983, The architecture of cognition
- Anderson J. R., 1990, The adaptive character of thought
- 10.1037/0033-295X.84.5.413 · DOI · Paper page
- 10.1016/0959-4388(94)90138-4 · DOI
- 10.1037/0033-295X.97.3.432 · doi:10.1037/0033-295x.97.3.432 · Paper page
- 10.1111/cogs.12126 · DOI · Paper page
- 10.1037/0033-295X.111.2.395 · DOI · Paper page
- 10.4159/harvard.9780674732469 · DOI · Paper page
- 10.1111/j.2044‐8295.1990.tb02367.x · DOI · Paper page
- 10.1075/tsl.9 · DOI · Paper page
- 10.1353/lan.1982.0021 · doi:10.1353/lan.1982.0021 · Paper page
- 10.1016/0278‐2626(86)90061‐8 · DOI · Paper page
- Carey S., 1985, Conceptual change in childhood
- 10.1207/S15327647JCD0101N_3 · doi:10.1207/s15327647jcd0101n_3
- 10.1017/CBO9780511752902.008 · DOI · Paper page
- 10.1037/0033-295X.113.2.234 · DOI · Paper page
- 10.1111/cogs.12149 · DOI
- 10.1037/0096-3445.120.3.235 · DOI · Paper page
- Cohen J. D., 2004, Cognitive neuroscience of attention, 71
- 10.1037/0033-295X.97.3.332 · DOI · Paper page
- 10.1111/1467-9280.00178 · DOI
- 10.1037/0033-295X.108.1.204 · DOI · Paper page
- 10.1037/0033-295X.112.2.347 · DOI · Paper page
- 10.1016/j.cognition.2011.12.013 · DOI · Paper page
- 10.1038/11205 · DOI · Paper page
- 10.1162/089892998563798 · DOI · Paper page
- 10.1080/02643290701723948 · DOI
- Eliasmith C., 2004, Neural engineering: Computation, representation, and dynamics in neurobiological systems
- 10.1207/s15516709cog1402_1 · DOI · Paper page
- 10.1017/S0140525X0999094X · DOI · Paper page
- Farah M. J., 1990, Visual agnosia
- 10.1037/0096-3445.120.4.339 · DOI · Paper page
- 10.1207/s15516709cog0603_1 · doi:10.1207/s15516709cog0603_1 · Paper page
- 10.1037/a0017196 · DOI · Paper page
- 10.1016/0010-0277(78)90002-1 · DOI · Paper page
- 10.1037/a0022327 · DOI · Paper page
- 10.1037/a0025255 · DOI
- 10.1016/0010-0277(86)90034-X · DOI · Paper page
- Gelman R., 1998, Handbook of child psychology, Volume II: Cognition, perception and development, 575
- 10.1016/S1364‐6613(03)00080‐9 · DOI · Paper page
- 10.1037/0033-295X.105.2.251 · DOI · Paper page
- 10.1126/science.1094492 · DOI · Paper page
- Gough P. B., 1972, Language by eye and by ear
- 10.1093/cercor/bhp245 · DOI · Paper page
- Greenberg J., 1963, Universals of language, 73
- 10.1006/cogp.2000.0737 · DOI
- 10.1037/0033-295X.111.3.662 · DOI · Paper page
- 10.1126/science.1063736 · DOI · Paper page
- Hinton G. E., 1989, Parallel distributed processing: Implications for psychology and neurobiology, 46
- Hinton G. E., 1988, Neural Information Processing Systems, 358
- Hinton G. E., 1986, Parallel distributed processing, 282
- 10.1162/jocn.1992.4.4.323 · DOI
- 10.1073/pnas.96.13.7592 · DOI · Paper page
- Johnson S., 2001, Emergence: The connected lives of ants, brains, cities, and software
- 10.1016/S0163-6383(01)00057-1 · DOI
- 10.1016/j.newideapsych.2007.07.007 · DOI
- Karmiloff‐Smith A., 1992, Beyond Modularity: A Developmental Perspective on Cognitive Science, 10.7551/mitpress/1579.001.0001 · DOI · Paper page
- 10.1073/pnas.0802631105 · DOI · Paper page
- 10.3389/fpsyg.2013.00857 · DOI
- 10.1016/0024-3841(88)90064-2 · DOI
- 10.1037/a0028681 · DOI · Paper page
- 10.1016/0004-3702(87)90050-6 · DOI · Paper page
- 10.1093/brain/awm025 · DOI · Paper page
- Le Q. V., 2012, Building high‐level features using large scale unsupervised learning, Proceedings of the International Conference on Machine Learning
- 10.1037/12402-000 · doi:10.1037/12402-000
- 10.1016/0010-0277(91)90048-9 · DOI · Paper page
- 10.1006/cogp.1995.1015 · DOI · Paper page
- 10.1016/S1364-6613(00)01536-9 · DOI
- 10.1037/0012-1649.36.5.635 · doi:10.1037/0012-1649.36.5.635 · Paper page
- Marr D., 1982, Vision
- 10.1016/0010-0285(89)90014-5 · DOI · Paper page
- 10.1037/a0018130 · DOI
- McClelland J. L., 1981, Proceedings of the Third Annual Conference of the Cognitive Science Society, 170
- McClelland J. L., 1989, Theoretical issues in natural language processing, 78
- 10.1037/a0033812 · DOI · Paper page
- 10.1016/j.tics.2010.06.002 · DOI · Paper page
- 10.1016/0010-0285(86)90015-0 · DOI · Paper page
- 10.1111/cogs.12146 · DOI · Paper page
- 10.1016/S1364-6613(02)02012-0 · DOI
- 10.1016/S1364-6613(02)01993-9 · DOI · Paper page
- McClelland J. L., 1981, An interactive activation model of context effects in letter perception: Part 1. An account of basic findings, Psychological Review, 88, 375, 10.1037/0033-295X.88.5.375 · DOI · Paper page
- 10.1037/0096-3445.114.2.159 · DOI · Paper page
- McClelland J. L., 1986, Parallel distributed processing: Explorations in the microstructure of cognition, 3
- 10.1080/01690968908406371 · DOI · Paper page
- 10.1111/j.1467-9280.1991.tb00173.x · DOI · Paper page
- McCloskey M., 1989, The psychology of learning and motivation, 109
- 10.1037/a0029872 · DOI · Paper page
- McRae K., 2002, Category specificity in brain and mind
- 10.1006/jmla.1997.2543 · DOI · Paper page
- 10.1207/s15516709cog2001_2 · doi:10.1207/s15516709cog2001_2
- 10.2307/3680823 · doi:10.2307/3680823
- Minsky M., 1969, Perceptrons: An introduction to computational geometry
- 10.4249/scholarpedia.5947 · DOI · Paper page
- Morowitz H. J., 2002, The emergence of everything: How the world became complex, 10.1093/oso/9780195135138.001.0001 · DOI · Paper page
- 10.1037/0033-295X.108.1.113 · DOI
- 10.1111/1467-7687.00296 · DOI · Paper page
- 10.1037/0033-295X.104.4.686 · doi:10.1037/0033-295x.104.4.686 · Paper page
- 10.1037/0033-295X.92.3.289 · doi:10.1037/0033-295x.92.3.289 · Paper page
- Neisser U., 1967, Cognitive Psychology
- Newell A., 1990, Unified Theories of Cognition
- 10.1126/science.134.3495.2011 · DOI · Paper page
- 10.3758/BF03197425 · DOI
- 10.1017/CBO9781139174909.014 · DOI · Paper page
- O'Reilly R. C., 2000, Computational explorations in cognitive neuroscience, 10.7551/mitpress/2014.001.0001 · DOI · Paper page
- 10.1002/1098-1063(2000)10:4<389::AID-HIPO5>3.0.CO;2-P · doi:10.1002/1098-1063(2000)10:4<389::aid-hipo5>3.0.co;2-p
- 10.1162/jocn.2006.18.2.169 · doi:10.1162/jocn.2006.18.2.169 · Paper page
- Pearl J., 1982, Proceedings of the AAAI national conference on AI, 133
- 10.1016/j.cogpsych.2010.04.001 · DOI · Paper page
- 10.1016/0010-0285(90)90006-P · DOI · Paper page
- Piaget J., 1970, The child's conception of movement and speed
- 10.1159/000112531 · DOI · Paper page
- 10.1177/00238309030460020501 · DOI · Paper page
- 10.1126/science.1857983 · DOI · Paper page
- Pinker S., 1999, Words and Rules
- 10.1016/0010-0277(88)90032-7 · DOI · Paper page
- 10.1080/02643290244000112 · DOI · Paper page
- 10.1080/02643294.2011.609812 · DOI
- 10.1037/0033-295X.107.4.786 · DOI · Paper page
- 10.1080/02643299308253469 · DOI · Paper page
- 10.1016/0010-0277(91)90022-V · DOI · Paper page
- 10.1016/S0010-0277(96)00721-4 · DOI
- 10.1111/j.2044-835X.1992.tb00575.x · DOI · Paper page
- 10.1016/0004‐3702(90)90005‐K · DOI · Paper page
- 10.1126/science.275.5306.1604 · DOI · Paper page
- 10.1109/CVPR.2007.383157 · DOI · Paper page
- 10.1111/j.1756‐8765.2010.01127.x · DOI
- 10.1037/0033-295X.111.1.205 · DOI · Paper page
- 10.1080/01690960344000053 · DOI
- 10.7551/mitpress/6161.001.0001 · DOI · Paper page
- 10.1017/S0140525X08006067 · DOI
- 10.1017/S0140525X0800589X · DOI
- 10.1207/s15327647jcd0501_14 · DOI
- Rohde D. L.(2002).A connectionist model of sentence comprehension and production. Ph.D. Thesis.Pittsburgh PA:Computer Science Department Carnegie Mellon University.
- 10.1016/S0010-0277(99)00055-4 · DOI
- 10.1006/jmla.1996.2489 · DOI
- Rumelhart D. E., 1977, Attention and performance VI
- Rumelhart D. E., 1989, The architecture of mind: A connectionist approach, Foundations of Cognitive Science, 1, 133, 10.7551/mitpress/3072.003.0006 · doi:10.7551/mitpress/3072.003.0006
- Rumelhart D. E., 1990, An Introduction to neural and electronic networks, 405
- Rumelhart D. E., 1986, Parallel distributed processing: Explorations in the microstructure of cognition, 318, 10.7551/mitpress/5236.001.0001 · DOI · Paper page
- 10.7551/mitpress/5236.003.0008 · DOI · Paper page
- Rumelhart D. E., 1976, Schooling and the acquisition of knowledge
- Rumelhart D. E., 1986, Parallel distributed processing: Explorations in the microstructure of cognition, 7, 10.7551/mitpress/5236.001.0001 · DOI · Paper page
- 10.1126/science.274.5294.1926 · DOI · Paper page
- Salakhutdinov R., 2009, Deep Boltzmann machines, Artificial Intelligence, 5, 448
- 10.1147/rd.441.0206 · DOI · Paper page
- Saxe A., 2013, Proceedings of the 35th annual meeting of the Cognitive Science Society, 1271
- Schank R. C., 1981, Perspectives on cognitive science, 105
- Schank R. C., 1977, Representation, 272
- 10.1016/j.cognition.2008.11.017 · DOI
- 10.1037/0033-295X.96.4.523 · DOI · Paper page
- 10.1111/cogs.12147 · DOI
- Sejnowski T. J., 1987, Parallel networks that learn to pronounce English text, Complex Systems, 1, 145
- 10.1093/acprof:osobl/9780199579242.001.0001 · DOI · Paper page
- 10.2307/415743 · DOI · Paper page
- 10.1080/03640210802066964 · DOI
- 10.2307/1165995 · DOI · Paper page
- Siegler R. S., 2005, Childrens thinking
- 10.1006/cogp.1998.0686 · DOI · Paper page
- 10.1111/j.1551‐6709.2010.01129.x · DOI · Paper page
- Smolensky P., 1986, Parallel distributed processing: Explorations in the microstructure of cognition, 194
- 10.1111/cogs.12047 · DOI
- Smolensky P., 2005, The harmonic mind
- Socher R., 2013, Proceedings of the 51st annual meeting of the Association for Computational Linguistics, 455
- Socher R., 2013, Proceedings of the 2013 conference on empirical methods in natural language processing, 1631, 10.18653/v1/D13-1170 · DOI · Paper page
- 10.1037/0033-295X.99.4.605 · doi:10.1037/0033-295x.99.4.605 · Paper page
- 10.1093/acprof:oso/9780195300598.001.0001 · DOI
- Spivey M. J., 2008, Continuity of Mind
- 10.1037/0278-7393.24.6.1521 · doi:10.1037/0278-7393.24.6.1521 · Paper page
- 10.1207/s15516709cog1602_5 · DOI
- 10.1162/089976601300014376 · DOI · Paper page
- 10.1080/016909697386853 · DOI · Paper page
- Thelen E., 1996, A dynamic systems approach to the development of cognition and action
- 10.1037/0033-295X.110.4.647 · DOI
- 10.1006/brln.2000.2353 · DOI · Paper page
- 10.1016/j.neuron.2011.09.013 · DOI · Paper page
- 10.1207/s15516709cog2702_4 · doi:10.1207/s15516709cog2702_4
- Weigand A. S., 1991, Advances in Neural Information Processing Systems 3, 875
- Wellman H. M., 1997, Handbook of child psychology, 523
- 10.1016/j.cogdev.2012.08.004 · DOI
- 10.1016/0010-0285(70)90005-8 · DOI · Paper page
- Wilkening F. &Anderson N. H.(1980).Comparison of two rule assessment methodologies for studying cognitive development. Center for Human Information Processing Report(Vol. 94 p.44pp.).
- 10.1145/355598.362773 · DOI · Paper page
- 10.1037/0033-295X.114.2.316 · DOI · Paper page
Cited by
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381
Bargh, J. A. (2006) · European Journal of Social Psychology · doi:10.1002/ejsp.336 · Cited by 757
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501
The ghosts of brain states past: Remembering reactivates the brain regions engaged during encoding.
Danker, J. F., & Anderson, J. R. (2010) · Psychological Bulletin · doi:10.1037/a0017937 · Cited by 400
If deep learning is the answer, what is the question?
Saxe, A., Nelli, S., & Summerfield, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00395-8 · Cited by 397
A theory of eye movements during target acquisition.
Zelinsky, G. J. (2008) · Psychological Review · doi:10.1037/a0013118 · Cited by 394
Incrementality and Prediction in Human Sentence Processing
Altmann, G. T. M., & Mirković, J. (2009) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01022.x · Cited by 369
Empiricism without magic: transformational abstraction in deep convolutional neural networks
Buckner, C. (2018) · Synthese · doi:10.1007/s11229-018-01949-1 · Cited by 149
The microcircuit concept applied to cortical evolution: from three-layer to six-layer cortex
Shepherd, G. M. (2011) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2011.00030 · Cited by 148
Exploiting short-term memory in soft body dynamics as a computational resource
Nakajima, K., Li, T., Hauser, H., & Pfeifer, R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.0437 · Cited by 128
Bayesian cognitive science, predictive brains, and the nativism debate
Colombo, M. (2018) · Synthese · doi:10.1007/s11229-017-1427-7 · Cited by 15
Metadata
- Authors
- Rogers, T. T., & McClelland, J. L.
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 2014-08
- Volume
- 38
- Issue
- 6
- Pages
- 1024-1077
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2127770685
- Cited by
- 233
- References
- 48
- FWCI
- 8.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.