Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Psychological and Biological Models
Abstract
What makes people smarter than computers? These volumes by a pioneering neurocomputing group suggest that the answer lies in the massively parallel architecture of the human mind. They describe a new theory of cognition called connectionism that is challenging the idea of symbolic computation that has traditionally been at the center of debate in theoretical discussions about the mind. The authors' theory assumes the mind is composed of a great number of elementary units connected in a neural network. Mental processes are interactions between these units which excite and inhibit each other in parallel rather than sequential operations. In this context, knowledge can no longer be thought of as stored in localized structures; instead, it consists of the connections between pairs of units that are distributed throughout the network. Volume 1 lays the foundations of this exciting theory of parallel distributed processing, while Volume 2 applies it to a number of specific issues in cognitive science and neuroscience, with chapters describing models of aspects of perception, memory, language, and thought.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Cognitive science has developed task-performing computational models that decompose cognition into functional components.
“Cognitive science has developed computational models that decompose cognition into functional components.”
From Cognitive computational neuroscience (2018) · cites this paper as [6]
Cited by
Sorted by citations
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570 · see citing works
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · see citing works
Networks for approximation and learning
Poggio, T., & Girosi, F. (1990) · Proceedings of the IEEE · doi:10.1109/5.58326 · Cited by 3,256 · see citing works
30 years of adaptive neural networks: perceptron, Madaline, and backpropagation
Widrow, B. C., & Lehr, M. A. (1990) · Proceedings of the IEEE · doi:10.1109/5.58323 · Cited by 2,241 · see citing works
Coding and use of tactile signals from the fingertips in object manipulation tasks
Johansson, R. S., & Flanagan, J. R. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2621 · Cited by 2,063 · see citing works
Deep Learning for Health Informatics
Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636665 · Cited by 2,000 · see citing works
Neural networks for control systems—A survey
Hunt, K. J., Sbarbaro, D. G., Żbikowski, R., & Gawthrop, P. J. (1992) · Automatica · doi:10.1016/0005-1098(92)90053-i · Cited by 1,861 · see citing works
Implicit learning and tacit knowledge
Reber, A. S. (1989) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.118.3.219 · Cited by 1,581 · see citing works
Damasio, A. R. (1989) · Cognition · doi:10.1016/0010-0277(89)90005-x · Cited by 1,538 · see citing works
Neural-network-based fuzzy logic control and decision system
Lin, C., & Lee, C. S. G. (1991) · IEEE Transactions on Computers · doi:10.1109/12.106218 · Cited by 1,483 · see citing works
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451 · see citing works
Self-citationGenerative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363 · see citing works
Pavlovian conditioning: it's not what you think it is
Rescorla, R. A. (1988) · American Psychologist · doi:10.1037/0003-066x.43.3.151 · Cited by 1,542 · see citing works
An introduction to neural computing
Kohonen, T. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90020-2 · Cited by 1,201 · see citing works
Andreasen, N. C., Paradiso, S., & OʼLeary, D. S. (1998) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a033321 · Cited by 1,176 · see citing works
An introduction to genetic algorithms
Deb, K. (1999) · Sadhana · doi:10.1007/bf02823145 · Cited by 1,180 · see citing works
A deep learning framework for neuroscience
Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0520-2 · Cited by 1,027 · see citing works
Beyond behaviorism: on the automaticity of higher mental processes.
Bargh, J., & Ferguson, M. (2000) · Psychological bulletin · doi:10.1037/0033-2909.126.6.925 · Cited by 1,064 · see citing works
Peripheral vision and pattern recognition: A review
Strasburger, H., Rentschler, I., & Jüttner, M. (2011) · Journal of Vision · doi:10.1167/11.5.13 · Cited by 939 · see citing works
Pyramidal Neuron as Two-Layer Neural Network
Poirazi, P., Brannon, T., & Mel, B. W. (2003) · Neuron · doi:10.1016/s0896-6273(03)00149-1 · Cited by 792 · see citing works
An embodied cognitive science?
Clark, A. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01361-3 · Cited by 781 · see citing works
Directed-graph epidemiological models of computer viruses
Kephart, J. O., & White, S. R. (2002) · IEEE Computer Society Symposium on Research in Security and Privacy · doi:10.1109/risp.1991.130801 · Cited by 788 · see citing works
Knowledge‐Based Modeling of Material Behavior with Neural Networks
Ghaboussi, J., Garrett, J. H., & Wu, X. (1991) · Journal of Engineering Mechanics · doi:10.1061/(asce)0733-9399(1991)117:1(132 · Cited by 784 · see citing works
Diagonal recurrent neural networks for dynamic systems control
Ku, C.-C., & Lee, K. Y. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.363441 · Cited by 725 · see citing works
The recent excitement about neural networks
Crick, F. (1989) · Nature · doi:10.1038/337129a0 · Cited by 724 · see citing works
Discriminative learning for minimum error classification (pattern recognition)
Juang, B.-H., & Katagiri, S. (1992) · IEEE Transactions on Signal Processing · doi:10.1109/78.175747 · Cited by 714 · see citing works
Analyzing vision at the complexity level
Tsotsos, J. K. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00079577 · Cited by 704 · see citing works
Wallis, C. (2003) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813021000055199 · Cited by 687 · see citing works
Temporal Reasoning Based on Semi-Intervals
Freksa, C. (1992) · Artificial Intelligence · doi:10.1016/0004-3702(92)90090-k · Cited by 309 · see citing works
Competitive learning algorithms for vector quantization
Ahalt, S. C., Krishnamurthy, A. K., Chen, P., et al. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90071-r · Cited by 673 · see citing works
A simple procedure for pruning back-propagation trained neural networks
Karnin, E. D. (1990) · IEEE Transactions on Neural Networks · doi:10.1109/72.80236 · Cited by 672 · see citing works
Dynamical approaches to cognitive science
Beer, R. D. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01440-0 · Cited by 639 · see citing works
Nonlinear principal component analysis—Based on principal curves and neural networks
Dong, D., & McAvoy, T. J. (1996) · Computers & Chemical Engineering · doi:10.1016/0098-1354(95)00003-k · Cited by 629 · see citing works
Ritter, H. J., & Kohonen, T. (1989) · Biological Cybernetics · doi:10.1007/bf00203171 · Cited by 622 · see citing works
Impact of Active Dendrites and Structural Plasticity on the Memory Capacity of Neural Tissue
Poirazi, P., & Mel, B. W. (2001) · Neuron · doi:10.1016/s0896-6273(01)00252-5 · Cited by 592 · see citing works
Short-term load forecasting using an artificial neural network
Lee, K. Y., Cha, Y. T., & Park, J.-S. (1992) · IEEE Transactions on Power Systems · doi:10.1109/59.141695 · Cited by 603 · see citing works
Beggs, J. M., & Plenz, D. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.0540-04.2004 · Cited by 575 · see citing works
A Neural Theory of Visual Attention: Bridging Cognition and Neurophysiology.
Bundesen, C., Habekost, T., & Kyllingsbæk, S. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.291 · Cited by 582 · see citing works
Dense Inhibitory Connectivity in Neocortex
Fino, E., & Yuste, R. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.025 · Cited by 532 · see citing works
Cortex and memory: emergence of a new paradigm
Fuster, J. M. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21280 · Cited by 559 · see citing works
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Zoubin Ghahramani, A., Jaakkola, T., & Saul, L. K. (1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9_5 · Cited by 551 · see citing works
Large-scale cortical networks and cognition
Bressler, S. L. (1995) · Brain Research Reviews · doi:10.1016/0165-0173(94)00016-i · Cited by 548 · see citing works
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535 · see citing works
An ANN application for water quality forecasting
Palani, S., Liong, S., & Tkalich, P. (2008) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2008.05.021 · Cited by 528 · see citing works
Zhao, T., Khan, M. I., & Chu, Y. (2021) · Mathematical Methods in the Applied Sciences · doi:10.1002/mma.7310 · Cited by 520 · see citing works
Forecasting the behavior of multivariate time series using neural networks
Chakraborty, K., Mehrotra, K. G., Mohan, C. K., et al. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80092-9 · Cited by 519 · see citing works
Chen, A., Leung, M. T., & Daouk, H. (2002) · Computers & Operations Research · doi:10.1016/s0305-0548(02)00037-0 · Cited by 527 · see citing works
Cognition and control in schizophrenia: a computational model of dopamine and prefrontal function
Braver, T. S., Barch, D. M., & Cohen, J. D. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(99)00116-x · Cited by 507 · see citing works
Juola, P. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000005 · Cited by 505 · see citing works
Rogers, L. L., & Dowla, F. (1994) · Water Resources Research · doi:10.1029/93wr01494 · Cited by 485 · see citing works
Genetic algorithm learning and the cobweb model
Arifovic, J. (1994) · Journal of Economic Dynamics and Control · doi:10.1016/0165-1889(94)90067-1 · Cited by 471 · see citing works
Reflexion and reflection: A social cognitive neuroscience approach to attributional inference
Lieberman, M. D., Gaunt, R. A., Gilbert, D. T., & Yaacov Trope, B. (2002) · Advances in experimental social psychology · doi:10.1016/s0065-2601(02)80006-5 · Cited by 472 · see citing works
Artificial neural network models for forecasting and decision making
Hill, T., Marquez, L., O'Connor, M., & Remus, W. (1994) · International Journal of Forecasting · doi:10.1016/0169-2070(94)90045-0 · Cited by 475 · see citing works
Trends in cooperative distributed problem solving
Durfee, E. H., Lesser, V., & Corkill, D. D. (1989) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.43404 · Cited by 447 · see citing works
Neural network models for pattern recognition and associative memory
Carpenter, G. A. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90035-x · Cited by 417 · see citing works
The general inefficiency of batch training for gradient descent learning
Wilson, D. R., & Martinez, T. R. (2003) · Neural Networks · doi:10.1016/s0893-6080(03)00138-2 · Cited by 420 · see citing works
The Link between Brain Learning, Attention, and Consciousness
Grossberg, S. (1999) · Consciousness and Cognition · doi:10.1006/ccog.1998.0372 · Cited by 408 · see citing works
Dynamic node creation in backpropagation networks
ASH, T. (1989) · Connection Science · doi:10.1080/09540098908915647 · Cited by 415 · see citing works
Harman, G. H. (1999) · doi:10.1093/0198238029.001.0001 · Cited by 409 · see citing works
Multispectral classification of Landsat-images using neural networks
Bischof, H., Schneider, W., & Pinz, A. J. (1992) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.142926 · Cited by 404 · see citing works
Stephan, W. G., & Stephan, C. W. (1996) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(96)00026-0 · Cited by 414 · see citing works
Redundant, overlapping organization: A Japanese approach to managing the innovation process
Nonaka, I. (1990) · California Management Review · doi:10.2307/41166615 · Cited by 393 · see citing works
Efficient classification for multiclass problems using modular neural networks
Anand, R., Mehrotra, K., Mohan, C. K., et al. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.363444 · Cited by 395 · see citing works
Theory and applications of neural networks for industrial control systems
Fukuda, T., & Shibata, T. (1992) · IEEE Transactions on Industrial Electronics · doi:10.1109/41.170966 · Cited by 389 · see citing works
Temporal binding, binocular rivalry, and consciousness
Engel, A. K., Fries, P., König, P., Brecht, M., & Singer, W. (1999) · Consciousness and Cognition · doi:10.1006/ccog.1999.0389 · Cited by 379 · see citing works
Analyzing the Performance of Multilayer Neural Networks for Object Recognition
Agrawal, P., Girshick, R., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_22 · Cited by 427 · see citing works
Hippocampal pyramidal cells excite inhibitory neurons through a single release site
Gulyás, A. I., Miles, R., Sik, A., Tóth, K., Tamamaki, N., & Freund, T. F. (1993) · Nature · doi:10.1038/366683a0 · Cited by 384 · see citing works
Implementations are not conceptualizations: Revising the verb learning model
MacWhinney, B., & Leinbach, J. (1991) · Cognition · doi:10.1016/0010-0277(91)90048-9 · Cited by 373 · see citing works
Teegavarapu, R. S. V., & Chandramouli, V. (2005) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.02.015 · Cited by 370 · see citing works
Learning to Segment Speech Using Multiple Cues: A Connectionist Model
Christiansen, M. H., Allen, J., & Seidenberg, M. S. (1998) · Language and Cognitive Processes · doi:10.1080/016909698386528 · Cited by 356 · see citing works
Exploring listening comprehension tactics and their interaction patterns
Goh, C. C. M. (2002) · System · doi:10.1016/s0346-251x(02)00004-0 · Cited by 358 · see citing works
Estimation of global solar radiation using artificial neural networks
Mohandes, M. A., Rehman, S., & Halawani, T. O. (1998) · Renewable Energy · doi:10.1016/s0960-1481(98)00065-2 · Cited by 352 · see citing works
Explicit information for category-orthogonal object properties increases along the ventral stream
Hong, H., Yamins, D. L. K., Majaj, N. J., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4247 · Cited by 329 · see citing works
Frequency Effects and the Representational Status of Regular Inflections
Alegre, M. A., & Gordon, P. C. (1999) · Journal of Memory and Language · doi:10.1006/jmla.1998.2607 · Cited by 343 · see citing works
An Aggregation Approach to Short-Term Traffic Flow Prediction
Tan, M., Wong, S. C., Xu, J., Guan, Z.-R., & Zhang, P. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2008.2011693 · Cited by 337 · see citing works
Vocabulary Acquisition and Verbal Short-Term Memory: Computational and Neural Bases
Gupta, P., & MacWhinney, B. (1997) · Brain and Language · doi:10.1006/brln.1997.1819 · Cited by 337 · see citing works
Support vector machines and its applications in chemistry
Li, H., Liang, Y., & Xu, Q. (2008) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2008.10.007 · Cited by 338 · see citing works
Neural networks for oil spill detection using ERS-SAR data
Frate, F. D., Petrocchi, A., Lichtenegger, J., et al. (2000) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.868885 · Cited by 336 · see citing works
Rehman, S., & Mohandes, M. A. (2007) · Energy Policy · doi:10.1016/j.enpol.2007.09.033 · Cited by 332 · see citing works
Computational analyses of multilevel discourse comprehension
Graesser, A. C., & McNamara, D. S. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01081.x · Cited by 325 · see citing works
Modha, D. S., Ananthanarayanan, R., Esser, S. K., Ndirango, A., Sherbondy, A. J., & Singh, R. (2011) · Communications of the ACM · doi:10.1145/1978542.1978559 · Cited by 331 · see citing works
Six principles for biologically based computational models of cortical cognition
O’Reilly, R. C. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01241-8 · Cited by 317 · see citing works
Knowlton, B. J., Ramus, S. J., & Squire, L. R. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00021.x · Cited by 316 · see citing works
Gray, C. M., Engel, A. K., Peter König, B., & Singer, W. (1990) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1990.tb00450.x · Cited by 315 · see citing works
The cerebellum and VOR/OKR learning models
Kawato, M., & Gomi, H. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90008-v · Cited by 320 · see citing works
Population coding of affect across stimuli, modalities and individuals
Chikazoe, J., Lee, D. H., Kriegeskorte, N., & Anderson, A. K. (2014) · Nature Neuroscience · doi:10.1038/nn.3749 · Cited by 303 · see citing works
Toward a Unified Model of Attention in Associative Learning
Kruschke, J. K. (2001) · Journal of Mathematical Psychology · doi:10.1006/jmps.2000.1354 · Cited by 309 · see citing works
Implicit statistical learning is directly associated with the acquisition of syntax
Kidd, E. (2012) · Developmental Psychology · doi:10.1037/a0025405 · Cited by 310 · see citing works
TYLER, L. K., Moss, H. E., Durrant-peatfield, M., & Levy, J. (2000) · Brain and Language · doi:10.1006/brln.2000.2353 · Cited by 304 · see citing works
Shin, Y., & Ghosh, J. (2002) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1991.155142 · Cited by 303 · see citing works
Effects of noun phrase type on sentence complexity
Gordon, P. C., Hendrick, R., & Johnson, M. (2004) · Journal of Memory and Language · doi:10.1016/j.jml.2004.02.003 · Cited by 304 · see citing works
Brusić, V., Rudy, G. B., Honeyman, G., et al. (1998) · Bioinformatics · doi:10.1093/bioinformatics/14.2.121 · Cited by 296 · see citing works
Neural network control for a closed-loop System using Feedback-error-learning
Gomi, H., & Kawato, M. (1993) · Neural Networks · doi:10.1016/s0893-6080(09)80004-x · Cited by 288 · see citing works
Designing an artificial neural network for forecasting tourism time series
Pol, A. L. P., Moreno, J. J. M., & Sesé, A. (2005) · Tourism Management · doi:10.1016/j.tourman.2005.05.006 · Cited by 287 · see citing works
Précis ofBeyond modularity: A developmental perspective on cognitive science
Karmiloff‐Smith, A. (1994) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00036621 · Cited by 285 · see citing works
Inductive biases for deep learning of higher-level cognition
Goyal, A., & Bengio, Y. (2022) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2021.0068 · Cited by 300 · see citing works
Free food or earned food? A review and fuzzy model of contrafreeloading
INGLIS, I. R., Forkman, B., & Lazarus, J. H. (1997) · Animal Behaviour · doi:10.1006/anbe.1996.0320 · Cited by 281 · see citing works
Wilson, R. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511606847 · Cited by 286 · see citing works
Probabilistic Neural Networks in Bankruptcy Prediction
Yang, Z. R., Platt, M. B., & Platt, H. D. (1999) · Journal of Business Research · doi:10.1016/s0148-2963(97)00242-7 · Cited by 279 · see citing works
- Authors
- McClelland, J. L., Rumelhart, D. E., & AU
- ORCID
- McClelland, James L.
- Venue
- The MIT Press eBooks
- Publisher
- The MIT Press
- Published
- 1987
- OpenAlex
- W4253020087
- Cited by
- 3,315
- References
- 0
- Citations by year
- 2026: 14 · 2025: 46 · 2024: 73 · 2023: 134 · 2022: 85 · 2021: 91 · 2020: 68 · 2019: 78 · 2018: 69 · 2017: 65 · 2016: 64 · 2015: 54 · 2014: 59 · 2013: 41 · 2012: 39
- FWCI
- 42.46
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- The MIT Press eBooks (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Physical Sciences › Computer Science › Artificial Intelligence › Cognitive Computing and Networks
- Keywords
- parallel distributed processing, connectionism, artificial neural networks, cognitive architecture, symbolic computation, distributed knowledge, perception, memory, language, thinking, neuroscience, cognitive science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review