The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Feature Discovery by Competitive Learning*
Open accessAbstract
This paper reports the results of our studies with an unsupervised learning paradigm which we have called “Competitive Learning.” We have examined competitive learning using both computer simulation and formal analysis and have found that when it is applied to parallel networks of neuron‐like elements, many potentially useful learning tasks can be accomplished. We were attracted to competitive learning because it seems to provide a way to discover the salient, general features which can be used to classify a set of patterns. We show how a very simply competitive mechanism can discover a set of feature detectors which capture important aspects of the set of stimulus input patterns. We also show how these feature detectors can form the basis of a multilayer system that can serve to learn categorizations of stimulus sets which are not linearly separable. We show how the use of correlated stimuli con serve as a kind of “teaching” input to the system to allow the development of feature detectors which would not develop otherwise. Although we find the competitive learning mechanism a very interesting and powerful learning principle, we do not, of course, imagine thot it is the only learning principle. Competitive learning is an essentially nonassociative statistical learning scheme. We certainly imagine that other kinds of learning mechanisms will be involved in the building of associations among patterns of activation in a more complete neural network. We offer this analysis of these competitive learning mechanisms to further our understanding of how simple adaptive networks can discover features important in the description of the stimulus environment in which the system finds itself.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Hebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
indicated, N. A. (1950) · Journal of Consulting Psychology · doi:10.1037/h0049612 · Cited by 6,923
McClelland, J. L., & Rumelhart, D. E. (1981) · Psychological Review · doi:10.1037/0033-295x.88.5.375 · Cited by 4,889
Self-citationBienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896 · cited 1×
“The second method is similar to that employed by Bienenstock, Cooper, and Munro (1982), in which a unit modulates its own sensitivity so that when it is not receiving enough inputs, it becomes increasingly sensitive.”
MethodGrossberg, S. (1976) · Biological Cybernetics · doi:10.1007/bf00344744 · Cited by 1,909
Rumelhart, D. E., & McClelland, J. L. (1982) · Psychological Review · doi:10.1037//0033-295x.89.1.60 · Cited by 1,525
Self-citationSelf-organization of orientation sensitive cells in the striate cortex
von der Malsburg, C. (1973) · Kybernetik · doi:10.1007/bf00288907 · Cited by 1,461
Bek, R. (1978) · Czech digital mathematics library · Cited by 787
Cognitron: A self-organizing multilayered neural network
Fukushima, K. (1975) · Biological Cybernetics · doi:10.1007/bf00342633 · Cited by 757
Cited by
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
A theory of lexical access in speech production
Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99001776 · Cited by 5,136
Representativeness revisited: Attribute substitution in intuitive judgment.
Kahneman, D., & Frederick, S. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.004 · Cited by 3,476
Learning internal representations by error propagation
RUMELHART, D. E., HINTON, G. E., & WILLIAMS, R. J. (1988) · Readings in Cognitive Science · doi:10.1016/b978-1-4832-1446-7.50035-2 · Cited by 3,002
Self-citationThe TRACE model of speech perception
McClelland, J. L., & Elman, J. L. (1986) · Cognitive Psychology · doi:10.1016/0010-0285(86)90015-0 · Cited by 2,956
Slovic, P., Finucane, M., Peters, E., & MacGregor, D. G. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.025 · Cited by 2,349
Heuristics and Biases: The Psychology of Intuitive Judgment
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098 · Cited by 2,192
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Nonlinear neural networks: Principles, mechanisms, and architectures
Grossberg, S. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90021-4 · Cited by 1,623
Neural-network-based fuzzy logic control and decision system
Lin, C.-T., & Lee, C. S. G. (1991) · IEEE Transactions on Computers · doi:10.1109/12.106218 · Cited by 1,480
Competitive learning: From interactive activation to adaptive resonance
Grossberg, S. (1987) · Cognitive Science · doi:10.1111/j.1551-6708.1987.tb00862.x · Cited by 1,471
“Rumelhart and Zipser (1985) were able to ignore this fundamental issue by considering simple input environments whose probabilistic rules do not change through time.”
BackgroundMethodInfluentialConnectionist learning procedures
Hinton, G. E. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90049-0 · Cited by 1,430
Neural syntax: cell assemblies, synapsembles, and readers
Buzsáki, G. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.023 · Cited by 1,289
Norman, K. A., & O'Reilly, R. C. (2003) · Psychological Review · doi:10.1037/0033-295x.110.4.611 · Cited by 1,312
Solar forecasting methods for renewable energy integration
Inman, R. H., Pedro, H. T. C., & Coimbra, C. F. M. (2013) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2013.06.002 · Cited by 1,062
Skill acquisition: Compilation of weak-method problem situations.
Anderson, J. R. (1987) · Psychological Review · doi:10.1037//0033-295x.94.2.192 · Cited by 1,023
Training Deep Spiking Neural Networks Using Backpropagation
Lee, J. H., Delbruck, T., & Pfeiffer, M. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00508 · Cited by 976
A high-bias, low-variance introduction to Machine Learning for physicists
Mehta, P., Bukov, M., Wang, C.-H., Day, A. G. R., Richardson, C., Fisher, C. K., & Schwab, D. J. (2019) · Physics Reports · doi:10.1016/j.physrep.2019.03.001 · Cited by 920
Norris, D. (2003) · Cognitive Psychology · doi:10.1016/s0010-0285(03)00006-9 · Cited by 884
Conjunctive representations in learning and memory: Principles of cortical and hippocampal function.
O'Reilly, R. C., & Rudy, J. W. (2001) · Psychological Review · doi:10.1037//0033-295x.108.2.311 · Cited by 865
Tang, J., Yuan, F., Shen, X., Wang, Z., Rao, M., He, Y., Sun, Y., Li, X., Zhang, W., Li, Y., et al. (2019) · Advanced Materials · doi:10.1002/adma.201902761 · Cited by 834
Knowledge‐Based Modeling of Material Behavior with Neural Networks
Ghaboussi, J., Garrett, J. H., & Wu, X. (1991) · Journal of Engineering Mechanics · doi:10.1061/(asce)0733-9399(1991)117:1(132 · Cited by 775
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.020 · Cited by 678
Learning invariance from transformation sequences
Földiák, P. (1991) · Neural Computation · doi:10.1162/neco.1991.3.2.194 · Cited by 661
Competitive learning algorithms for vector quantization
Ahalt, S. C., Krishnamurthy, A. K., Chen, P., & Melton, D. E. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90071-r · Cited by 670
The discovery of structural form
Kemp, C., & Tenenbaum, J. B. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802631105 · Cited by 650
Adding a conscience to competitive learning
DeSieno (1988) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1988.23839 · Cited by 637
Gutkin, R., Green, C. J., Vangrattanachai, S., Pinho, S. T., Robinson, P., & Curtis, P. T. (2011) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2010.11.014 · Cited by 623
Rival penalized competitive learning for clustering analysis, RBF net, and curve detection
Xu, L., Krzyzak, A., & Oja, E. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.238318 · Cited by 613
Metaheuristic design of feedforward neural networks: A review of two decades of research
Ojha, V. K., Abraham, A., & Snášel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 606
Neural Networks: A New Tool for Predicting Thrift Failures*
Salchenberger, L. M., Cinar, E. M., & Lash, N. A. (1992) · Decision Sciences · doi:10.1111/j.1540-5915.1992.tb00425.x · Cited by 533
Use of neural networks in detection of structural damage
Wu, X., Ghaboussi, J., & Garrett, J. H. (1992) · Computers & Structures · doi:10.1016/0045-7949(92)90132-j · Cited by 530
Forming sparse representations by local anti-Hebbian learning
Földiák, P. (1990) · Biological Cybernetics · doi:10.1007/bf02331346 · Cited by 528
Hinton, G. E. (1990) · Machine Learning · doi:10.1016/b978-0-08-051055-2.50029-8 · Cited by 516
Learning the distribution of object trajectories for event recognition
Johnson, N., & Hogg, D. (1996) · Image and Vision Computing · doi:10.1016/0262-8856(96)01101-8 · Cited by 499
The Transfer of Scientific Principles Using Concrete and Idealized Simulations
Goldstone, R. L., & Son, J. Y. (2005) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1401_4 · Cited by 452
Coordinating perceptually grounded categories through language: A case study for colour
steels, L., & belpaeme, T. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000087 · Cited by 440
3-D vision and figure-ground separation by visual cortex
Grossberg, S. (1994) · Perception & Psychophysics · doi:10.3758/bf03206880 · Cited by 440
An elemental model of associative learning: I. Latent inhibition and perceptual learning
McLaren, I. P. L., & Mackintosh, N. J. (2000) · Animal Learning & Behavior · doi:10.3758/bf03200258 · Cited by 439
Neural network models for pattern recognition and associative memory
Carpenter, G. A. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90035-x · Cited by 418
Thrun, S. (1998) · Learning to Learn · doi:10.1007/978-1-4615-5529-2_8 · Cited by 413
Incorporating the Irrelevant: Anchors in Judgments of Belief and Value
Chapman, G. B., & Johnson, E. J. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.008 · Cited by 410
Letter recognition using Holland-style adaptive classifiers
Frey, P. W., & Slate, D. J. (1991) · Machine Learning · doi:10.1007/bf00114162 · Cited by 409
Information processing, dimensionality reduction and reinforcement learning in the basal ganglia
Bar-Gad, I., Morris, G., & Bergman, H. (2003) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2003.12.001 · Cited by 399
Sloman, S. A. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.024 · Cited by 395
A model of hippocampal function
Burgess, N., Recce, M., & O'Keefe, J. (1994) · Neural Networks · doi:10.1016/s0893-6080(05)80159-5 · Cited by 393
Improvement in line orientation discrimination is retinally local but dependent on cognitive set
Shiu, L.-P., & Pashler, H. (1992) · Perception & Psychophysics · doi:10.3758/bf03206720 · Cited by 389
BIOLOGICALLY BASED ARTIFICIAL NAVIGATION SYSTEMS: REVIEW AND PROSPECTS
TRULLIER, O., WIENER, S. I., BERTHOZ, A., & MEYER, J.-A. (1997) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00060-3 · Cited by 363
Clustering Algorithms in Biomedical Research: A Review
Xu, R., & Wunsch, D. C. (2010) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2010.2083647 · Cited by 349
Least mean square error reconstruction principle for self-organizing neural-nets
Xu, L. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80107-8 · Cited by 341
Self-organizing feature maps and the travelling salesman problem
Angéniol, B., de La Croix Vaubois, G., & Le Texier, J.-Y. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90002-0 · Cited by 340
Serb, A., Bill, J., Khiat, A., Berdan, R., Legenstein, R., & Prodromakis, T. (2016) · Nature Communications · doi:10.1038/ncomms12611 · Cited by 339
Clustering: A neural network approach
Du, K.-L. (2010) · Neural Networks · doi:10.1016/j.neunet.2009.08.007 · Cited by 325
On the directional firing properties of hippocampal place cells
Muller, R., Bostock, E., Taube, J., & Kubie, J. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-12-07235.1994 · Cited by 322
Cognitive maps beyond the hippocampus
Redish, A. D., & Touretzky, D. S. (1997) · Hippocampus · doi:10.1002/(sici)1098-1063(1997)7:1<15::aid-hipo3>3.0.co;2-6 · Cited by 319
Six principles for biologically based computational models of cortical cognition
O'Reilly, R. C. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01241-8 · Cited by 318
The transfer of abstract principles governing complex adaptive systems
Goldstone, R. L., & Sakamoto, Y. (2003) · Cognitive Psychology · doi:10.1016/s0010-0285(02)00519-4 · Cited by 315
A revised model of short-term memory and long-term learning of verbal sequences
Burgess, N., & Hitch, G. J. (2006) · Journal of Memory and Language · doi:10.1016/j.jml.2006.08.005 · Cited by 307
Introduction – Heuristics and Biases: Then and Now
Gilovich, T., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.002 · Cited by 305
Grossberg, S., & Levine, D. S. (1987) · Applied Optics · doi:10.1364/ao.26.005015 · Cited by 303
The Effects of Feature‐Label‐Order and Their Implications for Symbolic Learning
Ramscar, M., Yarlett, D., Dye, M., Denny, K., & Thorpe, K. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01092.x · Cited by 300
Nessler, B., Pfeiffer, M., Buesing, L., & Maass, W. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003037 · Cited by 281
Cortical connections and parallel processing: Structure and function
Ballard, D. H. (1986) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00021555 · Cited by 299
Unsupervised learning of vowel categories from infant-directed speech
Vallabha, G. K., McClelland, J. L., Pons, F., Werker, J. F., & Amano, S. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0705369104 · Cited by 294
Information theoretic clustering
Gokcay, E., & Principe, J. C. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982897 · Cited by 293
Norm Theory: Comparing Reality to Its Alternatives
Kahneman, D., & Miller, D. T. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.022 · Cited by 289
Functions of Neuronal Networks in the Hippocampus and Neocortex in Memory
Rolls, E. T. (1989) · Neural Models of Plasticity · doi:10.1016/b978-0-12-148955-7.50017-5 · Cited by 286
Design and evolution of modular neural network architectures
Happel, B. L. M., & Murre, J. M. J. (1994) · Neural Networks · doi:10.1016/s0893-6080(05)80155-8 · Cited by 275
Attention-Gated Reinforcement Learning of Internal Representations for Classification
Roelfsema, P. R., & Ooyen, A. V. (2005) · Neural Computation · doi:10.1162/0899766054615699 · Cited by 260
Using neural networks for data mining
Craven, M. W., & Shavlik, J. W. (1997) · Future Generation Computer Systems · doi:10.1016/s0167-739x(97)00022-8 · Cited by 257
A counterpropagation fuzzy-neural network modeling approach to real time streamflow prediction
Chang, F.-J., & Chen, Y.-C. (2001) · Journal of Hydrology · doi:10.1016/s0022-1694(01)00350-x · Cited by 253
Quantum Many-Body Dynamics in Two Dimensions with Artificial Neural Networks
Schmitt, M., & Heyl, M. (2020) · Physical Review Letters · doi:10.1103/physrevlett.125.100503 · Cited by 221
Neurophysiology of shape processing
Perrett, D. I., & Oram, M. W. (1993) · Image and Vision Computing · doi:10.1016/0262-8856(93)90011-5 · Cited by 213
Isolated and interrelated concepts
Goldstone, R. L. (1996) · Memory & Cognition · doi:10.3758/bf03201087 · Cited by 182
Mental Contamination and the Debiasing Problem
Wilson, T. D., Centerbar, D. B., & Brekke, N. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.012 · Cited by 160
The calibration of expert judgment: heuristics and biases beyond the laboratory
Koehler, D. J., Brenner, L., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.041 · Cited by 146
Toward an integration of deep learning and neuroscience
Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119
Navigation by fragment fitting: A theory of hippocampal function
Worden, R. (1992) · Hippocampus · doi:10.1002/hipo.450020208 · Cited by 117
Multiple perspectives on word production
Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99451775 · Cited by 107
Statistical computations underlying the dynamics of memory updating
Gershman, S. J., Radulescu, A., Norman, K. A., & Niv, Y. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003939 · Cited by 101
“Episodes are partitioned into modes by a competitive clustering process similar to mechanisms that have been proposed in many other psychological and neural models [23,24,34,37,38].”
MethodPredictive Coding Approximates Backprop Along Arbitrary Computation Graphs
Millidge, B., Tschantz, A., & Buckley, C. L. (2022) · Neural Computation · doi:10.1162/neco_a_01497 · Cited by 95
The multiple, interacting levels of cognitive systems (MILCS) perspective on group cognition
Goldstone, R. L., & Theiner, G. (2017) · Philosophical Psychology · doi:10.1080/09515089.2017.1295635 · Cited by 31
“…1976), developing differentiated and specialized units by having originally homogeneous units compete for the “right” to adapt to input patterns (Rumelhart & Zipser, 1985), interactive activation for combining top-down and bottom-up information (McClelland & Rumelhart, 1981), and…”
BackgroundATTRIBUTING RESPONSIBILITY TO COMPUTER SYSTEMS1,*
BECHTEL, W. (1985) · Metaphilosophy · doi:10.1111/j.1467-9973.1985.tb00176.x · Cited by 26
Metadata
- Authors
- Rumelhart, D. E., & Zipser, D.
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 1985-01
- Volume
- 9
- Issue
- 1
- Pages
- 75-112
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W1490454746
- Cited by
- 1,057
- References
- 12
- FWCI
- 26.86
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.