Local vs. Distributed Coding

Abstract

The question of how information can be represented in networks of neurons is central to cognitive science - especially so now that some researchers are turning to connectionist models in an attempt to understand human cognition. A major distinction can be made between local coding schemes, in which each unit is assigned a particular meaning, and distributed coding, in which information is encoded by large numbers of units, each of which is involved in representing many different concepts. Many brain scientists dislike local coding schemes, but it is argued here that the arguments generally invoked against local coding are far from convincing. There are situations where it has been shown that the brain does use a form of distributed coding, often referred to as coarse coding, which is particularly useful for representing continuous variables during sensory and motor processing. However, it may be appropriate to think of the brain as a hybrid system, using more local codes for higher level representation. Such a view has the advantage of allowing more conventional symbol manipulation based artificial intelligence approaches to be integrated into a connectionist framework.