Winner-Take-All Networks of O(N) Complexity
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Two general types of inhibition mediate activity in neural systems: subtractive inhibition, which sets a zero level for the computation, and multiplicative (nonlinear) inhibition, which regulates the gain of the computation. We report a physical realization of general nonlinear inhibition in its extreme form, known as winner-take-all We have designed and fabricated a series of compact, completely functional CMOS integrated circuits that realize the winner-take-all function, using the full analog nature of the medium. This circuit has been used successfully as a component in several VLSI sensory systems, that perform auditory localization (Lazzaro and Mead, in press) and visual stereopsis (Mahowald and Delbruck, 1988). Winner-take-all circuits with over 170 inputs function correctly in these sensory systems. We have also modified this global winner-take-all circuit, realizing a circuit that computes local nonlinear inhibition. The circuit allows multiple winners in the network, and is well suited for use in systems that represent a feature space topographically and that process several features in parallel. We have designed, fabricated, and tested a CMOS integrated circuit that computes locally the winner-take-all function of spatially ordered input.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some studies proposed to implement the argmax() function via hardware128–148, which could be beneficial to reduce the total transistor count and power consumption while at the same time increasing the throughput.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [132]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Analog VLSI and Neural Systems
Mead, C. (1989) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,776
Self-citationA Silicon Model Of Auditory Localization
Lazzaro, J., & Mead, C. (1989) · Neural Computation · doi:10.1162/neco.1989.1.1.47 · Cited by 121
Self-citationAn analog VLSI implementation of the marr-poggio stereo correspondence algorithm
Mahowald, M. A., & Delbrück, T. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90418-2 · Cited by 13
Self-citation
Research works printed but not linked: 1
- Mead, C. A. (in press). AnalogVLSI and Neural Systems. Reading, MA: AddisonWesley.
Cited by
Items 501–587 of 587
A precise 90° quadrature OTA-C VCO between 50-130 MHz
Linares-Barranco, B., Serrano‐Gotarredona, T., Ramos-Martos, J., Ceballos-Caceres, J., Mora-Gutierrez, J. M., & Linares-Barranco, A. (2004) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2004.1329060
Implementation of a masking network for speech perception
Chiueh, T., & Bu, L. (1997) · Lecture notes in computer science · doi:10.1007/bfb0020307
Associative neural networks in analog VLSI: Advantages of decrementing algorithms
Dobson, V. G. (1991) · Lecture notes in computer science · doi:10.1007/3-540-55027-5_12
A new high-performance current-mode fuzzy membership function circuit and its application
Temel, T. (2015) · TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES · doi:10.3906/elk-1305-240
A Low-Complexity current-mode WTA circuit based on CMOS Quasi-FG Inverters
Solis, J. E. M., Solís, M., Gaspariano, L. A. S., Zolá, R., Lozano, G., Ponce-Ponce, V. H., Ocampo‐Hidalgo, J. J., Molina-Lozano, H., & Sánchez, A. D. (2011) · Americanae (AECID Library) · doi:10.13053/cys-14-3-1272
Poikonen, J. H., & Paasio, A. (2006) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2006.1693441
A neural algorithm incorporating winner‐take‐all subnets for combinatorial optimization
Urahama, K. (1993) · Systems and Computers in Japan · doi:10.1002/scj.4690240609
Event recognition hardware based on neuron MOS soft-computing circuits
Shibata, T., Yamashita, Y., Konda, M., Morimoto, T., & Ohmi, T. (1997) · Computers & Electrical Engineering · doi:10.1016/s0045-7906(97)00028-1
A Current-Mirror Winner-Take-All Sense Amplifier for Low Voltage SRAMs
Jia, S., Xu, H., Fengfeng, W. U., & Wang, Y. (2013) · IEICE Transactions on Electronics · doi:10.1587/transele.e96.c.1205
Soft-max circuit design with adjustable gain
Piombo, D., & Zunino, R. (2006) · IEE Proceedings - Circuits Devices and Systems · doi:10.1049/ip-cds:20050105
Four Bit Priority Resolution Network Using Current Mode Winner Take all Circuit
Cao, W. Q., Zhu, H. Y., & Tu, G. (2014) · Advanced materials research · doi:10.4028/www.scientific.net/amr.889-890.886
SSCS DL Boris Murmann and SSCS-Utah SDC Winner Speak at Spring Seminar in Boise [People]
Noall, S. (2013) · IEEE Solid-State Circuits Magazine · doi:10.1109/mssc.2013.2264882
Mixed-mode simulation of optical-based systems: PSD application
Doldán, R., Peralías, E., Yúfera, A., & Rueda, A. (2005) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.608209
Association hardware for intelligent electronic systems
Ohmi, T., Shibata, T., Kotani, K., Nakai, T., Nakada, A., Yu, N. M., Konda, M., Morimoto, T., & Yamashita, Y. (1999) · Systems and Computers in Japan · doi:10.1002/(sici)1520-684x(19991115)30:12<25::aid-scj3>3.3.co;2-r
Precise 90° quadrature current-controlled oscillator tunable between 50–130 MHz
Linares-Barranco, B., Serrano‐Gotarredona, T., Ramos-Martos, J., Ceballos-Caceres, J., Mora-Gutierrez, J. M., & Linares-Barranco, A. (2003) · Electronics Letters · doi:10.1049/el:20030558
A path searching method based on circuit analysis for nonlinear resistive networks
Sato, M., Aomori, H., & Tanaka, M. (2007) · European Conference on Circuit Theory and Design · doi:10.1109/ecctd.2007.4529734
Data compression at low power using soft competitive learning
McNeill, D. K., & CARD, H. C. (2002) · IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM) · doi:10.1109/pacrim.1995.519578
CMOS Photodetector Array For Sequential Peak Location
Turner, R. M., & Johnson, K. M. (2005) · IEEE/LEOS Summer Topical Meetings · doi:10.1109/leosst.1994.700464
Examples of Optoelectronic Integrated Circuits
Zimmermann, H. (2009) · Springer series in optical sciences/SPringer series in optical sciences · doi:10.1007/978-3-642-01521-2_12
Analog current-mode design for soft-max computation
Piombo, D., & Zunino, R. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2005.1555931
Low complexity CMOS competitive array for approaching assignments
Castañeda, F. G., Flores-Nava, L. M., & Moreno-Cadenas, J. A. (2002) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.1998.703940
An encoder for vector quantization neural networks
Ancona, F., Rovetta, S., & Zunino, R. (2005) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.1997.662316
Neuron-MOS continuous-time winner-take-all circuit for intelligent data processing
Morimoto, T., Shibata, T., & Ohmi, T. (2002) · International Conference on Knowledge-Based Intelligent Electronic Systems (KES) · doi:10.1109/kes.1998.726005
Integrated circuit for Hamming neural net
Gomez-Castaneda, F., & Moreno-Cadenas, J. A. (2002) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.1994.519291
Flexible video compression systems using an analog vector quantization chip
Rovetta, S., & Zunino, R. (1999) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1999.758305
Electronic neural network for dynamic resource allocation
Thakoor, A. P., Eberhardt, S. P., & Daud, T. (1991) · AIAA Computers in Aerospace Conference · doi:10.2514/6.1991-3755
Neuromorphic Systems For Industrial Applications
Indiveri, G. (2013)
RANK-ORDER Fi'ILTERING IN ANALOG VLSI
Wilson, D. M., & DeWeerth, S. P. (1996)
New methods for triangulation-based shape acquisition using laser scanners
Salví, J., & Cabruja, E. (2004)
Tomatsopoulos, B., & Demosthenous, A. (2003) · UCL Discovery (University College London)
Low-power current-mode circuits
Sarpeshkar, R. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511841446.014
Biologically-Inspired Learning and Intelligence
Temel, T. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-018-1.ch009
Turner, R., Jared, D. A., Sharp, G. D., & Johnson, K. M. (2005) · IEEE/LEOS Summer Topical Meetings · doi:10.1109/leosst.1992.697482
Study of model consistency for a subthreshold mos winner-take-all circuit
Bucata, V., & Iordache, M. (2016) · International Conference on Applied and Theoretical Electricity · doi:10.1109/icate.2016.7754706
Morphological learning for spiking neurons with nonlinear active dendrites
Shaista, H. (2016) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/69184
A Neural Network Classifier for the 11000 OCR Chip
Platt, J. C., & Allen, T. P. (1992)
Overcoming the Circuit Design Challenges In Nanoscale SRAMs
Elakkumanan, P. (2006) · Dissertations & Theses @ SUNY Buffalo,ProQuest Dissertations & Theses Global
A model of neurobiologically plausible least-squares learning in visual cortex
Bagchi, S., & McDonnell, M. D. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489725
CMOS Analog Integrated Circuit for Competitive Neural Array.
Gomez-Castaneda, F., Flores-Nava, L. M., & Moreno-Cadenas, J. A. (1997) · International Conference on Neural Information Processing
Sufficient Conditions for an Analog Maximum Rank Selector to Operate Fully in Weak Inversion
Costea, R. L., & Marinov, C. A. (2019) · International Symposium on Signals, Circuits and Systems · doi:10.1109/isscs.2019.8801752
Cognitive Trading System ModelPreprint
Parrondo, R. M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3450470
Work modes of impulse k-winners-take-all neural network
Tymoshchuk, P. V. (2018) · Computer systems and network · doi:10.23939/csn2018.905.125
Keeping the subthreshold all along the transients. The WTA unbounded domain case
Costea, R. L., & Marinov, C. A. (2020) · International Symposium on Electronics and Telecommunications (ISETC) · doi:10.1109/isetc50328.2020.9301049
Examples of Optoelectronic Integrated Circuits
Zimmermann, H. (2018) · Springer series in advanced microelectronics · doi:10.1007/978-3-030-05822-7_6
Umano, M., Baldwin, J. M., Martin, T., Pilsworth, B., Petry, F. E., Jani, Y., Lea, R., von Altrock, C., Rovatti, R., Manaresi, N., et al. (1998) · Taylor & Francis eBooks · doi:10.1201/9781420050394.pte
Analog VLSI Excitatory Feedback Circuits for Attentional Shifts and Tracking
Morris, T. G., & DeWeerth, S. P. (2007) · Springer eBooks · doi:10.1007/978-0-585-28001-1_6
A real-time clustering microchip neural engine
(1997) · Microelectronics Reliability · doi:10.1016/s0026-2714(97)82523-1
Analog/Mixed-Signal Classification for Voice Activity Detection
Kurrey, P., Kavishwar, M., & Zele, R. H. (2022) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs202256217.2022.9971057
Histopathological Image Classification Methods and Techniques in Deep Learning Field
Rani, S., & Kumar, M. J. (2022) · International Journal on Recent and Innovation Trends in Computing and Communication · doi:10.17762/ijritcc.v10i2s.5923
Kane, J. S., & Kincaid, T. G. (1993) · Annual Meeting Optical Society of America · doi:10.1364/oam.1993.wg.4
VLSI/Liquid Crystal Winner-Take-All Modulators for Optical Competitive Learning
Slagle, T. M., & Wagner, K. H. (1993) · Spatial Light Modulators and Applications · doi:10.1364/slma.1993.smd.3
Alimisis, V., Strakosi, L., Gennis, G., Eleftheriou, N. P., Dimas, C., & Sotiriadis, P. P. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573763
Passive Protocol Based on Memristors for Lightweight Authentication with PUF
Mitchell-Moreno, J. H., Flores‐Verdad, G. E., & Sarmiento-Reyes, A. (2023) · IEEE International Conference on Engineering Veracruz (ICEV) · doi:10.1109/icev59168.2023.10329629
Alimisis, V., Eleftheriou, N. P., Leventikidis, S., & Sotiriadis, P. P. (2023) · doi:10.1109/icm60448.2023.10378896
Alimisis, V., Eleftheriou, N. P., & Sotiriadis, P. P. (2023) · doi:10.1109/icm60448.2023.10378893
A Low-Power Analog Bell-Shaped Classifier Based on Parallel-Connected Gaussian Function Circuits
Alimisis, V., Kamperi, A., Eleftheriou, N. P., & Sotiriadis, P. P. (2024) · Frontiers of artificial intelligence, ethics and multidisciplinary applications. · doi:10.1007/978-981-99-9836-4_34
An Analog Hardware Classifier for Estimating Sea State or Wave Height from Inertial Sensor Data
Alimisis, V., Eleftheriou, N. P., Georgousis, G., & Sotiriadis, P. P. (2024) · Panhellenic Conference on Electronics & Telecommunications (PACET) · doi:10.1109/pacet60398.2024.10497002
An Analog MP3 Compression Psychoacoustic Model Implemented on a Field-Programmable Analog Array
Liu, L., Hasler, J., & Mathews, P. O. (2024) · Electronics · doi:10.3390/electronics13142691
A 93nW, Analog, Parallel-Connected Threshold Classifier for Epileptic Seizure Prediction
Alimisis, V., Kamperi, A., Eleftheriou, N. P., & Sotiriadis, P. P. (2023) · International Workshop on Cellular Nanoscale Networks and their Applications (CNNA) · doi:10.1109/cnna60945.2023.10652765
Pandey, P. K., & Bhuvan, B. (2024) · IEEE International Symposium on Smart Electronic Systems (iSES) · doi:10.1109/ises63344.2024.00021
Low-Power High-Speed Neuromorphic Integrated Circuits
Kumar, R., & Nagar, B. C. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-8084-0.ch008
A Cuff-Less Blood Pressure Estimation System Based on Low-Power Analog Integrated Neural Network
Alimisis, V., Mylona, A., Cheliotis, K., Moustakas, V., Foufas, Z., & Sotiriadis, P. P. (2025) · International Conference on Modern Circuits and Systems Technologies · doi:10.1109/mocast65744.2025.11083960
Alimisis, V., Sidani, M. M. E., Younes, R., Cheliotis, K., Sotiriadis, P. P., Possik, J., Yaacoub, C., & Daou, R. A. Z. (2025) · International Conference on Advances in Computational Tools for Engineering Applications · doi:10.1109/actea66485.2025.11189939
A Power-Efficient Analog Hardware Neural Network for Hand Gesture Recognition
Mylona, A., Alimisis, V., & Sotiriadis, P. P. (2025) · International Conference on Advances in Biomedical Engineering (ICABME) · doi:10.1109/icabme66883.2025.11211716
Improving time-domain winner-take-all circuit for neuromorphic computing systems
Truong, S. N., & Ngo, T. T. (2025) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v15i6.pp5173-5182
Butler-Matrix Beamspace Front-Ends for Massive MIMO: Architecture, Loss Budget, and Capacity Impact
Vico, F., Monserrat, J. F., & Ge, Y. (2025) · Sensors · doi:10.3390/s25237170
An Analog Hardware Squarer-Based Edge Detector for Breast Cancer
Mylona, A., Alimisis, V., & Sotiriadis, P. P. (2025) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs66544.2025.11270589
A Fast Distributed Algorithm for Uniform Price Auction with Bidding Information Protection
Sum, J., Leung, C.-S., & Chang, J. C. C. (2025) · Computation · doi:10.3390/computation13120294
Circuit technologies for VLSI associative processors
小川, 誠. (2005) · Institutional Repositories DataBase (IRDB) · doi:10.15083/00009194
Papathanasiou, A., Mylona, A., Alimisis, V., & Sotiriadis, P. P. (2025) · doi:10.1109/icm66518.2025.11322466
A current-mode, low-power, area-efficient analog-hardware squarer-based edge detector
Alimisis, V., Cheliotis, K., Mylona, A., Foufas, Z., Moustakas, V., & Sotiriadis, P. P. (2026) · Analog Integrated Circuits and Signal Processing · doi:10.1007/s10470-026-02557-7
A Hypertension Prediction System Based On Low-Power Analog Hardware Neural Network
Alimisis, V., Mylona, A., Papathanasiou, A., Moustakas, V., & Sotiriadis, P. P. (2025) · International Conference on Computer and Applications (ICCA) · doi:10.1109/icca66035.2025.11430967
Développement d'un réseau de neurones impulsionnels sur silicium à synapses memristives
Lecerf, G. (2014) · theses.fr (ABES) · doi:10.70675/e3684dd2zbbd0z440bza4bbz59a5ef8682bf
Bayesian neuromorphic computing based on resistive memory
Dalgaty, T. (2020) · theses.fr (ABES) · doi:10.70675/e5b4f3e2z44a5z4c41zbac6z4c933e86b101 · Cited by 1
Event-based Image Sensor for low-power
Akrarai, M. (2023) · theses.fr (ABES) · doi:10.70675/d6903b60zb619z4f2fz8eb7zd05358c8787b
An Analog Edge Detector Based on a Hardware-Friendly Difference of Gaussians Method
Papadopoulos, C., Papathanasiou, A., Alimisis, V., Moustakas, V., Daou, R. A. Z., & Sotiriadis, P. P. (2026) · IEEE International Multidisciplinary Conference on Engineering Technology (IMCET) · doi:10.1109/imcet69180.2026.11503765
An Analog Integrated, Low-Power Decision Tree Classifier Architecture for Heart Attack Detection
Alimisis, V., Papathanasiou, A., Mylona, A., Moustakas, V., Majumder, A., Daou, R. A. Z., & Sotiriadis, P. P. (2026) · IEEE International Multidisciplinary Conference on Engineering Technology (IMCET) · doi:10.1109/imcet69180.2026.11503772
On the Viability of End-to-End Neural Networks in the Analog Domain
Ige, A., Ayyappan, P. R., & Hasler, J. (2026) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2026.3703087
Accelerating Analog Test through Firmware-Hardware Driven Parallelism
Madabhushi, K. P., Jain, A., Pukett, L., Jahner, W., & Hag, E. (2026) · IEEE VLSI Test Symposium (VTS) · doi:10.1109/vts69484.2026.11563343
Dimas, C., Alimisis, V., Papathanasiou, A., Papa, D., Fragulis, G. F., & Sotiriadis, P. P. (2026) · International Conference on Modern Circuits and Systems Technologies · doi:10.1109/mocast70204.2026.11626440
Alimisis, V., Serlis, E. A., Gennis, G., & Sotiriadis, P. P. (2026) · Analog Integrated Circuits and Signal Processing · doi:10.1007/s10470-026-02635-w
Memristive in-Memory Computing Circuit for Solving Assignment Problems
Gomez-Castaneda, F., Flores-Nava, L. M., Salgado-Solano, L. E., Arellano-Cardenas, O., Hernández-Gutiérrez, C. A., & Tornez-Xavier, G. M. (2026) · International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE) · doi:10.1109/cce72160.2026.11734958
Implementation of neural gas training in analog VLSI
Ancona, F., Rovetta, S., & Zunino, R. (1997) · IOS Press eBooks
AFAN — A Tool for the Automatic Design of Digital and Analog Neuro-Fuzzy Controllers
Carvajal, R. G., Echanove, M. Á. A., Silgado, A. J. T., & Franquelo, L. G. (1998) · Springer eBooks · doi:10.1007/978-1-4615-4090-8_4
Analog VLSI Neural Learning Circuits — A Tutorial
CARD, H. C. (1994) · Springer eBooks · doi:10.1007/978-1-4899-1331-9_1
Metadata
- Authors
- Lazzaro, J., Ryckebusch, S., Mahowald, M. A., & Mead, C. A.
- Affiliations
- California Institute of Technology (US)
- Publisher
- Defense Technical Information Center
- Published
- 1988-01-01
- OpenAlex
- W2139016795
- Cited by
- 582
- References
- 3
- Citations by year
- 2026: 10 · 2025: 24 · 2024: 16 · 2023: 24 · 2022: 24 · 2021: 6 · 2020: 8 · 2019: 13 · 2018: 13 · 2017: 11 · 2016: 18 · 2015: 14 · 2014: 18 · 2013: 21 · 2012: 4
- Type
- report
- Language
- en
- Open access
- closed
- Locations
- CaltechAUTHORS (California Institute of Technology) (submittedVersion)
- Defense Technical Information Center (DTIC) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency
- Office of Naval Research
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Analog and Mixed-Signal Circuit Design
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- winner-take-all circuit, CMOS integrated circuit, analog neural circuits, sound localization, feature space representation, linear time complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.