Adaptive switching circuits
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The DeltaNet update rule is equivalent to performing a gradient descent step with respect to the recurrent state Φ on ||Φ k_t - v_t||^2.
“The DeltaNet update rule is equivalent to performing a gradient descent step with respect to the recurrent state Φ on || Φ k t -v t || 2 .”
From MesaNet: Sequence Modeling by Locally Optimal Test-Time Training (2025) · cites this paper as Widrow & Hoff, 1960
DeltaNet replaces additive writes with the delta rule, enabling targeted overwrite of the association addressed by the current key.
“DeltaNet replaces additive writes with the delta rule, enabling targeted overwrite of the association addressed by the current key [2, 9, 10].”
From Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention (2026) · cites this paper as [9]
DeltaNet gives the state an active edit operation: before writing v_t, the model reads the value currently associated with k_t and subtracts it from the state.
“DeltaNet instead gives the state an active edit operation [2, 9, 10]. Before writing 𝑣 𝑡 , the model reads the value currently associated with 𝑘 𝑡 and subtracts it from the state.”
From Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention (2026) · cites this paper as [9]
Cites
Still being checked.
Cited by
Sorted by citations
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
An introduction to computing with neural nets
Lippmann, R. P. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,848 · see citing works
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · see citing works
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · see citing works
Adaptive noise cancelling: Principles and applications
Widrow, B., Glover, J. R., McCool, J. M., Kaunitz, J., Williams, C. S., Hearn, R. H., Zeidler, J. R., Eugene Dong, Jr., & Goodlin, R. C. (1975) · Proceedings of the IEEE · doi:10.1109/proc.1975.10036 · Cited by 3,939 · see citing works
Self-citationSelection of relevant features and examples in machine learning
Blum, A. L., & Pat Langley, B. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00063-5 · Cited by 3,294 · see citing works
Prediction, learning, and games
Cesa-Bianchi, N., & Lugosi, G. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546921 · Cited by 4,660 · see citing works
Bobadilla, J., Ortega, F., Hernando, A., & Gutiérrez, A. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.03.012 · Cited by 3,167 · see citing works
Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Dayan, P., & Abbott, L. F. (2001) · Cited by 3,153 · see citing works
Learning internal representations by error propagation
RUMELHART, D. E., HINTON, G. E., & WILLIAMS, R. J. (1988) · Readings in Cognitive Science · doi:10.1016/b978-1-4832-1446-7.50035-2 · Cited by 3,002 · see citing works
Evolving artificial neural networks
Yao, X. (1999) · Proceedings of the IEEE · doi:10.1109/5.784219 · Cited by 2,995 · see citing works
Understanding normal and impaired word reading: Computational principles in quasi-regular domains.
Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996) · Psychological Review · doi:10.1037/0033-295x.103.1.56 · Cited by 2,698 · see citing works
Alignment by Maximization of Mutual Information
Viola, P. A., & Wells, W. M. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007958904918 · Cited by 2,610 · see citing works
Content-Based Recommendation Systems
Pazzani, M. J., & Billsus, D. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-72079-9_10 · Cited by 2,600 · see citing works
An algorithm for linearly constrained adaptive array processing
Frost, O. L. (1972) · Proceedings of the IEEE · doi:10.1109/proc.1972.8817 · Cited by 2,535 · see citing works
30 years of adaptive neural networks: perceptron, Madaline, and backpropagation
Widrow, B. C., & Lehr, M. A. (1990) · Proceedings of the IEEE · doi:10.1109/5.58323 · Cited by 2,241 · see citing works
Self-citationTheory of the backpropagation neural network
Hecht-Nielsen (1989) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1989.118638 · Cited by 2,221 · see citing works
Stochastic Gradient Descent Tricks
Bottou, L. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35289-8_25 · Cited by 2,097 · see citing works
Multi-modal volume registration by maximization of mutual information
Wells, W. M., Viola, P. A., Atsumi, H., Nakajima, S., & Kikinis, R. (1996) · Medical Image Analysis · doi:10.1016/s1361-8415(01)80004-9 · Cited by 1,961 · see citing works
Fundamentals of Adaptive Filtering
Ramirez, P. S. (2002) · Kluwer international series in engineering and computer science · doi:10.1007/978-1-4757-3637-3_2 · Cited by 1,958 · see citing works
Fading channels: information-theoretic and communications aspects
Biglieri, E., Proakis, J. G., & Shamai, S. S. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720551 · Cited by 1,932 · see citing works
Neural networks for control systems—A survey
Hunt, K. J., Sbarbaro, D. G., Żbikowski, R., & Gawthrop, P. J. (1992) · Automatica · doi:10.1016/0005-1098(92)90053-i · Cited by 1,861 · see citing works
Increased rates of convergence through learning rate adaptation
Jacobs, R. A. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90003-2 · Cited by 1,806 · see citing works
An alternative approach to linearly constrained adaptive beamforming
Griffiths, L. J., & Jim, C. (1982) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.1982.1142739 · Cited by 1,785 · see citing works
Deep learning for smart manufacturing: Methods and applications
Wang, J., Ma, Y., Zhang, L., Gao, R. X., & Wu, D. (2018) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2018.01.003 · Cited by 1,740 · see citing works
Neural Network Toolbox™ User's Guide
Beale, M. H., Hagan, M., & Demuth, H. B. (2015) · Cited by 1,643 · see citing works
Connectionist learning procedures
Hinton, G. E. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90049-0 · Cited by 1,487 · see citing works
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · see citing works
Qureshi, S. (1982) · IEEE Communications Magazine · doi:10.1109/mcom.1982.1090994 · Cited by 1,466 · see citing works
A Resource-Allocating Network for Function Interpolation
Platt, J. C. (1991) · Neural Computation · doi:10.1162/neco.1991.3.2.213 · Cited by 1,355 · see citing works
Stationary and nonstationary learning characteristics of the LMS adaptive filter
Widrow, B. C., McCool, J., Larimore, M. G., & Johnson, C. R. (1976) · Proceedings of the IEEE · doi:10.1109/proc.1976.10286 · Cited by 1,304 · see citing works
Self-citationSynaptic electronics: materials, devices and applications
Kuzum, D., Yu, S., & Wong, H. ‐. P. (2013) · Nanotechnology · doi:10.1088/0957-4484/24/38/382001 · Cited by 1,257 · see citing works
Progress in supervised neural networks
Hush, D. R., & Horne, B. G. (1993) · IEEE Signal Processing Magazine · doi:10.1109/79.180705 · Cited by 1,252 · see citing works
Serial Order: A Parallel Distributed Processing Approach
Jordan, M. I. (1997) · Advances in psychology · doi:10.1016/s0166-4115(97)80111-2 · Cited by 1,251 · see citing works
Yager, R. R. (1993) · Fuzzy Sets and Systems · doi:10.1016/0165-0114(93)90194-m · Cited by 1,245 · see citing works
From covariation to causation: A causal power theory.
Cheng, P. W. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.367 · Cited by 1,204 · see citing works
An introduction to neural computing
Kohonen, T. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90020-2 · Cited by 1,201 · see citing works
Artificial Intelligence: A New Synthesis
(1998) · Elsevier eBooks · doi:10.1016/c2009-0-27773-7 · Cited by 1,207 · see citing works
Learning and Revising User Profiles: The Identification of Interesting Web Sites
Pazzani, M. J., & Billsus, D. (1997) · Machine Learning · doi:10.1023/a:1007369909943 · Cited by 1,208 · see citing works
Stationary and Nonstationary Learning Characteristics of the LMS Adaptive Filter
Widrow, B. C., McCool, J., Larimore, M. G., & Johnson, C. R. (1977) · Springer eBooks · doi:10.1007/978-94-010-1223-2_23 · Cited by 1,195 · see citing works
Self-citationMultilabel Neural Networks with Applications to Functional Genomics and Text Categorization
Zhang, M.-L., & Zhou, Z. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.162 · Cited by 1,188 · see citing works
Characteristics of dissociable human learning systems
Shanks, D. R., & St. John, M. F. (1994) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00035032 · Cited by 1,163 · see citing works
Widrow, B. C., Mantey, P. E., Griffiths, L. J., & Goode, B. (1967) · Proceedings of the IEEE · doi:10.1109/proc.1967.6092 · Cited by 1,125 · see citing works
Self-citationAnalysis of hidden units in a layered network trained to classify sonar targets
Gorman, R. P., & B, T. J. S. A. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90023-8 · Cited by 1,116 · see citing works
Connectionist Speech Recognition: A Hybrid Approach
Bourlard, H. A., & Morgan, N. H. (1993) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,115 · see citing works
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451 · see citing works
Alignment by maximization of mutual information
Viola, P. A., & Wells, W. M. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466930 · Cited by 1,080 · see citing works
O’Reilly, R. C., & Frank, M. J. (2005) · Neural Computation · doi:10.1162/089976606775093909 · Cited by 1,066 · see citing works
Solar forecasting methods for renewable energy integration
Inman, R. H., Pedro, H. T. C., & Coimbra, C. F. M. (2013) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2013.06.002 · Cited by 1,081 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Neural Networks: A Review from a Statistical Perspective
Cheng, B., & Titterington, D. M. (1994) · Statistical Science · doi:10.1214/ss/1177010638 · Cited by 1,054 · see citing works
Inference in artificial intelligence with deep optics and photonics
Wetzstein, G., Özcan, A., Gigan, S., Fan, S., Englund, D. R., Marin Soljacic, A., Denz, C., Miller, D. A. B., & Psaltis, D. (2020) · Nature · doi:10.1038/s41586-020-2973-6 · Cited by 1,043 · see citing works
Raza, M. Q., & Khosravi, A. (2015) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2015.04.065 · Cited by 1,036 · see citing works
Hecht-Nielsen, R. (1992) · Elsevier eBooks · doi:10.1016/b978-0-12-741252-8.50010-8 · Cited by 1,003 · see citing works
Smolensky, P. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90007-m · Cited by 959 · see citing works
Elements of Artificial Neural Networks
Mehrotra, K. G., Mohan, C. K., & Ranka, S. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/2687.001.0001 · Cited by 917 · see citing works
Artificial neural networks as a tool in ecological modelling, an introduction
Lek, S., & Guégan, J. (1999) · Ecological Modelling · doi:10.1016/s0304-3800(99)00092-7 · Cited by 885 · see citing works
Estimating and interpreting the instantaneous frequency of a signal. II. Algorithms and applications
Boashash, B. (1992) · Proceedings of the IEEE · doi:10.1109/5.135378 · Cited by 888 · see citing works
Neural networks for self-learning control systems
Nguyen, D., & Widrow, B. C. (1990) · IEEE Control Systems Magazine · doi:10.1109/37.55119 · Cited by 859 · see citing works
Self-citationHong, Y. E., Hsu, K., Sorooshian, S., & Gao, X. (2004) · Journal of applied meteorology · doi:10.1175/jam2173.1 · Cited by 859 · see citing works
Stochastic Variational InferencePreprint
Hoffman, M., Blei, D. M., Wang, C., & Paisley, J. W. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.7051 · Cited by 850 · see citing works
Explorations in parallel distributed processing
McClelland, J. L. (1988) · Cited by 841 · see citing works
Reinforcement learning for robots using neural networks
Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 836 · see citing works
Frequency-domain and multirate adaptive filtering
Shynk, J. J. (1992) · IEEE Signal Processing Magazine · doi:10.1109/79.109205 · Cited by 827 · see citing works
From conditioning to category learning: An adaptive network model.
Gluck, M. A., & Bower, G. H. (1988) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.117.3.227 · Cited by 896 · see citing works
Foundations of neural networks, fuzzy systems, and knowledge engineering
Kasabov, N. K. (1997) · Choice Reviews Online · doi:10.5860/choice.35-0330 · Cited by 821 · see citing works
Fuzzy min-max neural networks. I. Classification
Simpson, P. K. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.159066 · Cited by 781 · see citing works
SUSTAIN: A Network Model of Category Learning.
Love, B. C., Medin, D. L., & Gureckis, T. M. (2004) · Psychological Review · doi:10.1037/0033-295x.111.2.309 · Cited by 778 · see citing works
Neuroevolution: from architectures to learning
Floreano, D., Dürr, P., & Mattiussi, C. (2008) · Evolutionary Intelligence · doi:10.1007/s12065-007-0002-4 · Cited by 734 · see citing works
Fast, recursive-least-squares transversal filters for adaptive filtering
Cioffi, J. M., & Kailath, T. (1984) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1984.1164334 · Cited by 732 · see citing works
Perry, C., Ziegler, J. C., & Zorzi, M. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.273 · Cited by 547 · see citing works
How Can the Human Mind Occur in the Physical Universe?
Anderson, J. R. (2007) · doi:10.1093/acprof:oso/9780195324259.001.0001 · Cited by 1,483 · see citing works
Widrow, B. C., McCool, J., & Ball, M. (1975) · Proceedings of the IEEE · doi:10.1109/proc.1975.9807 · Cited by 683 · see citing works
Self-citationUse of neural nets for dynamic modeling and control of chemical process systems
Bhat, N., & McAvoy, T. J. (1990) · Computers & Chemical Engineering · doi:10.1016/0098-1354(90)87028-n · Cited by 672 · see citing works
Inverse filtering of room acoustics
Miyoshi, M., & Kaneda, Y. (1988) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/29.1509 · Cited by 671 · see citing works
Torrieri, D. J. (1979) · doi:10.21236/ada082999 · Cited by 651 · see citing works
Computational Intelligence: An Introduction
Fulcher, J. (2008) · Studies in computational intelligence · doi:10.1007/978-3-540-78293-3_1 · Cited by 633 · see citing works
A computational model of four regions of the cerebellum based on feedback-error learning
Kawato, M., & Gomi, H. (1992) · Biological Cybernetics · doi:10.1007/bf00201431 · Cited by 627 · see citing works
Metaheuristic design of feedforward neural networks: A review of two decades of research
Ojha, V., Abraham, A., & Snåšel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 613 · see citing works
An Introductory Review of Deep Learning for Prediction Models With Big Data
Emmert‐Streib, F., Yang, Z., Han, F., Tripathi, S., & Dehmer, M. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00004 · Cited by 615 · see citing works
Identification of Dynamic Systems
Isermann, R., & Münchhof, M. (2010) · Springer eBooks · doi:10.1007/978-3-540-78879-9 · Cited by 599 · see citing works
The development of features in object concepts
Schyns, P. G., Goldstone, R. L., & Thibaut, J. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98000107 · Cited by 598 · see citing works
Sayed, A. H. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2306253 · Cited by 591 · see citing works
Syskill & webert: Identifying interesting web sites
Pazzani, M. J., Muramatsu, J., & Billsus, D. (1996) · Cited by 593 · see citing works
Incremental Subgradient Methods for Nondifferentiable Optimization
Nedić, A., & Bertsekas, D. P. (2001) · SIAM Journal on Optimization · doi:10.1137/s1052623499362111 · Cited by 590 · see citing works
Gradient calculations for dynamic recurrent neural networks: a survey
Pearlmutter, B. A. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.410363 · Cited by 578 · see citing works
Bessa, M. A., Bostanabad, R., Liu, Z., Hu, A., Apley, D. W., Brinson, L. C., Chen, W., & Liu, W. K. (2017) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2017.03.037 · Cited by 580 · see citing works
Stochastic Gradient Learning in Neural Networks
Bottou, L. (1991) · Cited by 578 · see citing works
Specht, D. F. (1990) · IEEE Transactions on Neural Networks · doi:10.1109/72.80210 · Cited by 577 · see citing works
A survey on modern trainable activation functions
Apicella, A., Donnarumma, F., Isgrò, F., & Prevete, R. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.01.026 · Cited by 585 · see citing works
Ponulak, F., & Kasiński, A. (2009) · Neural Computation · doi:10.1162/neco.2009.11-08-901 · Cited by 575 · see citing works
On-line Learning and Stochastic Approximations
Bottou, L. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511569920.003 · Cited by 585 · see citing works
Crammer, K., & Singer, Y. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0087 · Cited by 570 · see citing works
Survey on SVM and their application in image classification
Chandra, M. A., & Bedi, S. S. (2018) · International Journal of Information Technology · doi:10.1007/s41870-017-0080-1 · Cited by 569 · see citing works
Health Monitoring of Aerospace Structures
(2003) · Wiley eBooks · doi:10.1002/0470092866 · Cited by 556 · see citing works
Learning to trade via direct reinforcement
Moody, J. E., & Saffell, M. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.935097 · Cited by 555 · see citing works
On recent advances in PV output power forecast
Raza, M. Q., Nadarajah, M., & Ekanayake, C. (2016) · Solar Energy · doi:10.1016/j.solener.2016.06.073 · Cited by 544 · see citing works
Information fusion for wireless sensor networks
Nakamura, E. F., Loureiro, A. A. F., & Frery, A. C. (2007) · ACM Computing Surveys · doi:10.1145/1267070.1267073 · Cited by 537 · see citing works
- Authors
- WIDROW, B., & HOFF, M. E.
- Publisher
- Defense Technical Information Center
- Published
- 1960-06-30
- OpenAlex
- W1535810436
- Cited by
- 4,009
- References
- 0
- Citations by year
- 2026: 33 · 2025: 59 · 2024: 94 · 2023: 118 · 2022: 122 · 2021: 127 · 2020: 147 · 2019: 124 · 2018: 117 · 2017: 115 · 2016: 88 · 2015: 118 · 2014: 126 · 2013: 121 · 2012: 95
- Type
- report
- Language
- en
- Open access
- closed
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Analog and Mixed-Signal Circuit Design
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › VLSI and FPGA Design Techniques
- Keywords
- switching circuits, adaptive circuits
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
