The DOI matches its Crossref record; 52 of the 54 references it cites were found in a registry or an index.
Forward Models: Supervised Learning with a Distal Teacher
Abstract
Internal models of the environment have an important role to play in adaptive systems, in general, and are of particular importance for the supervised learning paradigm. In this article we demonstrate that certain classical problems associated with the notion of the “teacher” in supervised learning can be solved by judicious use of learned internal models as components of the adaptive system. In particular, we show how supervised learning algorithms can be utilized in cases in which an unknown dynamical system intervenes between actions and desired outcomes. Our approach applies to any supervised learning algorithm that is capable of learning in multilayer networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In turn, sensory prediction errors are used to control movements online, cancel sensory reafference due to self-generated movement, perform state estimation, guide motor learning, and update the forward model (Jordan and Rumelhart, 1992; Miall et al., 1993; Wolpert et al., 1995; Doya, 1999; Shadmehr et al., 2010).”
From Cerebellum, Predictions and Errors (2019) · cites this paper as Jordan and Rumelhart, 1992
In the citing paper
“With the motor command and current sensory information as its inputs, a forward internal model predicts the consequences of motor actions (Jordan and Rumelhart, 1992; Miall et al., 1993; Miall and Wolpert, 1996).”
From Cerebellum, Predictions and Errors (2019) · cites this paper as Jordan and Rumelhart, 1992
Citations
Cites
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
Self-citationParallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Self-citationSelf-organized formation of topologically correct feature maps
Kohonen, T. (1982) · Biological Cybernetics · doi:10.1007/bf00337288 · Cited by 9,529
Identification and control of dynamical systems using neural networks
Narendra, K. S., & Parthasarathy, K. (1990) · IEEE Transactions on Neural Networks · doi:10.1109/72.80202 · Cited by 8,158
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
(1991) · Springer eBooks · doi:10.1007/978-3-7091-2840-4 · Cited by 5,092
Adaptive filtering, prediction and control
Ioannou, P. (1985) · Automatica · doi:10.1016/0005-1098(85)90014-7 · Cited by 4,465
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Theory and Practice of Recursive Identification
Lennart Ljung, A., & Söderström, T. (1983) · Lund University Publications (Lund University) · Cited by 3,989
Kirk, D. E. (1970) · Cited by 3,804
Adaptive filtering prediction and control
Goodwin, G. C., & Sin, K. S. (1984) · Cited by 3,400
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,325
McClelland, J. L., Rumelhart, D. E., & AU (1987) · doi:10.7551/mitpress/5237.001.0001 · Cited by 3,315
Self-citationAdvances in Neural Information Processing Systems 37
Touretzky, D. S. (2024) · doi:10.52202/079017 · Cited by 2,874
Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789
Beyond regression : new fools for prediction and analysis in the behavioral sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,739
Alexander, S. T. (1986) · Springer eBooks · doi:10.1007/978-1-4612-4978-8 · Cited by 2,651
Mullin, A., & Rosenblatt, F. F. (1963) · American Mathematical Monthly · doi:10.2307/2312103 · Cited by 2,211
McKerrow, P. J. (1991) · Medical Entomology and Zoology · Cited by 1,731
A hierarchical neural-network model for control and learning of voluntary movement
Kawato, M., Furukawa, K., & Suzuki, R. (1987) · Biological Cybernetics · doi:10.1007/bf00364149 · Cited by 1,573
Self-organization in a perceptual network
Linsker, R. (1988) · Computer · doi:10.1109/2.36 · Cited by 1,473
Competitive learning: From interactive activation to adaptive resonance
Grossberg, S. (1987) · Cognitive Science · doi:10.1111/j.1551-6708.1987.tb00862.x · Cited by 1,471
The Foundations of Cognitive Science
(1989) · The MIT Press eBooks · doi:10.7551/mitpress/3072.001.0001 · Cited by 1,452
Sutton, R. S. (1990) · Elsevier eBooks · doi:10.1016/b978-1-55860-141-3.50030-4 · Cited by 1,381
An organizing principle for a class of voluntary movements
Hogan, N. (1984) · Journal of Neuroscience · doi:10.1523/jneurosci.04-11-02745.1984 · Cited by 1,349
Serial Order: A Parallel Distributed Processing Approach
Jordan, M. I. (1997) · Advances in psychology · doi:10.1016/s0166-4115(97)80111-2 · Cited by 1,308
Self-citationLearning and relearning in Boltzmann machines
Hinton, G. E., & Sejnowski, T. J. (2001) · Graphical Models · doi:10.7551/mitpress/3349.003.0005 · Cited by 1,037
(1991) · The MIT Press eBooks · doi:10.7551/mitpress/4939.001.0001 · Cited by 871
Temporal credit assignment in reinforcement learning
Sutton, R. S. (1984) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 749
Schemata and Sequential Thought Processes in PDP Models
Rumelhart, D. E., Smolensky, P., McClelland, J. L., & Hinton, G. E. (1988) · Elsevier eBooks · doi:10.1016/b978-1-4832-1446-7.50020-0 · Cited by 665
Self-citationHadley, G. F., & Kemp, M. C. (1971) · Elsevier eBooks · doi:10.1016/b978-0-7204-3601-3.50008-8 · Cited by 498
Foundations of Cognitive Science
Garnham, A. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90025-6 · Cited by 469
The truck backer-upper: an example of self-learning in neural networks
Nguyen, & Widrow (1989) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1989.118723 · Cited by 449
Eysenck, M. W., & Keane, M. T. (2020) · Psychology Press eBooks · doi:10.4324/9781351058513-6 · Cited by 395
Carlson, A. (1968) · Virtual Defense Library (Ministerio de Defensa) · Cited by 383
Neural Model of Adaptive Hand-Eye Coordination for Single Postures
Kuperstein, M. (1988) · Science · doi:10.1126/science.3344437 · Cited by 342
Sensor-based control of robotic manipulators using a general learning algorithm
Miller, W. (1987) · IEEE Journal on Robotics and Automation · doi:10.1109/jra.1987.1087081 · Cited by 307
Theory and practice of recursive identification
Dumortier, F. A. G. (1985) · Automatica · doi:10.1016/0005-1098(85)90088-3 · Cited by 293
Werbos, P. J. (1987) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1987.289329 · Cited by 249
Mergler, H. W. (1986) · Proceedings of the IEEE · doi:10.1109/proc.1986.13656 · Cited by 182
(1986) · Ophthalmology · doi:10.1016/s0161-6420(86)33832-6 · Cited by 181
Motor Learning and the Degrees of Freedom Problem
Jordan, M. I. (2018) · Psychology Press eBooks · doi:10.4324/9780203772010-29 · Cited by 140
Self-citationKawato, M. (1990) · The MIT Press eBooks · Cited by 112
Feature discovery by competitive learning
Rumelhart, D. E., & Zipser, D. (1986) · Defense Technical Information Center (DTIC) · Cited by 110
Self-citationAn on-line algorithm for dynamic reinforcement learning and planning in reactive environments
Schmidhuber, J. (1990) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1990.137723 · Cited by 95
Learning to Control an Unstable System with Forward Modeling
Jordan, M. I., & Jacobs, R. A. (1989) · Cited by 86
Self-citationUsing Associative Content-Addressable Memories to Control Robots
Atkeson, C. G., & Reinkensmeyer, D. J. (1991) · The MIT Press eBooks · doi:10.1109/cdc.1988.194418 · Cited by 82
Constrained supervised learning
Jordan, M. I. (1992) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(92)90029-7 · Cited by 57
Self-citation(1987) · Cited by 47
Discovering the Structure of a Reactive Environment by Exploration
Mozer, M. C., & Bachrach, J. R. (1990) · Neural Computation · doi:10.1162/neco.1990.2.4.447 · Cited by 37
Spatial coherence as an internal teacher for a neural network
Becker, S., & Hinton, G. E. (1995) · Cited by 24
From Chemotaxis to cooperativity: abstract exercises in neuronal learning strategies
Barto, A. G. (1989) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 14
Research works printed but not linked: 12
- Barto A.G., 1989, The computing neurone
- Gelfand I.M., 1963, Calculus of variations
- Hinton G.E., 1986, Parallel distributed processing
- Jordan M.I., 1983, Mental practice
- LeCun Y., 1985, Learning scheme for asymmetric threshold networks, Proceedings of Cognitiva, 85
- LeCun Y., 1987, Modéles connexionnistes de I'apprentissage
- Mozer M.C., 1990, Advances in neural information processing systems
- Munro P., 1987, Proceedings of the Ninth Conference of the Cognitive Science Society
- Parker D., 1985, Learning logic
- Robinson A.J., 1989, Proceedings of Neural Information Systems
- Rumelhart D.E., 1986, Parallel distributed processing, 10.7551/mitpress/5236.001.0001 · DOI · Paper page
- Rumelhart D.E., 1986, Parallel distributed processing, 10.7551/mitpress/5236.001.0001 · DOI · Paper page
Cited by
Sorted by citations
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
Introduction to the theory of neural computation
Hertz, J., Krogh, A., & Palmer, R. G. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,410
An internal model for sensorimotor integration
Wolpert, D. M., Ghahramani, Z., & Jordan, M. I. (1995) · Science · doi:10.1126/science.7569931 · Cited by 3,553
Self-citationUnderstanding normal and impaired word reading: Computational principles in quasi-regular domains.
Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996) · Psychological Review · doi:10.1037/0033-295x.103.1.56 · Cited by 2,698
Internal models for motor control and trajectory planning.
Kawato, M. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)00028-8 · Cited by 2,685
Metadata
- Authors
- Jordan, M. I., & Rumelhart, D. E.
- Affiliations
- Massachusetts Institute of Technology (US)
- Stanford University (US)
- Corresponding author
- Jordan, Michael I.
- ORCID
- Jordan, Michael I.
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 1992-07
- Volume
- 16
- Issue
- 3
- Pages
- 307-354
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2043968544
- Cited by
- 1,451
- References
- 54
- Citations by year
- 2026: 18 · 2025: 15 · 2024: 33 · 2023: 47 · 2022: 40 · 2021: 40 · 2020: 47 · 2019: 65 · 2018: 54 · 2017: 37 · 2016: 40 · 2015: 48 · 2014: 42 · 2013: 48 · 2012: 47
- FWCI
- 66.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Cognitive Science (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- forward model, internal models, supervised learning, adaptive systems, learned models, multilayer networks, dynamical systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
