The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Learning to perceive and act by trial and error
Open accessOverview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, sensations from the world are aliased (10, 11) and do not convey locations directly.”
From Space is a latent sequence: A theory of the hippocampus (2024) · cites this paper as [10]
Citations
Cites
Adaptation in Natural and Artificial Systems
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,340
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
The Ecological Approach to Visual Perception: Classic Edition
Gibson, J. J. (2014) · doi:10.4324/9781315740218 · Cited by 12,132
A robust layered control system for a mobile robot
Brooks, R. (1986) · IEEE Journal on Robotics and Automation · doi:10.1109/jra.1986.1087032 · Cited by 7,799
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,674
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,325
Advances in Neural Information Processing Systems 37
Touretzky, D. S. (2024) · doi:10.52202/079017 · Cited by 2,874
The Ecological Approach To Visual Perception
Gibson, J. J. (2013) · Psychology Press eBooks · doi:10.4324/9780203767764 · Cited by 2,622
Induction: Processes of Inference, Learning, and Discovery
Holland, J. H., Holyoak, K. J., Nisbett, R. E., Thagard, P. R., & Smoliar, S. W. (1987) · IEEE Expert · doi:10.1109/mex.1987.4307100 · Cited by 2,305
A New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)
Albus, J. S. (1975) · Journal of Dynamic Systems, Measurement, and Control · doi:10.1115/1.3426922 · Cited by 2,177
Holland, J. H., Holyoak, K. J., Nisbett, R. E., & Thagard, P. R. (1986) · The MIT Press eBooks · doi:10.7551/mitpress/3729.001.0001 · Cited by 1,534
Sutton, R. S. (1990) · Elsevier eBooks · doi:10.1016/b978-1-55860-141-3.50030-4 · Cited by 1,381
Dynamic Programming: Deterministic and Stochastic Models
Bertsekas, D. P. (1987) · Medical Entomology and Zoology · Cited by 1,348
Introduction to Stochastic Dynamic Programming.
Berry, D. A., & Ross, S. M. (1986) · Journal of the American Statistical Association · doi:10.2307/2289262 · Cited by 1,130
(2012) · Springer eBooks · doi:10.1007/springerreference_117344 · Cited by 1,050
Ullman, S. (1984) · Cognition · doi:10.1016/0010-0277(84)90023-4 · Cited by 1,045
Learning and executing generalized robot plans
Fikes, R. E., Hart, P. E., & Nilsson, N. J. (1972) · Artificial Intelligence · doi:10.1016/0004-3702(72)90051-3 · Cited by 1,025
Reactive reasoning and planning
Georgeff, M., & Lansky, A. (1987) · National Conference on Artificial Intelligence · Cited by 888
Networks and the best approximation property
Girosi, F., & Poggio, T. (1990) · Biological Cybernetics · doi:10.1007/bf00195855 · Cited by 887
(1991) · The MIT Press eBooks · doi:10.7551/mitpress/4939.001.0001 · Cited by 871
Pengi: an implementation of a theory of activity
Agre, P. E., & Chapman, D. (1987) · National Conference on Artificial Intelligence · Cited by 867
Temporal credit assignment in reinforcement learning
Sutton, R. S. (1984) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 749
Toward a mathematical theory of inductive inference
Blum, L., & Blum, M. (1975) · Information and Control · doi:10.1016/s0019-9958(75)90261-2 · Cited by 662
Automatic programming of behavior-based robots using reinforcement learning
Mahadevan, S., & Connell, J. H. (1992) · Artificial Intelligence · doi:10.1016/0004-3702(92)90058-6 · Cited by 583
Müller, B., & Reinhardt, J. (1990) · Physics of neural networks · doi:10.1007/978-3-642-97239-3 · Cited by 543
Chunking in Soar: The Anatomy of a General Learning Mechanism
Laird, J. E., Rosenbloom, P. S., & Newell, A. (1986) · Machine Learning · doi:10.1023/a:1022639103969 · Cited by 509
Universal plans for reactive robots in unpredictable environments
Schoppers, M. (1987) · Cited by 473
An investigation into reactive planning in complex domains
Firby, R. J. (1987) · National Conference on Artificial Intelligence · Cited by 470
Albus, J. S. (1981) · DigitalGeorgetown (Georgetown University Library) · Cited by 448
Holland, J. H. (1986) · American Association for Artificial Intelligence eBooks · Cited by 407
Proceedings of the Ninth International Joint Conference on Artificial Intelligence - 1985
Bundy, A., & Clutterbuck, R. (1985) · Cited by 382
Credit Assignment in Rule Discovery Systems Based on Genetic Algorithms
Grefenstette, J. J. (1988) · Machine Learning · doi:10.1007/bf00113898 · Cited by 356
Learning and Sequential Decision Making
Barto, A. G., Sutton, R. S., & Watkins, C. (1989) · Cited by 349
Chunking in Soar: The anatomy of a general learning mechanism
Laird, J. E., Rosenbloom, P. S., & Newell, A. (1986) · Machine Learning · doi:10.1007/bf00116249 · Cited by 287
The Dynamic Structure of Everyday Life
Agre, P. E. (1988) · Defense Technical Information Center (DTIC) · Cited by 267
Learning Sequential Decision Rules Using Simulation Models and Competition
Grefenstette, J. J., Ramsey, C. L., & Schultz, A. C. (1990) · Machine Learning · doi:10.1023/a:1022677607120 · Cited by 266
Classifier Systems and the Animat Problem
Wilson, S. W. (1987) · Machine Learning · doi:10.1023/a:1022655214215 · Cited by 264
Machine learning: an artificial intelligence approach volume III
Kodratoff, Y., & Michalski, R. S. (1990) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 253
Intelligent behavior as an adaptation to the task environment
Booker, L. B. (1982) · Deep Blue (University of Michigan) · Cited by 177
Landmark learning: An illustration of associative search
Barto, A. G., & Sutton, R. S. (1981) · Biological Cybernetics · doi:10.1007/bf00335152 · Cited by 150
Universal planning: an (almost) universally bad idea
Ginsberg, M. L. (1989) · doi:10.1609/aimag.v10i4.964 · Cited by 145
Proceedings of the seventh international conference (1990) on Machine learning
Morgan, M. B. (1990) · Cited by 142
Reference frames for animate vision
Ballard, D. H. (1989) · International Joint Conference on Artificial Intelligence · Cited by 139
Self-citationLearning and Problem Solving with Multilayer Connectionist Systems
Anderson, C. W. (1986) · Cited by 110
Drummond, M. (1989) · Cited by 100
Introduction to stochastic dynamic programming
Ross, S. M., Birnbaum, Z. W., & Lukacs, E. (1983) · Cited by 97
Chapman, D. (1989) · AI Magazine · doi:10.1609/aimag.v10i4.965 · Cited by 67
First Results with Dyna, an Integrated Architecture for Learning, Planning and Reacting
Sutton, R. S. (1991) · The MIT Press eBooks · doi:10.7551/mitpress/4939.003.0012 · Cited by 65
Sequential Decision Problems and Neural Networks
Barto, A. G., Sutton, R. S., & Watkins, C. (1989) · neural information processing systems · Cited by 60
Representation and Automatic Synthesis of Reaction Plans
Schoppers, M. (1989) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · doi:10.13140/rg.2.2.12084.07040 · Cited by 54
INCREMENTAL LEARNING OF CONTROL STRATEGIES WITH GENETIC ALGORITHMS
Grefenstette, J. J. (1989) · Elsevier eBooks · doi:10.1016/b978-1-55860-036-2.50087-4 · Cited by 39
Refinement of robot motor skills through reinforcement learning
Franklin, J. A. (2003) · Proceedings of the IEEE Conference on Decision & Control, including the Symposium on Adaptive Processes · doi:10.1109/cdc.1988.194487 · Cited by 34
Explaining temporal differences to create useful concepts for evaluating states
Yee, R. C., Saxena, S., Utgoff, P. E., & Barto, A. G. (1990) · Cited by 26
A Role for Anticipation in Reactive Systems that Learn
Whitehead, S. D., & Ballard, D. H. (1989) · Elsevier eBooks · doi:10.1016/b978-1-55860-036-2.50090-4 · Cited by 26
Self-citationBlythe, J., & Mitchell, T. M. (1989) · Elsevier eBooks · doi:10.1016/b978-1-55860-036-2.50073-4 · Cited by 26
Ramsey, C. L., Schultz, A. C., & Grefenstette, J. J. (1990) · Elsevier eBooks · doi:10.1016/b978-1-55860-141-3.50029-8 · Cited by 25
Explanations of Empirically Derived Reactive Plans
Gordon, D. F., & Grefenstette, J. J. (1990) · Elsevier eBooks · doi:10.1016/b978-1-55860-141-3.50027-4 · Cited by 22
A Self-organizing Associative Memory System for Control Applications
Hormel, M. (1989) · neural information processing systems · Cited by 18
A Formal Framework for Learning in Embedded Systems
Kaelbling, L. P. (1989) · Elsevier eBooks · doi:10.1016/b978-1-55860-036-2.50089-8 · Cited by 13
Some experiments in adaptive state-space robotics
Clocksin, W. F., & Moore, A. W. (1989) · Artificial Intelligence and the Simulation of Behaviour · Cited by 9
Visual Routines: Where Bottom-Up and Top-Down Processing Meet
Ullman, S. (1986) · Elsevier eBooks · doi:10.1016/b978-0-12-631402-1.50011-9 · Cited by 6
Reactive behavior, learning, and anticipation
Whitehead, S. D., & Ballard, D. H. (1989) · NASA STI Repository (National Aeronautics and Space Administration) · Cited by 5
Self-citation
Research works printed but not linked: 5
- Anderson, C. W. (1989). Towers of hanoi with connectionist networks: Learning new features. Proceedings of the Sixth International Conference on Machine Learning (pp. 345?350). San Mateo, CA: Morgan Kaufmann.
- Bellman, R. E. (1957). Dynamic programming. Princeton, NJ: Princeton University Press.
- Nilsson, N. J. (1989). Action networks. Proceedings of the Rochester Planning Workshop (Technical Report 284) (pp. 36?68). University of Rochester, Department of Computer Science.
- Whitehead, S. D., & Ballard, D. H. (1991). A study of cooperative mechanisms for faster reinforcement learning (Technical Report TR 365). Rochester, NY: University of Rochester, Department of Computer Science.
- Williams, R. J. (1987). Reinforcement-learning connectionist systems (Technical Report NU-CCS-87?3). Boston, MA: Northeastern University, College of Computer Science.
Cited by
Sorted by citations
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564
Deictic codes for the embodiment of cognition
Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997) · Behavioral and Brain Sciences · doi:10.1017/s0140525x97001611 · Cited by 1,082
Self-citationReinforcement learning for robots using neural networks
Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 841
Memory Representations in Natural Tasks
Ballard, D. H., Hayhoe, M. M., & Pelz, J. B. (1995) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1995.7.1.66 · Cited by 817
Self-citationDyna, an Integrated Architecture for Learning, Planning, and Reacting
Sutton, R. S. (1991) · ACM SIGART Bulletin · doi:10.1145/122344.122377 · Cited by 777
Metadata
- Authors
- Whitehead, S. D., & Ballard, D. H.
- Affiliations
- University of Rochester (US)
- Venue
- Machine Learning
- Published
- 1991-07
- Volume
- 7
- Issue
- 1
- Pages
- 45-83
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W2052117683
- Cited by
- 300
- References
- 64
- Citations by year
- 2026: 6 · 2025: 4 · 2024: 6 · 2023: 6 · 2022: 3 · 2021: 14 · 2020: 4 · 2019: 7 · 2018: 7 · 2017: 11 · 2016: 6 · 2015: 3 · 2014: 4 · 2013: 10 · 2012: 7
- FWCI
- 12.15
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Machine Learning (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- active perception, perceptual aliasing, reinforcement learning, adaptive control architecture, sensorimotor system, visual attention, decision-making systems, internal representations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review