Learning to perceive and act by trial and error

Adaptation in Natural and Artificial Systems

Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,340

The Ecological Approach to Visual Perception

Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935

Dynamic Programming

Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588

The Ecological Approach to Visual Perception: Classic Edition

Gibson, J. J. (2014) · doi:10.4324/9781315740218 · Cited by 12,132

A robust layered control system for a mobile robot

Brooks, R. (1986) · IEEE Journal on Robotics and Automation · doi:10.1109/jra.1986.1087032 · Cited by 7,799

Learning from Delayed Rewards

Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,674

Learning to predict by the methods of temporal differences

Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148

Neuronlike adaptive elements that can solve difficult learning control problems

Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,325

Advances in Neural Information Processing Systems 37

Touretzky, D. S. (2024) · doi:10.52202/079017 · Cited by 2,874

The Ecological Approach To Visual Perception

Gibson, J. J. (2013) · Psychology Press eBooks · doi:10.4324/9780203767764 · Cited by 2,622

Robot Navigation in Complex and Initially Unknown Environments

de, A. P., Braga, S., & Araujo, A. F. R. (1999) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)57441-8 · Cited by 4

Simulating an agent’s decision-making process in black-box managerial environment: An estimation-and-optimisation approach

He, Z., Luo, C., Tan, C.-H., Wu, H., & Fan, B. (2018) · Journal of Simulation · doi:10.1080/17477778.2018.1440946 · Cited by 4

Learning from interaction with the environment using a situation-operator calculus with application to mobile robots

Ahle, E., & Söffker, D. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1400943 · Cited by 4

Combining Exploitation-Based and Exploration-Based Approach in Reinforcement Learning

Iwata, K., Ito, N., Yamauchi, K., & Ishii, N. (2000) · Lecture notes in computer science · doi:10.1007/3-540-44491-2_47 · Cited by 4

A Framework for Robust Sensing in Multi-agent Systems

Bonarini, A., Matteucci, M., & Restelli, M. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45603-1_32 · Cited by 4

Symbolic Task Compression in Structured Task Learning

Saveriano, M., Seegerer, M., Caccavale, R., Finzi, A., & Lee, D. (2019) · IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc.2019.00033 · Cited by 3

Probabilistic Discriminative Models address the Tactile Perceptual Aliasing Problem

Lloyd, J., Lin, Y., & Lepora, N. F. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.057 · Cited by 4

Stochastic intervention for causal inference via reinforcement learning

Duong, T. D., Li, Q., & Xu, G. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.086 · Cited by 4

Reinforcement Learning of Perceptual Classes using Q Learning Updates

Jodogne, S., & Piater, J. (2005) · Cited by 3

Task-Driven Discretization of the Joint Space of Visual Percepts and Continuous Actions

Jodogne, S., & Piater, J. (2006) · Lecture notes in computer science · doi:10.1007/11871842_24 · Cited by 3

Q-Learning with Adaptive State Space Construction

Murao, H., & Kitamura, S. (1998) · Lecture notes in computer science · doi:10.1007/3-540-49240-2_2 · Cited by 3

Goal-Directed Reinforcement Learning Using Variable Learning Rate

Braga, A. P. S., & Araujo, A. F. R. (1998) · Lecture notes in computer science · doi:10.1007/10692710_14 · Cited by 3

The fuzzy classifier system using the implicit bucket brigade algorithm

Joung, C.-S., Lee, D.-W., & Sim, K.-B. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.1999.812985 · Cited by 3

Dynamical analysis of recurrent neural circuits in articulated limb controllers for tool use

Wang, H., Li, Q., Yoo, J., & Choe, Y. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727766 · Cited by 3

Determining point correspondences between two views under geometric constraint and photometric consistency

Noury, N., Sur, F., & Berger, M. (2010) · HAL · Cited by 3

Evolution and Learning: Evolving Sensors in a Simple MDP Environment

Jung, T., Dauscher, P., & Uthmann, T. (2003) · Adaptive Behavior · doi:10.1177/1059712303113002 · Cited by 3

An analysis of feature-based and state-based representations for module-based learning in mobile robots

Colombini, E. L., & Ribeiro, C. H. C. (2005) · International Conference on Hybrid Intelligent Systems (HIS) · doi:10.1109/ichis.2005.18 · Cited by 3

Grounding oriented design

Stanton, C. (2007) · UTS ePRESS (University of Technology Sydney) · Cited by 3

Prioritizing Starting States for Reinforcement Learning.Preprint

Tavakoli, A., Levdik, V., Islam, R., & Kormushev, P. S. (2018) · arXiv (Cornell University) · Cited by 3

Learning action representations using kernel perceptrons

Mourão, K. (2012) · ERA · Cited by 3

Module-based Autonomous Learning for Mobile Robots

Colombini, E. L., & Ribeiro, C. H. C. (2007) · Studies in computational intelligence · doi:10.1007/978-3-540-49720-2_7 · Cited by 2

Modelo de ciclo de vida para el aprendizaje basado en compartición de conocimientos en sistemas autónomos de robots

Ierache, J. S. (2012) · doi:10.35537/10915/18378 · Cited by 2

Reinforcement learning in continuous state space with perceptual aliasing by using complex-valued RBF network

Shibuya, T., Arita, H., & Hamagami, T. (2010) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2010.5642294 · Cited by 2

Vision-based assistive navigation for robotic wheelchair platforms

Tranhanias, P. E., Lourakis, M., Argyros, A., & Orphanoudakis, S. C. (1996) · Cited by 2

Using Genetic Network Programming to Get Comprehensible Control Rules for Real Robots

Murata, T., & Okada, D. (2006) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2006.1688550 · Cited by 2

A Reinforcement Learning Approach to Dynamic Norm Generation

Hosseini, H. (2010) · Cited by 2

The impact of perceptual aliasing on exploration and learning in a dynamic decision making task

Zaval, L., & Gureckis, T. M. (2010) · eScholarship (California Digital Library) · Cited by 2

Lateralized Learning for Multi-Class Visual Classification Tasks

Siddique, A., Browne, W. N., & Grimshaw, G. M. (2026) · IEEE Access · doi:10.1109/access.2026.3660716 · Cited by 2

Reinforcement learning under incomplete perception using stochastic gradient ascent and recurrent neural networks

Onat, A., Kosino, N., Kuramitu, M., & Kita, H. (2003) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1999.815598 · Cited by 2

Un modelo de aprendizaje por observación en planificación

Martínez, R. G. (1997) · doi:10.20868/upm.thesis.950 · Cited by 2

Problems and solutions in acquisition and interpretation of sensorial data on a mobile robot

Agazzi, G., & Bonarini, A. (2003) · Conference proceedings - IEEE Instrumentation/Measurement Technology Conference · doi:10.1109/imtc.1999.776982 · Cited by 2

Selective visual attention in object detection processes

Paletta, L., Goyal, A., & Greindl, C. (2003) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.477401 · Cited by 2

Implementation of real time spatial mapping in robotic systems through self-organizing neural networks

Morellas, V., Minners, J., & Donath, M. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.1995.525808 · Cited by 2

IMPROVING THE PERFORMANCE OF Q-LEARNING WITH LOCALLY WEIGHTED REGRESSION

Aljibury, H. (2001) · Cited by 2

Meta-level control of multiagent systems

(1994) · Lecture notes in computer science · doi:10.1007/3-540-58698-9_5 · Cited by 2

Lateralized Learning to Solve Complex Problems

Siddique, A. (2021) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.16655416.v1 · Cited by 9

Un mécanisme constructiviste d'apprentissage automatique, d'anticipations pour des agents artificiels situés

Perotto, F. S. (2010) · doi:10.70675/ad0099a8ze085z4ef0z8aabz173dfd32d8d6 · Cited by 2

The MaRz Algorithm: Towards an Artificial General Episodic Learner

Rodriguez, C., Marston, G., Goolkasian, W., Rosenberg, A., & Nuxoll, A. M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-63703-7_15 · Cited by 1

A hybrid connectionist/LCS for hidden-state problems

Mitchell, M. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09758-z · Cited by 1

Application of reinforcement learning in phase control of mid-air ultrasonic haptics

Nakamura, M., Furuya, R., Nobuya, S. A. T. O., & Mizushima, D. (2025) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/adcd7f · Cited by 1

Evolving internal memory strategies for the woods problems

Yim, H., & Kim, D. (2012) · Cited by 1

Synthesizing Intelligent Behavior: A Learning Paradigm

Hamdi, M. S., & Kaiser, K. (1999) · Lecture notes in computer science · doi:10.1007/978-3-540-48765-4_69 · Cited by 1

N-Learning: A Reinforcement Learning Paradigm for Multiagent Systems

Mansfield, M., Collins, J. J., Eaton, M., & Collins, T. (2005) · Lecture notes in computer science · doi:10.1007/11589990_71 · Cited by 1

Do trial-and-error practices and the use of the internet influence how medicines are used?

Price, K., Taylor, A. W., Grande, E. D., & Kralik, D. (2013) · Australian Journal of Primary Health · doi:10.1071/py13007 · Cited by 1

A Measure of Perceptual Aliasing in Image Descriptors

Wang, J., & Zhang, H. (2013) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2013.27 · Cited by 1

A performance comparison of TRACA - an incremental on-line learning algorithm

Mitchell, M. W. (2004) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2003.1223697 · Cited by 1

Learning of Active Perception Based on Reinforcement Learning

Shibata, K., Nishino, T., & Okabe, Y. (1996) · The Brain & Neural Networks · doi:10.3902/jnns.3.126 · Cited by 1

EMBODIED CATEGORIZATION**Work on this chapter was supported by funding from the SSHRC and FCAR/FQRSC agencies. The authors wish to thank them.

Poirier, P., Hardy‐Vallée, B., & DePasquale, J.-F. (2005) · Elsevier eBooks · doi:10.1016/b978-008044612-7/50088-3 · Cited by 4

Improved Stochastic Synapse Reinforcement Learning for Continuous Actions in Sharply Changing Environments

Shah, S. N. H., & Hougen, D. F. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207622 · Cited by 1

ADS Optimization Using Reinforcement Learning

Jain, R., Nagrath, P., Raina, S. T., Prakash, P., & Thareja, A. (2021) · Lecture notes in networks and systems · doi:10.1007/978-981-15-9712-1_6 · Cited by 1

A Neural Network-Based Feature Learning and Processing to Estimate Signal-to-Noise Ratio in Coherent Optical Fiber Systems

Al‐Nahhal, M., Al-Nahhal, I., Soman, S. K. O., & Dobre, O. A. (2025) · IEEE photonics journal · doi:10.1109/jphot.2025.3558516 · Cited by 1

Reinforcement Based U-Tree: A Novel Approach for Solving POMDP

Zheng, L., Cho, S., & Quek, C. H. (2010) · Intelligent systems reference library · doi:10.1007/978-3-642-13639-9_9 · Cited by 1

Embodied Categorization

Poirier, P., Hardy‐Vallée, B., & DePasquale, J.-F. (2005) · Elsevier eBooks · doi:10.1016/b978-0-08-101107-2.00033-6 · Cited by 1

Accelerating Goal-Directed Reinforcement Learning by Model Characterization

Debnath, S., Sukhatme, G. S., & Liu, L. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593728 · Cited by 1

Leveraging Temporal Reasoning for Policy Selection in Learning from Demonstration

Carpio, E., Clark-Turner, M., Gesel, P., & Begum, M. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794461 · Cited by 1

A Non-computationally-intensive Neurocontroller for Autonomous Mobile Robot Navigation

Pérez-Uribe, A. (2003) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1775-1_8 · Cited by 1

Reinforcement Learning for Control of Traffic and Access Points in Intelligent Wireless ATM Networks

Martyna, J. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45493-4_56 · Cited by 1

APPLICATION OF AI-BASED REINFORCEMENT LEARNING TO ROBOT VEHICLE CONTROL

Madden, M. G., & Nolan, P. (1995) · Cited by 1

Prognosis of High-Grade Carcinoid Tumors using Dynamic Limited Memory Influence Diagrams

van Gerven, M. A. J., Díez, F. J., Taal, B. G., & Lucas, P. (2006) · Cited by 1

The Concrete Substrates of Abstract Rule Use

Love, B. C., Tomlinson, M. T., & Gureckis, T. M. (2008) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)00005-4 · Cited by 1

Investigation of automatic construction of reactive controllers

Westerberg, C. J. (1993) · Cited by 1

Learning-based control of preception for mobility

Barth, M., Das, S., & Bhanu, B. (2003) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/isic.1992.225112 · Cited by 1

Automated Spatio-Temporal Abstraction in Reinforcement Learning

Mathew, V. (2007) · Cited by 1

Probability Redistribution using Time Hopping for Reinforcement Learning

Kormushev, P. S., Dong, F., & Hirota, K. (2009) · Spiral (Imperial College London) · Cited by 1

Exploiting generalization in the subspaces for faster model-based learningPreprint

Hashemzadeh, M., Hosseini, R., & Ahmadabadi, M. N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.08012 · Cited by 1

Deictic Image Maps: An Abstraction For Learning Pose Invariant Manipulation PoliciesPreprint

Platt, R., Kohler, C., & Gualtieri, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.10045 · Cited by 1

Reinforcement Learning

Engelbrecht, A. P. (2007) · doi:10.1002/9780470512517.ch6 · Cited by 1

RLPR – An Aspectualizable State Space Representation

Frommberger, L. (2010) · Cognitive technologies · doi:10.1007/978-3-642-16590-0_6 · Cited by 1

Gaze control for visually guided manipulation

Nunez-Varela, J. I. (2013) · University of Birmingham Institutional Research Archive (University of Birmingham) · Cited by 1

An object indexing methodology as support to object recognition

Mineau, G. W., Lahboub, M., & Beaulieu, J. ‐. (1998) · Lecture notes in computer science · doi:10.1007/3-540-64575-6_41

Acting Optimally in Part ially servable Stoc ains

Cassandra, A. R., Kaelbling, L. P., & Littmant, M. L. (1994)

Hunting in an Environment Containing Obstacles: A Combinatory Study of Incremental Evolution and Co-Evolutionary Approaches

Mermigkis, I., & Petrou, L. (2008) · doi:10.5772/5466

Learning to solve complex tasks for reactive systems (Extended abstract)

Martín, M., & Cortés, U. (1995) · Lecture notes in computer science · doi:10.1007/3-540-59286-5_76

Neural network generation of temporal sequences from single static vector inputs using varying length distal target sequences

Reggia, J. A., & Gittens, S. D. (2007)

Agent-Based Implementation on Intelligent Instruments

Dapoigny, R., Benoît, É., & Foulloy, L. (2007) · Springer eBooks · doi:10.1007/3-540-45034-3_51

Cortical Mechanisms of Visual Recognition and Learning: A Hierarchical Kalman Filter Model

Rao, R. P. N. (2007)

VISUAL DETECTION OF INDEPENDENT 3D MOTION BY A MOVING OBSERVER

Αργυρός, Α. (1996) · doi:10.12681/eadd/7427

Agente topológico de aprendizado por reforço

Braga, A. P. S. (2004) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.18.2004.tde-21102011-081848

An evaluation of Markov-k approaches to hidden-state

Lam, J. W. (2004)

A Study on Architecture, Algorithms and Internal Representation for Reinforcement Learning with Recurrent Neural Networks

Onat, A., Kita, H., & Nishikawa, Y. (1999) · Transactions of the Society of Instrument and Control Engineers · doi:10.9746/sicetr1965.35.1599

A reinforcement learning method to improve the sweeping efficiency for an agent

Ohsaka, N., Kitakoshi, D., & Suzuki, M. (2011) · IEEE International Conference on Granular Computing (GrC) · doi:10.1109/grc.2011.6122650

Evaluation of genetic-fuzzy systems in the configuration space

Bonarini, A., & Fiorellato, F. (2002) · Joint IFSA World Congress and NAFIPS International Conference · doi:10.1109/nafips.2001.944783

A Constraint-Based Control Architecture for Acting and Reasoning in Autonomous Robots

Rosca, J. P., & Riopka, T. P. (1995)

Exploring deictic representations in reinforcement learning

Finney, S. J. (2003) · DSpace@MIT (Massachusetts Institute of Technology)

Estudo de Desempenho de Algoritmos de Aprendizagem sob Condições de Ambigüidade Sensorial

Monteiro, S. T. (2002) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)

PoDMan: Policy Deviation Management

Bakshi, A., Talaei‐Khoei, A., RAY, P. K., & Solvoll, T. G. (2017) · AJIS. Australasian journal of information systems/AJIS. Australian journal of information systems/Australian journal of information systems · doi:10.3127/ajis.v21i0.1325

Reinforcement Learning in Robotic Task Domains with Deictic Descriptor Representation

Moore, H. P. (2018) · doi:10.31390/gradschool_dissertations.4738

Synthesizing Policies That Account For Human Execution Errors Caused By State-Aliasing In Markov Decision Processes.Preprint

Gopalakrishnan, S., Verma, M., & Subbarao Kambhampati, B. (2021) · arXiv (Cornell University)

Modelo de ciclo de vida para el aprendizaje basado en compartición de conocimiento en sistemas autónomos de robots

Ierache, J. S. (2010) · doi:10.35537/10915/4174

Dynamic LIMIDS

Díez, F. J., & van Gerven, M. A. J. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-165-2.ch008

Introduction

Singh, S. P. (2002) · Machine Learning · doi:10.1023/a:1017917511082

Robotic pick-and-place of partially visible and novel objects

Gualtieri, M. (2021) · doi:10.17760/d20412868

Enhanced Signal-to-Noise Ratio Estimation in Optical Fiber Communications: A Pilot-Based Approach

Al‐Nahhal, M., Al-Nahhal, I., Soman, S. K. O., & Dobre, O. A. (2025) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2025.3581473

External Visual Memory with Autoencoder-Based Intrinsic Motivation for Reinforcement Learning Under Partial Observability

Demirbilek, B. H., Demіr, A., & Polat, F. (2025) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai66417.2025.00115

Subsystem Formation Driven by Double Contingency

Porr, B., & Prodi, P. D. (2014) · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam)

Intrinsically Motivated and Interactive Reinforcement Learning : a Developmental Approach

Fournier, P. (2019) · theses.fr (ABES) · doi:10.70675/525d96caz1d44z4f9cz86bfzb69a83bf40b5

Hyperbolic neurodynamics and graph convolutional networks in drug combination prediction

Li, J., Chen, J., Shang, Y., & Lei, X. (2026) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2026.131637

Subgoal identification with multiple instance learning methods in landmark Partially Observable Markov Decision Process problems

Sunel, S., & Polat, F. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116178

Machine Behaviour Design and Management

Tan, H., Wu, Y., & Zhang, Y. (2026) · Springer eBooks · doi:10.1007/978-981-95-5585-7_20 · Cited by 1

Physics-consistent reinforcement learning for temperature control in delayed thermal energy systems

Xing, Y., Feng, Z., Zhao, Z., Liu, X., & Song, M. (2026) · Energy · doi:10.1016/j.energy.2026.142371

Learning to Perceive and Act

Whitehead, S. D., & Ballard, D. H. (1990) · UR Research (University of Rochester) · Cited by 23

Active Perception and Reinforcement Learning

Whitehead, S. D., & Ballard, D. H. (1990) · Machine Learning Proceedings 1990 · doi:10.1016/b978-1-55860-141-3.50025-0 · Cited by 81

Reinforcement learning with perceptual aliasing: the perceptual distinctions approach

Chrisman, L. (1992) · Cited by 316

Perceptual Aliasing in JCMB (or, Where on Earth is IPAB?)

Harrison, M. (2008)

Perception control

Randløv, J., & Alstrøm, P. (2001) · Physica A Statistical Mechanics and its Applications · doi:10.1016/s0378-4371(00)00504-5 · Cited by 3