Learning to perceive and act by trial and error

Adaptation in Natural and Artificial Systems

Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,340

The Ecological Approach to Visual Perception

Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935

Dynamic Programming

Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588

The Ecological Approach to Visual Perception: Classic Edition

Gibson, J. J. (2014) · doi:10.4324/9781315740218 · Cited by 12,132

A robust layered control system for a mobile robot

Brooks, R. (1986) · IEEE Journal on Robotics and Automation · doi:10.1109/jra.1986.1087032 · Cited by 7,799

Learning from Delayed Rewards

Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,674

Learning to predict by the methods of temporal differences

Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148

Neuronlike adaptive elements that can solve difficult learning control problems

Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,325

Advances in Neural Information Processing Systems 37

Touretzky, D. S. (2024) · doi:10.52202/079017 · Cited by 2,874

The Ecological Approach To Visual Perception

Gibson, J. J. (2013) · Psychology Press eBooks · doi:10.4324/9780203767764 · Cited by 2,622

On-line semantic perception using uncertainty

de Nijs, R., Ramos, S., Roig, G., Boix, X., Gool, L. V., & Kühnlenz, K. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6386212 · Cited by 16

Decision tree methods for finding reusable MDP homomorphisms

Wolfe, A. P., & Barto, A. G. (2006) · Cited by 16

Integrating Epistemic Action (Active Vision) and Pragmatic Action (Reaching): A Neural Architecture for Camera-Arm Robots

Ognibene, D., Balkenius, C., & Baldassarre, G. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69134-1_22 · Cited by 16

Controlling a Simulated Khepera with an XCS Classifier System with Memory

Webb, A. M., Hart, E., Ross, P. D., & Lawson, A. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39432-7_95 · Cited by 16

A neural-network reinforcement-learning model of domestic chicks that learn to localize the centre of closed arenas

Mannella, F., & Baldassarre, G. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2006.1966 · Cited by 18

Crossmodal Learning and Prediction of Autobiographical Episodic Experiences using a Sparse Distributed Memory

Jockel, S. (2010) · Cited by 14

Exploiting Generalization in the Subspaces for Faster Model-Based Reinforcement Learning

Hashemzadeh, M., Hosseini, R., & Ahmadabadi, M. N. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2869978 · Cited by 15

The MACS Project: An Approach to Affordance-Inspired Robot Control

Rome, E., Paletta, L., Şahi̇n, E., Dorffner, G., Hertzberg, J., Breithaupt, R., Fritz, G., Irran, J., Kintzler, F., Lörken, C., et al. (2008) · Springer eBooks · doi:10.1007/978-3-540-77915-5_12 · Cited by 15

Adaptive policy framework: A systematic review

Bakshi, A., Talaei‐Khoei, A., & RAY, P. K. (2013) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2012.12.007 · Cited by 15

Anchoring: do we need new solutions to an old problem or do we have old solutions for a new problem?

Bonarini, A., Matteucci, M., & Restelli, M. (2001) · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · Cited by 15

Cost-effective sensing during plan execution

Hansen, E. A. (1994) · Cited by 15

Intentional Learning Vs Incidental Learning

Ahmed, S. (2017) · Journal of Psychology & Clinical Psychiatry · doi:10.15406/jpcpy.2017.07.00426 · Cited by 14

Interactive learning of mappings from visual percepts to actions

Jodogne, S., & Piater, J. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102401 · Cited by 13

Towards modelling complex robot training tasks through system identification

Nehmzow, U., Akanyeti, O., & Billings, S. A. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2009.11.002 · Cited by 13

Totally model-free reinforcement learning by actor-critic Elman networks in non-Markovian domains

Mizutani, E., & Dreyfus, S. E. (2002) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1998.687169 · Cited by 13

Meta-level control in multi-agent systems

Raja, A., & Lesser, V. (2003) · Cited by 13

Evolving internal memory for T-maze tasks in noisy environments

Kim, D. (2004) · Connection Science · doi:10.1080/09540090412331314812 · Cited by 13

Gated multi-attention representation in reinforcement learning

Liang, D., Chen, Q., & Liu, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107535 · Cited by 12

Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood

Daee, P., Mirian, M. S., & Ahmadabadi, M. N. (2014) · PLoS ONE · doi:10.1371/journal.pone.0103143 · Cited by 11

How network monitoring and reinforcement learning can improve tcp fairness in wireless multi-hop networks

Arianpoo, N., & Leung, V. C. M. (2016) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-016-0773-3 · Cited by 12

Interpreting a dynamic and uncertain world: High-level vision

Howarth, R. (1995) · Artificial Intelligence Review · doi:10.1007/bf00857653 · Cited by 12

An Evolutionary Approach to Quantify Internal States Needed for the Woods Problem

Kim, D., & Hallam, J. C. T. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/3121.003.0050 · Cited by 12

Learning Manipulation Skills via Hierarchical Spatial Attention

Gualtieri, M., & Platt, R. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2974093 · Cited by 11

Landmark Based Reward Shaping in Reinforcement Learning with Hidden States

Demіr, A., Çіlden, E., & Polat, F. (2019) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/ztnx1687 · Cited by 11

SRL2003 IJCAI 2003 Workshop on Learning Statistical Models from Relational Data

Getoor, L. C. (2003) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 11

Learning with Deictic Representation

Finney, S. J., Gardiol, N. H., Kaelbling, L. P., & Oates, T. (2002) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 11

Schemes for Learning and Behaviour: A New Expectancy Model

Witkowski, C. M. (2013) · Cited by 11

A framework for distributed reinforcement learning

Gu, P., & Maddox, A. B. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7_21 · Cited by 11

A Hierarchical Network of Provably Optimal Learning Control Systems: Extensions of the Associative Control Process (ACP) Network

Baird, L. C., & Klopf, A. H. (1993) · Adaptive Behavior · doi:10.1177/105971239300100303 · Cited by 11

Using predictions for planning and modeling in *stochastic environments.

James, M. R., & Baveja, S. S. (2005) · Deep Blue (University of Michigan) · Cited by 11

Optimizing Methane Uptake on N/O Functionalized Graphene via DFT, Machine Learning, and Uniform Manifold Approximation and Projection (UMAP) Techniques

Rahimi, M., Mehrpanah, A., Mouchani, P., Rahimi, E., & Salaudeen, S. A. (2024) · Industrial & Engineering Chemistry Research · doi:10.1021/acs.iecr.4c02626 · Cited by 10

Solving for Best Responses and Equilibria in Extensive-Form Games with Reinforcement Learning Methods

Greenwald, A., Li, J., & Sodomka, E. (2017) · Outstanding contributions to logic · doi:10.1007/978-3-319-47843-2_11 · Cited by 10

Reinforcement learning of dynamic behavior by using recurrent neural networks

Onat, A., Kita, H., & Nishikawa, Y. (1997) · Artificial Life and Robotics · doi:10.1007/bf02471125 · Cited by 10

Deep Reinforcement Learning-Based Approach for Efficient and Reliable Droplet Routing on MEDA Biochips

Elfar, M., Chang, Y.-C., Ku, H. H.-Y., Liang, T.-C., Chakrabarty, K., & Pajić, M. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3194808 · Cited by 9

Ziggurat: Steps Toward a General Episodic Memory

Faltersack, Z., Burns, B., Nuxoll, A. M., & Crenshaw, T. L. (2011) · National Conference on Artificial Intelligence · Cited by 9

On-line expectation-based novelty detection for mobile robots

Özbılge, E. (2016) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.03.009 · Cited by 9

Totally model-free actor-critic recurrent neural-network reinforcement learning in non-Markovian domains

Mizutani, E., & Dreyfus, S. E. (2016) · Annals of Operations Research · doi:10.1007/s10479-016-2366-2 · Cited by 9

Automatic Selection of Object Recognition Methods Using Reinforcement Learning

Bianchi, R. A. C., Arnau Ramisa, A., & de Mántaras, R. L. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-05177-7_21 · Cited by 9

Localization and object recognition for mobile robots

Arnau Ramisa, A. (2009) · TDX (Tesis Doctorals en Xarxa) · Cited by 9

Online Learning of Single- and Multivalued Functions with an Infinite Mixture of Linear Experts

Damas, B., & Santos-Victor, J. (2013) · Neural Computation · doi:10.1162/neco_a_00510 · Cited by 9

Deictic Image Mapping: An Abstraction for Learning Pose Invariant Manipulation Policies

Platt, R., Kohler, C., & Gualtieri, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018042 · Cited by 11

Reinforcement learning using a recurrent neural network

Ho, F., & Kamel, M. S. (1994) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1994.374202 · Cited by 9

Task-Driven Learning of Spatial Combinations of Visual Features

Jodogne, S., Scalzo, F., & Piater, J. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.539 · Cited by 9

Evolving Robots Able to Integrate Sensory-Motor Information over Time

Nolfi, S., & Marocco, ‎. (2003) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1775-1_7 · Cited by 9

Parallel Neural Network Structures for Signal-to-Noise Ratio Estimation in Optical Fiber Communication Systems

Al‐Nahhal, M., Al-Nahhal, I., Dobre, O. A., & Soman, S. K. O. (2023) · Journal of Lightwave Technology · doi:10.1109/jlt.2023.3332484 · Cited by 8

Communicating robots’ intent through visual cues enhances human anticipatory behavior in human–dual robot collaboration

Psarakis, L., Nathanael, D., & Marmaras, N. (2024) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2024.102886 · Cited by 11

Learning Epistemic Actions in Model-Free Memory-Free Reinforcement Learning: Experiments with a Neuro-robotic Model

Ognibene, D., Volpi, N. C., Pezzulo, G., & Baldassarre, G. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39802-5_17 · Cited by 8

Grounding the Unobservable in the Observable: The Role and Representation of Hidden State in Concept Formation and Refinement

Morrison, C. T., Oates, T., & King, G. W. (2001) · Cited by 8

Spatial Ontologies in Multi-Agent Environmental Planning

Borri, D., & Camarda, D. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-091-4.ch015 · Cited by 8

Learning and Solving Partially Observable Markov Decision Processes

Shani, G. (2007) · Cited by 9

Solving Partially Observable Problems by Evolution and Learning of Finite State Machines

Sánchez, E. G., Pérez-Uribe, A., & Mesot, B. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45443-8_24 · Cited by 8

Image point correspondences and repeated patterns

Sur, F., Noury, N., & Berger, M. (2011) · HAL · Cited by 8

Learning in a state of confusion : employing active perception and reinforcement learning in partially observable worlds

Crook, P. (2007) · ERA · Cited by 8

Fuzzy classifier system for edge detection

Joung, C.-S., Kang, H., & Sim, K.-B. (2003) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1999.812531 · Cited by 8

Toward Code Evolution by Artificial Economies

Baum, E. B., & Đurđanović, I. (2002) · Natural computing series · doi:10.1007/978-3-642-55606-7_16 · Cited by 8

Reward-penalty reinforcement learning scheme for planning and reactive behaviour

Araújo, A. F. R., & Braga, A. P. S. (2002) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1998.728095 · Cited by 8

Recurrent neural networks for reinforcement learning: architecture, learning algorithms and internal representation

Onat, A., Kita, H., & Nishikawa, Y. (2002) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1998.687168 · Cited by 8

Layer-by-Layer Pick and Place Collaboration Between Human and Robot Using Optimization

Ghiyasi, T., Zargar, S. H., & Baghi, A. (2023) · eCAADe proceedings · doi:10.52842/conf.ecaade.2023.2.769 · Cited by 7

Active perception and recognition learning system based on Actor‐Q architecture

Shibata, K., Nishino, T., & Okabe, Y. (2002) · Systems and Computers in Japan · doi:10.1002/scj.10207 · Cited by 8

A cognitive/intelligent resource provisioning for cloud computing services: opportunities and challenges

Al-Asaly, M. S., Hassan, M. M., & Alsanad, A. (2019) · Soft Computing · doi:10.1007/s00500-019-04061-9 · Cited by 8

Review of the techniques used in motor‐cognitive human‐robot skill transfer

Guan, Y. H., Wang, N., & Yang, C. (2021) · Cognitive Computation and Systems · doi:10.1049/ccs2.12025 · Cited by 7

Cognitive graphs: Representational substrates for planning.

Yoo, J., Chrastil, E. R., & Bornstein, A. M. (2024) · Decision · doi:10.1037/dec0000249 · Cited by 9

Deictic option schemas

Ravindran, B., Barto, A. G., & Mathew, V. (2007) · International Joint Conference on Artificial Intelligence · Cited by 7

Interactive Selection of Visual Features through Reinforcement Learning

Jodogne, S., & Piater, J. (2007) · Springer eBooks · doi:10.1007/1-84628-102-4_21 · Cited by 7

Emergence of tool use in an articulated limb controlled by evolved neural circuits

Li, Q., Yoo, J., & Choe, Y. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280564 · Cited by 7

A Multistrategy Learning Scheme for Assimilating Advice in Embedded Agents

Gordon, D. F., & Subramanian, D. (1993) · Cited by 7

A Survey of Model-Based and Model-Free Methods for Resolving Perceptual Aliasing

Shani, G. (2004) · Cited by 7

Watching behaviour: the role of context and learning

Buxton, H., & Howarth, R. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1996.561025 · Cited by 7

Symbolic structures in numeric reinforcement for learning optimum robot trajectory

Hailu, G. (2001) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(01)00142-7 · Cited by 7

Landmark based guidance for reinforcement learning agents under partial observability

Demіr, A., Çіlden, E., & Polat, F. (2022) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-022-01713-5 · Cited by 6

How to Overcome Perceptual Aliasing in ASIFT?

Noury, N., Sur, F., & Berger, M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-17289-2_23 · Cited by 6

Using a genetic algorithm to search for the representational bias of a collective reinforcement learner

Cobb, H. G., & Bock, P. (1994) · Lecture notes in computer science · doi:10.1007/3-540-58484-6_300 · Cited by 6

On learning with imperfect representations

Kalyanakrishnan, S., & Stone, P. (2011) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2011.5967379 · Cited by 6

Learning Viewpoint Planning in Active Recognition on a Small Sampling Budget: A Kriging Approach

Defretin, J., Marzat, J., & Piet-Lahanier, H. (2010) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.32 · Cited by 6

Machine Learning in Text Analysis

Garg, N., & Sharma, K. (2020) · Advances in computational intelligence and robotics book series · doi:10.4018/978-1-5225-9643-1.ch018 · Cited by 6

Hierarchical Learning of Navigational Behaviors in an Autonomous Robot using a Predictive Sparse Distributed Memory

Rao, R. P. N., & Fuentes, O. (1998) · Autonomous Robots · doi:10.1023/a:1008810406347 · Cited by 6

On the use of attention clues for an autonomous wearable camera 1

Pilu, M. (2003) · Cited by 6

Actor-Q based active perception learning system

Shibata, K., Nishino, T., & Okabe, Y. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2001.932680 · Cited by 6

Reinforcement learning of iterative behaviour with multiple sensors

Piggott, P., & Sattar, A. (1994) · Applied Intelligence · doi:10.1007/bf00872474 · Cited by 6

Time manipulation technique for speeding up reinforcement learning in simulationsPreprint

Kormushev, P. S., Nomoto, K., Dong, F., & Hirota, K. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0903.4930 · Cited by 6

An Artificial Economy of Post Production Systems

Baum, E. B., & Đurđanović, I. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44640-0_1 · Cited by 6

Automatic landmark discovery for learning agents under partial observability

Demіr, A., Çіlden, E., & Polat, F. (2019) · The Knowledge Engineering Review · doi:10.1017/s026988891900002x · Cited by 5

Uncertainty maximization in partially observable domains: A cognitive perspective

Ramičić, M., & Bonarini, A. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.02.044 · Cited by 5

Deep intrinsically motivated exploration in continuous control

Sağlam, B., & Kozat, S. S. (2023) · Machine Learning · doi:10.1007/s10994-023-06363-4 · Cited by 5

Cognitive Architecture for Robust Adaptive Control of Robots in a Team

Agah, A., & Bekey, G. A. (1997) · Journal of Intelligent & Robotic Systems · doi:10.1023/a:1007960328527 · Cited by 5

Incremental state acquisition for Q-learning by adaptive Gaussian soft-max neural network

Murao, H., & Kitamura, S. (2002) · doi:10.1109/isic.1998.713706 · Cited by 5

Problems and solutions for anchoring in multi-robot applications

Bonarini, A., Matteucci, M., & Restelli, M. (2007) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/ifs-2007-00349 · Cited by 5

An Architecture for Representing and Learning Behaviors by Trial and Error

Blanchet, P. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/3117.003.0052 · Cited by 5

A Connectionist Approach to Spatial Memory and Planning

Bugmann, G. (1998) · Perspectives in neural computing · doi:10.1007/978-1-4471-3427-5_5 · Cited by 5

Learning optimal discourse strategies in a spoken dialogue system

Fromer, J. C. (1998) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5

Simultaneous Localization and Mapping ( SLAM )

Birk, A., & Pfingsthorn, M. F. (2016) · Wiley eBooks · doi:10.1002/047134608x.w8322 · Cited by 7

Locally weighted least squares policy iteration for model-free learning in uncertain environments

Howard, M., & Nakamura, Y. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696506 · Cited by 4

Are People Successful at Learning Sequences of Actions on a Perceptual Matching Task?

Yakushijin, R., & Jacobs, R. A. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01176.x · Cited by 4

Delayed reward‐based genetic algorithms for partially observable Markov decision problems

Yamashiro, Y., Ueno, A., & Takeda, H. (2004) · Systems and Computers in Japan · doi:10.1002/scj.10230 · Cited by 4

Stochastic synapse reinforcement learning (SSRL)

Shah, S. N. H., & Hougen, D. F. (2017) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2017.8285425 · Cited by 4

Enabling Fast Instruction-Based Modification of Learned Robot Skills

Frasca, T., Oosterveld, B., Chita-Tegmark, M., & Scheutz, M. J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16757 · Cited by 4

Learning what to memorize: Using intrinsic motivation to form useful memory in partially observable reinforcement learning

Demіr, A. (2023) · Applied Intelligence · doi:10.1007/s10489-022-04328-z · Cited by 6

Synthetic Experiences for Accelerating DQN Performance in Discrete Non-Deterministic Environments

von Pilchau, W. P., Stein, A., & Hähner, J. (2021) · Algorithms · doi:10.3390/a14080226 · Cited by 4

Active Bayesian perception and reinforcement learning

Lepora, N. F., Martínez-Hernández, U., Pezzulo, G., & Prescott, T. J. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6697038 · Cited by 4

Selecting Strategies for Infinite-Horizon Dynamic LIMIDs

van Gerven, M. A. J., & Díez, F. J. (2006) · Cited by 4

Learning to Perceive and Act

Whitehead, S. D., & Ballard, D. H. (1990) · UR Research (University of Rochester) · Cited by 23

Active Perception and Reinforcement Learning

Whitehead, S. D., & Ballard, D. H. (1990) · Machine Learning Proceedings 1990 · doi:10.1016/b978-1-55860-141-3.50025-0 · Cited by 81

Reinforcement learning with perceptual aliasing: the perceptual distinctions approach

Chrisman, L. (1992) · Cited by 316

Perceptual Aliasing in JCMB (or, Where on Earth is IPAB?)

Harrison, M. (2008)

Perception control

Randløv, J., & Alstrøm, P. (2001) · Physica A Statistical Mechanics and its Applications · doi:10.1016/s0378-4371(00)00504-5 · Cited by 3