The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Fuzzy inference system learning by reinforcement methods
Abstract
Fuzzy Actor-Critic Learning (FACL) and Fuzzy Q-Learning (FQL) are reinforcement learning methods based on dynamic programming (DP) principles. In the paper, they are used to tune online the conclusion part of fuzzy inference systems (FIS). The only information available for learning is the system feedback, which describes in terms of reward and punishment the task the fuzzy agent has to realize. At each time step, the agent receives a reinforcement signal according to the last action it has performed in the previous state. The problem involves optimizing not only the direct reinforcement, but also the total amount of reinforcements the agent can receive in the future. To illustrate the use of these two learning methods, we first applied them to a problem that involves finding a fuzzy controller to drive a boat from one bank to another, across a river with a strong nonlinear current. Then, we used the well known Cart-Pole Balancing and Mountain-Car problems to be able to compare our methods to other reinforcement learning methods and focus on important characteristic aspects of FACL and FQL. We found that the genericity of our methods allows us to learn every kind of reinforcement learning problem (continuous states, discrete/continuous actions, various type of reinforcement functions). The experimental studies also show the superiority of these methods with respect to the other related methods we can find in the literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fuzzy identification of systems and its applications to modeling and control
Takagi, T., & Sugeno, M. (1985) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1985.6313399 · Cited by 19,592
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Puterman, M. L. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316887 · Cited by 6,024
Fuzzy logic in control systems: fuzzy logic controller. I
Lee, C. C. (1990) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.52551 · Cited by 5,616
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,233
Fuzzy logic in control systems : fuzzy logic controller. Part II
Lee, C. C. (1990) · IEEE Transactions on Systems Man and Cybernetics · Cited by 2,225
Increased rates of convergence through learning rate adaptation
Jacobs, R. A. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90003-2 · Cited by 1,806
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564
Neural-network-based fuzzy logic control and decision system
Lin, C.-T., & Lee, C. S. G. (1991) · IEEE Transactions on Computers · doi:10.1109/12.106218 · Cited by 1,480
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Dynamic Programming: Deterministic and Stochastic Models
Bertsekas, D. P. (1987) · Medical Entomology and Zoology · Cited by 1,325
Sutton, R. S. (1990) · Machine Learning Proceedings 1990 · doi:10.1016/b978-1-55860-141-3.50030-4 · Cited by 1,314
Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding
Sutton, R. S. (1995) · Cited by 1,072
Learning and tuning fuzzy logic controllers through reinforcements
Berenji, H. R., & Khedkar, P. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.159061 · Cited by 942
Practical issues in temporal difference learning
Tesauro, G. (1992) · Machine Learning · doi:10.1007/bf00992697 · Cited by 787
On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 770
Temporal credit assignment in reinforcement learning
Sutton, R. S. (1984) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 749
Reinforcement learning with replacing eligibility traces
Singh, S. P., & Sutton, R. S. (1996) · Machine Learning · doi:10.1007/bf00114726 · Cited by 575
Generalization in Reinforcement Learning: Safely Approximating the Value Function
Boyan, J. A., & Moore, A. (1994) · Cited by 508
Accelerated Stochastic Approximation
Kesten, H. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706705 · Cited by 433
Learning and Sequential Decision Making
Barto, A. G., Sutton, R. S., & Watkins, C. (1989) · Cited by 357
A stochastic reinforcement learning algorithm for learning real-valued functions
Gullapalli, V. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90056-q · Cited by 295
Incremental multi-step Q-learning
Peng, J., & Williams, R. J. (1996) · Machine Learning · doi:10.1007/bf00114731 · Cited by 286
Efficient Exploration in Reinforcement Learning
(2012) · SpringerReference · doi:10.1007/springerreference_178956 · Cited by 257
Connectionist Learning for Control: An Overview
Barto, A. G. (1991) · Neural Networks for Control · doi:10.7551/mitpress/4939.003.0005 · Cited by 200
Steepest descent algorithms for neural network controllers and filters
Piche, S. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279185 · Cited by 170
TD(λ) Converges with Probability 1
Dayan, P., & Sejnowski, T. J. (1994) · Machine Learning · doi:10.1023/a:1022657612745 · Cited by 169
Moore, A. W. (1991) · Machine Learning Proceedings 1991 · doi:10.1016/b978-1-55860-200-7.50069-6 · Cited by 162
BOXES: AN EXPERIMENT IN ADAPTIVE CONTROL
Michie, D., & Chambers, R. (2013) · Cited by 152
A New Approach to Fuzzy Classifier Systems
Parodi, A., & Bonelli, P. (1993) · international conference on Genetic algorithms · Cited by 127
A self-learning rule-based controller employing approximate reasoning and neural net concepts
Lee, C.-C. (1991) · International Journal of Intelligent Systems · doi:10.1002/int.4550060105 · Cited by 119
Active Exploration in Dynamic Environments
Thrun, S., & Möller, K. (1991) · Cited by 119
Applying genetics to fuzzy logic
Karr, C. (1991) · AI Expert archive · Cited by 110
Explanation-Based Neural Network Learning for Robot Control
Mitchell, T. M., & Thrun, S. (1992) · Cited by 103
Fuzzy Q-learning and dynamical fuzzy Q-learning
Glorennec, P. Y. (1994) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzzy.1994.343739 · Cited by 94
Reinforcement Learning With High-Dimensional, Continuous Actions
Baird, I., Klopf Leemon, C., & Anderson Sam, H. (1993) · Defense Technical Information Center (DTIC) · doi:10.21236/ada280844 · Cited by 88
Classifier Systems that Learn Internal World Models
Booker, L. B. (1988) · Machine Learning · doi:10.1007/bf00113896 · Cited by 79
Efficient Exploration in Reinforcement Learning
Langford, J. C. (2010) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_244 · Cited by 66
Cichosz, P. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.135 · Cited by 58
Associative Reinforcement Learning: Functions in k-DNF
Kaelbling, L. P. (1994) · Machine Learning · doi:10.1023/a:1022689909846 · Cited by 47
Refinement of Approximate Reasoning-based Controllers by Reinforcement Learning
Berenji, H. R., & Software, S. (1991) · Elsevier eBooks · doi:10.1016/b978-1-55860-200-7.50097-0 · Cited by 46
Self-improvement Based On Reinforcement Learning, Planning and Teaching
Lin, L. (1991) · Elsevier eBooks · doi:10.1016/b978-1-55860-200-7.50067-2 · Cited by 34
Structural Learning In Connectionist Systems
Barto, A. G., & Anderson, C. W. (1985) · eScholarship (California Digital Library) · Cited by 10
Cited by
Reinforcement Learning and Dynamic Programming Using Function Approximators
Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2017) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919
Multi-agent Reinforcement Learning: An Overview
Buşoniu, L., Babuška, R., & De Schutter, B. (2010) · Studies in Computational Intelligence · doi:10.1007/978-3-642-14435-6_7 · Cited by 741
Neuro-fuzzy rule generation: survey in soft computing framework
Mitra, S., & Hayashi, Y. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.846746 · Cited by 726
Application of artificial intelligence in geotechnical engineering: A state-of-the-art review
Baghbani, A., Choudhury, T., Costa, S., & Reiner, J. (2022) · Earth-Science Reviews · doi:10.1016/j.earscirev.2022.103991 · Cited by 374
Experience Replay for Real-Time Reinforcement Learning Control
Adam, S., Busoniu, L., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2106494 · Cited by 255
Metadata
- Authors
- Jouffe, L.
- Venue
- IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews)
- Published
- 1998
- Volume
- 28
- Issue
- 3
- Pages
- 338-355
- ISSN
- 1094-6977 (ISSN-L)
- OpenAlex
- W2305205647
- Cited by
- 384
- References
- 49
- FWCI
- 1.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.