The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
A new methodology of extraction, optimization and application of crisp and fuzzy logical rules
Abstract
A new methodology of extraction, optimization, and application of sets of logical rules is described. Neural networks are used for initial rule extraction, local or global minimization procedures for optimization, and Gaussian uncertainties of measurements are assumed during application of logical rules. Algorithms for extraction of logical rules from data with real-valued features require determination of linguistic variables or membership functions. Contest-dependent membership functions for crisp and fuzzy linguistic variables are introduced and methods of their determination described. Several neural and machine learning methods of logical rule extraction generating initial rules are described, based on constrained multilayer perceptron, networks with localized transfer functions or on separability criteria for determination of linguistic variables. A tradeoff between accuracy/simplicity is explored at the rule extraction stage and between rejection/error level at the optimization stage. Gaussian uncertainties of measurements are assumed during application of crisp logical rules, leading to "soft trapezoidal" membership functions and allowing to optimize the linguistic variables using gradient procedures. Numerous applications of this methodology to benchmark and real-life problems are reported and very simple crisp logical rules for many datasets provided.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · Cited by 23,431
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Rough Sets: Theoretical Aspects of Reasoning about Data
Pawlak, Z. (1991) · Our Digital Library (Warsaw University of Technology) · Cited by 8,343
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
UCI Repository of Machine Learning Databases
Merz, C. J. (1996) · Medical Entomology and Zoology · Cited by 2,363
Neural Networks and Fuzzy Systems
Kosko, B., & Burgess, J. C. (1998) · The Journal of the Acoustical Society of America · doi:10.1121/1.423096 · Cited by 2,356
Introduction to artificial neural systems
Żurada, J. M. (1992) · Medical Entomology and Zoology · Cited by 2,355
Machine Learning, Neural and Statistical Classification
Fulkerson, B. (1995) · Technometrics · doi:10.1080/00401706.1995.10484383 · Cited by 2,209
Introduction to artificial neural systems
Nelson, D., & Wang, J. (1992) · Neurocomputing · doi:10.1016/0925-2312(92)90018-k · Cited by 1,999
UCI Repository of Machine Learning Databases
Murphy, P. M. (1994) · Medical Entomology and Zoology · Cited by 1,844
Survey and critique of techniques for extracting rules from trained artificial neural networks
Andrews, R., Diederich, J., & Tickle, A. B. (1995) · Knowledge-Based Systems · doi:10.1016/0950-7051(96)81920-4 · Cited by 1,225
Weiss, S. M. (1990) · Cited by 1,058
A theory and methodology of inductive learning
Michalski, R. S. (1983) · Artificial Intelligence · doi:10.1016/0004-3702(83)90016-4 · Cited by 1,002
Pattern Recognition: Statistical, Structural and Neural Approaches
Schalkoff, R. J. (1991) · Medical Entomology and Zoology · Cited by 964
Neural networks and fuzzy systems
Dvořák, V. (1993) · Knowledge-Based Systems · doi:10.1016/0950-7051(93)90043-s · Cited by 845
Foundations of neural networks, fuzzy systems, and knowledge engineering
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0330 · Cited by 821
Robust linear programming discrimination of two linearly inseparable sets
Bennett, K. P., & Mangasarian, O. L. (1992) · Optimization Methods and Software · doi:10.1080/10556789208805504 · Cited by 780
Extracting refined rules from knowledge-based neural networks
Towell, G. G., & Shavlik, J. W. (1993) · Machine Learning · doi:10.1007/bf00993103 · Cited by 757
Michalski, R. S., Mozetič, I., Hong, J., & Nada Lavrač, A. (1986) · National Conference on Artificial Intelligence · Cited by 747
Knowledge-based artificial neural networks
Towell, G. G., & Shavlik, J. W. (1994) · Artificial Intelligence · doi:10.1016/0004-3702(94)90105-8 · Cited by 746
Rough-Fuzzy Hybridization: A New Trend in Decision Making
Pal, S. K., & Skowron, A. (1999) · Cited by 669
Extracting Tree-Structured Representations of Trained Networks
Craven, M. W., & SHAVLIK, J. W. (1995) · neural information processing systems · Cited by 602
Foundations of neural networks
(1991) · Choice Reviews Online · doi:10.5860/choice.28-3925 · Cited by 546
Neural Networks in Computer Intelligence
Ziegel, E. R. (1995) · Technometrics · doi:10.1080/00401706.1995.10484401 · Cited by 540
Neural network learning and expert systems
(1993) · Choice Reviews Online · doi:10.5860/choice.31-0983 · Cited by 529
Weiss, S. M., & Kapouleas, I. (1989) · International Joint Conference on Artificial Intelligence · Cited by 506
Neural Networks in Computer Intelligence
Fu, L. (1994) · Medical Entomology and Zoology · Cited by 499
Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering
Kasabov, N. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3071.001.0001 · Cited by 483
The MONK's problems: A Performance Comparison of Different Learning Algorithms
Thrun, S., Bala, J. W., Bloedorn, E., Bratko, I., Cestnik, B., Cheng, J. Q., Jong, K. A. D., Džeroski, S., Fisher, D., Fahlman, S. E., et al. (1991) · doi:10.13021/mars/3370 · Cited by 445
Tickle, A. B., Andrews, R., Golea, M., & Diederich, J. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.728352 · Cited by 438
Neural Network Learning and Expert Systems
Gallant, S. I. (1993) · The MIT Press eBooks · doi:10.7551/mitpress/4931.001.0001 · Cited by 431
ASSISTANT 86: a knowledge-elicitation tool for sophisticated users
Cestnik, B., Kononenko, I., & Bratko, I. (1987) · Medical Entomology and Zoology · Cited by 428
Liu, H. (1996) · ACM SIGART Bulletin · doi:10.1145/230062.1066049 · Cited by 369
Rule generation from neural networks
Fu, L. (1994) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.299696 · Cited by 367
Using Sampling and Queries to Extract Rules from Trained Neural Networks
Craven, M. W., & Shavlik, J. W. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50013-1 · Cited by 311
Neural networks in designing fuzzy systems for real world applications
Halgamuge, S. K., & Glesner, M. (1994) · Fuzzy Sets and Systems · doi:10.1016/0165-0114(94)90242-9 · Cited by 241
Medical diagnostic expert system based on PDP model
Saito, & Nakano (1988) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1988.23855 · Cited by 209
PERSONALITY: Individual Differences and Clinical Assessment
Butcher, J. N., & Rouse, S. V. (1996) · Annual Review of Psychology · doi:10.1146/annurev.psych.47.1.87 · Cited by 193
Extracting Rules from Artificial Neural Networks with Distributed Representations
Thrun, S. (1994) · Cited by 175
Rule learning by searching on adapted nets
Fu, L. (1991) · National Conference on Artificial Intelligence · Cited by 165
Knowledge-based connectionism for revising domain theories
Fu, L.-M. (1993) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.214775 · Cited by 148
Understanding neural networks via rule extraction
Setiono, R., & Liu, H. (1995) · Cited by 129
AUTOMATED KNOWLEDGE ACQUISITION
(1991) · Elsevier eBooks · doi:10.1016/b978-1-55860-200-7.50134-3 · Cited by 115
Feature space mapping as a universal adaptive system
Duch, W., & Diercksen, G. H. F. (1995) · Computer Physics Communications · doi:10.1016/0010-4655(95)00023-9 · Cited by 85
Self-citationNetwork Structuring and Training Using Rule-based Knowledge
Volker Tresp, C., Hollatz, J., & Ahmad, S. (1992) · Cited by 78
Comparison of optimized backpropagation algorithms.
Schiffmann, W. H., Joost, M., & Werner, R. (1993) · Cited by 76
Rule extraction by successive regularization
Ishikawa, M. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00072-1 · Cited by 62
Extraction of Logical Rules from Neural Networks
Duch, W., Adamczak, R., & Grąbczewski, K. (1998) · Neural Processing Letters · doi:10.1023/a:1009670302979 · Cited by 45
Self-citationAcquiring rule sets as a product of learning in a logical neural architecture
Healy, M. J. R., & Caudell, T. P. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572088 · Cited by 45
Rule Induction through Integrated Symbolic and Subsymbolic Processing
McMillan, C., Mozer, M. C., & Smolensky, P. (1992) · Cited by 43
New developments in the Feature Space Mapping model
Adamczak, R., & Jankowski, N. (2000) · Cited by 35
Self-citationHayashi, Y., & Imura, A. (2002) · Annual Meeting of the North American Fuzzy Information Processing Society (NAFIPS) · doi:10.1109/isuma.1990.151303 · Cited by 30
Jankowski, N. (2007) · Cited by 28
Extraction of logical rules from backpropagation networks
Duch, W., & Grąbczewski, K. (1998) · Cited by 26
Self-citationTemplate-Based Algorithms for Connectionist Rule Extraction
Alexander, J. A., & Mozer, M. C. (1994) · Cited by 26
IRIS Revisited: A Comparison of Discriminant and Enhanced Rough Set Data Analysis
Browne, C., Düntsch, I., & Gediga, G. (1998) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1883-3_19 · Cited by 25
Fuzzy and Crisp Logical Rule Extraction Methods in Application to Medical Data
Duch, W., Adamczak, R., Grąbczewski, K., Żal, G., & Hayashi, Y. (2000) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1859-8_29 · Cited by 22
Self-citationExtraction of crisp logical rules using constrained backpropagation networks.
Duch, W., Adamczak, R., Grąbczewski, K., Ishikawa, M., & Ueda, H. R. (1997) · Cited by 22
Self-citationHybrid Neural-global Minimization Method of Logical Rule Extraction
Duch, W., Adamczak, R., Grabczewski, K., & Żal, G. (1999) · Journal of Advanced Computational Intelligence and Intelligent Informatics · doi:10.20965/jaciii.1999.p0348 · Cited by 20
Self-citationExtraction of logical rules from training data using backpropagation networks
Duch, W., Adamczak, R., & Grąbczewski, K. (2000) · Cited by 19
Self-citationRule Extraction from Trained Artifical Neural Networks
Géczy, P., & Usui, S. (1999) · Behaviormetrika · doi:10.2333/bhmk.26.89 · Cited by 15
Rule extraction by successive regularization
Ishikawa, M. (2002) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1996.549058 · Cited by 14
Optimization of logical rules derived by neural procedures
Duch, W., Adamczak, R., & Grąbczewski, K. (2003) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1999.831580 · Cited by 12
Self-citationExtraction of crisp logical rules using constructive constrained backpropagation networks
Duch, W., Adamczak, R., & Grąbczewski, K. (2002) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1997.614440 · Cited by 12
Self-citationNeural optimization of linguistic variables and membership functions
Duch, W., Adamczak, R., & Grąbczewski, K. (2003) · International Conference on Neural Information Processing · doi:10.1109/iconip.1999.845665 · Cited by 10
Self-citationJankowski, N. (2000) · Cited by 6
Constrained backpropagation for feature selection and extraction of logical rules
Duch, W., Adamczak, R., & Grąbczewski, K. (1996) · Cited by 6
Self-citationFloating Gaussian Mapping: a New Model of Adaptive Systems
Duch, W. (1994) · Cited by 2
Self-citation
Cited by
Generalized relevance learning vector quantization
Hammer, B., & Villmann, T. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00079-5 · Cited by 414
Toward optimal feature selection using ranking methods and classification algorithms
Novakovic, J., Strbac, P., & Bulatovic, D. (2011) · Yugoslav Journal of Operations Research · doi:10.2298/yjor1101119n · Cited by 269
Metadata
- Authors
- Duch, W., Adamczak, R., & Grabczewski, K.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2001-03
- Volume
- 12
- Issue
- 2
- Pages
- 277-306
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2143718527
- Cited by
- 272
- References
- 70
- FWCI
- 19.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.