The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
An information theoretic approach to rule induction from databases
Abstract
An algorithm for the induction of rules from examples is introduced. The algorithm is novel in the sense that it not only learns rules for a given concept (classification), but it simultaneously learns rules relating multiple concepts. This type of learning, known as generalized rule induction, is considerably more general than existing algorithms, which tend to be classification oriented. Initially, it is focused on the problem of determining a quantitative, well-defined rule preference measure. In particular, a quantity called the J-measure is proposed as an information-theoretic alternative to existing approaches. The J-measure quantifies the information content of a rule or a hypothesis. The information theoretic origins of this measure are outlined, and its plausibility as a hypothesis preference measure is examined. The ITRULE algorithm, which uses the measure to learn a set of optimal rules from a set of data samples, is defined. Experimental results on real-world data are analyzed.>
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
An introduction to probability theory and its applications
(1958) · Journal of the Franklin Institute · doi:10.1016/0016-0032(58)90688-4 · Cited by 29,269
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Judgment under Uncertainty: Heuristics and Biases
(1982) · doi:10.1017/cbo9780511809477 · Cited by 8,240
Information theory and statistics
(1959) · Journal of the Franklin Institute · doi:10.1016/0016-0032(59)90368-0 · Cited by 7,094
Discrete Multivariate Analysis: Theory and Practice.
Beniger, J. R., Bishop, Y. M. M., Feinberg, S. E., Holland, P. W., Light, R. J., & Mosteller, F. (1975) · Contemporary Sociology · doi:10.2307/2063625 · Cited by 5,108
Judgment under uncertainty: List of contributors
Kahneman, D. J., Slovic, P., & Tversky, A. (1982) · Cited by 4,670
Judgment under uncertainty: Causality and attribution
Kahneman, D. J., Slovic, P., & Tversky, A. (1982) · Cited by 4,670
Judgement under Uncertainty: Heuristics and Biases
Hirschman, E. C., Kahneman, D., Slovic, P., & Tversky, A. (1983) · Journal of Marketing Research · doi:10.2307/3151689 · Cited by 3,813
Language identification in the limit
Gold, E. M. (1967) · Information and Control · doi:10.1016/s0019-9958(67)91165-5 · Cited by 3,572
Pattern classification and scene analysis
Chien, Y. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100577 · Cited by 3,398
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
Induction: Processes of Inference, Learning, and Discovery
Holland, J. H., Holyoak, K. J., Nisbett, R. E., Thagard, P. R., & Smoliar, S. W. (1987) · IEEE Expert · doi:10.1109/mex.1987.4307100 · Cited by 2,305
Clark, P., & Niblett, T. (1989) · Machine Learning · doi:10.1007/bf00116835 · Cited by 2,267
Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy
Shore, J., & Johnson, R. (1980) · IEEE Transactions on Information Theory · doi:10.1109/tit.1980.1056144 · Cited by 1,774
The Handbook of Artificial Intelligence
(1982) · Elsevier eBooks · doi:10.1016/c2013-0-07691-8 · Cited by 1,695
Mitchell, T. M. (1982) · Artificial Intelligence · doi:10.1016/0004-3702(82)90040-6 · Cited by 1,412
An Introduction to Probability Theory and Its Applications
Freedman, D. A., & Feller, W. (1967) · Econometrica · doi:10.2307/1905668 · Cited by 1,244
Expert systems in the micro-electronic age
Michie, D. (1979) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,119
Principles and practice of information theory
Blahut, R. E. (1987) · Medical Entomology and Zoology · Cited by 1,008
Information Theory and Statistics.
Lindley, D. V., & Kullback, S. (1959) · Journal of the American Statistical Association · doi:10.2307/2282528 · Cited by 960
Inductive Inference: Theory and Methods
Angluin, D., & Smith, C. H. (1983) · ACM Computing Surveys · doi:10.1145/356914.356918 · Cited by 887
Rivest, R. L. (1987) · Machine Learning · doi:10.1007/bf00058680 · Cited by 886
Induction of decision trees. Machine Learning
Quinlan, J. R. (1986) · Symposium on the Theory of Computing · Cited by 809
Inferring decision trees using the minimum description lenght principle
Ross Quinlan, J., & Rivest, R. L. (1989) · Information and Computation · doi:10.1016/0890-5401(89)90010-2 · Cited by 652
PRISM: An algorithm for inducing modular rules
Cendrowska, J. (1987) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(87)80003-2 · Cited by 650
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
Sparks, J. N., & Good, I. J. (1967) · American Educational Research Journal · doi:10.2307/1162122 · Cited by 528
Generating Production Rules From Decision Trees
Quinlan, J. R. (1987) · Cited by 488
Pattern Recognition as Rule-Guided Inductive Inference
Michalski, R. S. (1980) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1980.4767034 · Cited by 405
Knowledge Acquisition for Expert Systems
Hart, A. (1988) · Knowledge, Skill and Artificial Intelligence · doi:10.1007/978-1-4471-1632-5_10 · Cited by 387
Scoring Rules and the Inevitability of Probability
Lindley, D. V. (1982) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1402448 · Cited by 334
Cheeseman, P. C. (1985) · Cited by 259
What Kind Of Expert Should A System Be?
Johnson, P. E. (1983) · Journal of Medicine and Philosophy · doi:10.1093/jmp/8.1.77 · Cited by 218
Synthesizing Statistical Knowledge from Incomplete Mixed-Mode Data
Wong, A. K. C., & Chiu, D. K. Y. (1987) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1987.4767986 · Cited by 192
Knowledge acquisition for expert systems
Brodheim, E. (1987) · European Journal of Operational Research · doi:10.1016/0377-2217(87)90281-5 · Cited by 156
Personal construct theory and the transfer of human expertise
Boose, J. H. (1984) · Cited by 118
Behaviour/structure transformations under uncertainty
Gaines, B. R. (1976) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(76)80005-3 · Cited by 70
Decision tree design from a communication theory standpoint
Goodman, R. M., & Smyth, P. (1988) · IEEE Transactions on Information Theory · doi:10.1109/18.21221 · Cited by 68
Self-citationBias, Version Spaces and Valiant's Learning Framework
Haussler, D. H. (1987) · Elsevier eBooks · doi:10.1016/b978-0-934613-41-5.50036-2 · Cited by 55
Decision tree design using information theory
Goodman, R. M., & Smyth, P. (1990) · Knowledge Acquisition · doi:10.1016/s1042-8143(05)80020-2 · Cited by 25
Self-citationGenerating rules from examples
Arbab, B., & Michie, D. (1985) · Cited by 21
Valiant, L. G. (2026) · Foundations of Computation and Machine Learning · doi:10.1145/3749740.3749746
Cited by
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
Relief-based feature selection: Introduction and review
Urbanowicz, R. J., Meeker, M., La Cava, W., Olson, R. S., & Moore, J. H. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.07.014 · Cited by 1,311
Efficiently mining long patterns from databases
Bayardo, R. J. (1998) · Proceedings of the 1998 ACM SIGMOD international conference on Management of data · doi:10.1145/276304.276313 · Cited by 1,302
Hand, D. J. (2007) · Drug Safety · doi:10.2165/00002018-200730070-00010 · Cited by 1,044
State-of-the-art in privacy preserving data mining
Verykios, V. S., Bertino, E., Fovino, I. N., Provenza, L. P., Saygin, Y., & Theodoridis, Y. (2004) · ACM SIGMOD Record · doi:10.1145/974121.974131 · Cited by 816
Metadata
- Authors
- Smyth, P., & Goodman, R. M.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 1992
- Volume
- 4
- Issue
- 4
- Pages
- 301-316
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2099321136
- Cited by
- 356
- References
- 43
- FWCI
- 18.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.