Automatically balancing accuracy and comprehensibility in predictive modeling
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
One specific problem, when performing predictive modeling, is the tradeoff between accuracy and comprehensibility. When comprehensible models are required, this normally rules out high-accuracy techniques like neural networks and committee machines. Therefore, an automated choice of a standard technique, known to generally produce sufficiently accurate and comprehensible models, would be of great value. In this paper, it is argued that this requirement is met by an ensemble of classifiers, followed by rule extraction. The proposed technique is demonstrated, using an ensemble of common classifiers and our rule extraction algorithm G-REX, on 17 publicly available data sets. The results presented demonstrate that the suggested technique performs very well. More specifically, the ensemble clearly outperforms the individual classifiers regarding accuracy, while the extracted models have accuracy similar to the individual classifiers. The extracted models are, however, significantly more compact than corresponding models created directly from the data set using the standard tool CART; thus providing higher comprehensibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Survey and critique of techniques for extracting rules from trained artificial neural networks
Andrews, R., Diederich, J., & Tickle, A. B. (1995) · Knowledge-Based Systems · doi:10.1016/0950-7051(96)81920-4 · Cited by 1,225
Production Rules as a Representation for a Knowledge-Based Consultation Program
Davis, R., Buchanan, B., & Shortliffe, E. (1977) · Artificial Intelligence · doi:10.1016/0004-3702(77)90003-0 · Cited by 569
Research works printed but not linked: 15
- 10.1023/A:1007608224229 · DOI · Paper page
- 10.1016/0893-6080(90)90049-Q · DOI · Paper page
- blake, 1998, UCI repository of machine learning databases
- rumelhart, 1986, Learning internal representations by error propagation, Parallel Distributed Processing Explorations in the Microstructure of Cognition, 1
- broomhead, 1998, Multivariate functional interpolation and adaptive networks, Complex Systems, 2, 321
- johansson, 2004, Accuracy vs. Comprehensibility in Data Mining Models, 7th International Conference on Information Fusion, 295
- breiman, 1984, Classification and Regression Trees
- bishop, 1995, Neural Networks for Pattern Recognition
- johansson, 2004, Why Rule Extraction Matters, 8th IASTED International Conference on Software Engineering and Applications, 47
- koza, 1992, Genetic Programming On the Programming of Computers by Natural Selection
- johansson, 2003, Rule Extraction from Trained Neural Networks using Genetic Programming, Supplementary proceedings 13th International Conference on Artificial Neural Networks, 13
- 10.1007/BF00993103 · DOI · Paper page
- craven, 1999, Rule Extraction: Where Do We Go from Here?, University of Wisconsin Machine Learning Research Group working Paper, 99 1
- johansson, 2004, The Truth is in There - Rule Extraction from Opaque Models Using Genetic Programming, 17th Florida Artificial Intelligence Research Symposium (FLAIRS 04), 658
- 10.1109/IJCNN.2003.1224026 · DOI
Cited by
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507
Huysmans, J., Dejaeger, K., Mues, C., Vanthienen, J., & Baesens, B. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.12.003 · Cited by 425
(2018) · arXiv (Cornell University) · Cited by 113
Metadata
- Authors
- Johansson, U., Konig, R., & Niklasson, L.
- Venue
- 2005 7th International Conference on Information Fusion
- Publisher
- IEEE
- Published
- 2005
- Pages
- 7 pp.
- OpenAlex
- W2142026086
- Cited by
- 22
- References
- 2
- FWCI
- 0.95
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatically balancing accuracy and comprehensibility in predictive modeling. https://app.cochat.ai/papers/10.1109/icif.2005.1592040
- The paper
- Johansson, U., Konig, R., & Niklasson, L. (2005). Automatically balancing accuracy and comprehensibility in predictive modeling. 2005 7th International Conference on Information Fusion. https://doi.org/10.1109/icif.2005.1592040
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.