The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Cohen's kappa coefficient as a performance measure for feature selection
Abstract
Measuring the performance of a given classifier is not a straightforward or easy task. Depending on the application, the overall classification rate may not be sufficient if one, or more, of the classes fail in prediction. This problem is also reflected in the feature selection process, especially when a wrapper method is used. Cohen's kappa coefficient is a statistical measure of inter-rater agreement for qualitative items. It is generally thought to be a more robust measure than simple percent agreement calculation, since it takes into account the agreement occurring by chance. Considering that kappa is a more conservative measure, then its use in wrapper feature selection is suitable to test the performance of the models. This paper proposes the use of the kappa measure as an evaluation measure in a feature selection wrapper approach. In the proposed approach, fuzzy models are used to test the feature subsets and fuzzy criteria are used to formulate the feature selection problem. Results show that using the kappa measure leads to more accurate classifiers, and therefore it leads to feature subset solutions with more relevant features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Fuzzy identification of systems and its applications to modeling and control
Takagi, T., & Sugeno, M. (1985) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1985.6313399 · Cited by 19,592
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
(2007) · Handbook of Approximation Algorithms and Metaheuristics · doi:10.1201/9781420010749-33 · Cited by 6,607
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Fuzzy Sets and Fuzzy Logic: Theory and Applications
Klir, G. J., & Yuan, B. (1995) · Medical Entomology and Zoology · Cited by 6,240
Abe, S. (2001) · Springer eBooks · doi:10.1007/978-1-4471-0285-4 · Cited by 3,721
Fuzzy clustering with a fuzzy covariance matrix
Gustafson, D., & Kessel, W. (1978) · 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes · doi:10.1109/cdc.1978.268028 · Cited by 1,978
Dorigo, M., Birattari, M., & Stutzle, T. (2006) · IEEE Computational Intelligence Magazine · doi:10.1109/ci-m.2006.248054 · Cited by 1,880
Fuzzy sets and fuzzy logic: theory and applications
(1996) · Choice Reviews Online · doi:10.5860/choice.33-2786 · Cited by 1,871
Feature Extraction: Foundations and Applications
(2006) · Studies in Fuzziness and Soft Computing · doi:10.1007/978-3-540-35488-8 · Cited by 981
Kuncheva, L. I. (2000) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1850-5 · Cited by 511
Comparison of classification accuracy using Cohen’s Weighted Kappa
BENDAVID, A. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.10.022 · Cited by 319
Pruning decision trees with misclassification costs
Bradford, J. P., Kunz, C., Kohavi, R., Brunk, C., & Brodley, C. E. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026682 · Cited by 195
Two cooperative ant colonies for feature selection using fuzzy models
Vieira, S. M., Sousa, J. M. C., & Runkler, T. A. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.08.026 · Cited by 104
Self-citationBootstrap Methods for the Cost-Sensitive Evaluation of Classifiers
Margineantu, D. D., & Dietterich, T. G. (2000) · Cited by 84
Cited by
Ali, M. M., Paul, B. K., Ahmed, K., Bui, F. M., Quinn, J. M. W., & Moni, M. A. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104672 · Cited by 494
Chicco, D., Warrens, M. J., & Jurman, G. (2021) · IEEE Access · doi:10.1109/access.2021.3084050 · Cited by 444
Vieira, S. M., Mendonça, L. F., Farinha, G. J., & Sousa, J. M. C. (2013) · Applied Soft Computing · doi:10.1016/j.asoc.2013.03.021 · Cited by 292
Self-citationKarakose, T., Demirkol, M., Aslan, N., Köse, H., & Yirci, R. (2023) · Educational Process International Journal · doi:10.22521/edupij.2023.123.1 · Cited by 65
Masikisiki, B., Marivate, V., & Hlophe, Y. (2023) · Proceedings of the 4th African Human Computer Interaction Conference · doi:10.1145/3628096.3628747 · Cited by 13
Metadata
- Authors
- Vieira, S. M., Kaymak, U., & Sousa, J. M. C.
- Venue
- International Conference on Fuzzy Systems
- Publisher
- IEEE
- Published
- 2010-07
- Pages
- 1-8
- OpenAlex
- W2135198734
- Cited by
- 300
- References
- 18
- FWCI
- 3.12
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.