Distributed Selection of Continuous Features in Multilabel Classification Using Mutual Information
The DOI matches its Crossref record; 60 of the 62 references it cites were found in a registry or an index.
Abstract
Multilabel learning is a challenging task demanding scalable methods for large-scale data. Feature selection has shown to improve multilabel accuracy while defying the curse of dimensionality of high-dimensional scattered data. However, the increasing complexity of multilabel feature selection, especially on continuous features, requires new approaches to manage data effectively and efficiently in distributed computing environments. This article proposes a distributed model for mutual information (MI) adaptation on continuous features and multiple labels on Apache Spark. Two approaches are presented based on MI maximization, and minimum redundancy and maximum relevance. The former selects the subset of features that maximize the MI between the features and the labels, whereas the latter additionally minimizes the redundancy between the features. Experiments compare the distributed multilabel feature selection methods on 10 data sets and 12 metrics. Results validated through statistical analysis indicate that our methods outperform reference methods for distributed feature selection for multilabel data, while MIM also reduces the runtime in orders of magnitude.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Their experimental results showcased that Bayesian techniques enhanced predictive performance as stochastic regularisers and uncertainty information could be utilised in trading.”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [522]
In the citing paper
“Zhang et al. [522] demonstrated that a huge deep learning model could utilize dropout variational inference to predict price movements from limit order books (LOBs), the data source with pricing and trading movements.”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [522]
In the citing paper
“Zhang et al. [522] | 2018 | NeurIPS | 5 | Deep learning | BDLOB”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [522]
Citations
Cites
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476
A review of feature selection techniques in bioinformatics
Saeys, Y., Inza, I., & Larrañaga, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm344 · Cited by 5,244
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
ML-KNN: A lazy learning approach to multi-label learning
Zhang, M.-L., & Zhou, Z.-H. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.12.019 · Cited by 3,552
Kraskov, A., Stögbauer, H., & Grassberger, P. (2004) · Physical Review E · doi:10.1103/physreve.69.066138 · Cited by 3,512
Apache Spark: A unified engine for big data processing
Zaharia, M., Xin, R. S., Wendell, P., Das, T., Armbrust, M., Dave, A., Meng, X., Rosen, J., Venkataraman, S., Franklin, M. J., et al. (2016) · Communications of the ACM · doi:10.1145/2934664 · Cited by 2,757
RCV1: A New Benchmark Collection for Text Categorization Research
Lewis, D., Yang, Y., Rose, T. G., & Li, F. (2004) · Goldsmiths (University of London) · doi:10.5555/1005332.1005345 · Cited by 2,503
García, S., Fernández, A., Luengo, J., & Herrera, F. (2010) · Information Sciences · doi:10.1016/j.ins.2009.12.010 · Cited by 2,229
Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning
Hall, M. A. (2000) · Cited by 1,715
On the histogram as a density estimator:L 2 theory
Freedman, D., & Diaconis, P. (1981) · Zeitschrift f�r Wahrscheinlichkeitstheorie und Verwandte Gebiete · doi:10.1007/bf01025868 · Cited by 1,601
Tsoumakas, G., Katakis, I., & Vlahavas, I. (2009) · Data Mining and Knowledge Discovery Handbook · doi:10.1007/978-0-387-09823-4_34 · Cited by 1,410
A review of feature selection methods based on mutual information
Vergara, J. R., & Estévez, P. A. (2014) · Neural Computing and Applications · doi:10.1007/s00521-013-1368-0 · Cited by 1,255
Mutual Information between Discrete and Continuous Data Sets
Ross, B. C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0087357 · Cited by 854
Lift: Multi-Label Learning with Label-Specific Features
Zhang, M.-L., & Wu, L. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2339815 · Cited by 536
Feature selection for multi-label naive Bayes classification
Zhang, M.-L., Peña, J. M., & Robles, V. (2009) · Information Sciences · doi:10.1016/j.ins.2009.06.010 · Cited by 505
Estimation of the information by an adaptive partitioning of the observation space
Darbellay, G. A., & Vajda, I. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.761290 · Cited by 493
On the Stratification of Multi-label Data
Sechidis, K., Tsoumakas, G., & Vlahavas, I. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23808-6_10 · Cited by 432
Multi-instance multi-label learning
Zhou, Z.-H., Zhang, M.-L., Huang, S.-J., & Li, Y.-F. (2012) · Artificial Intelligence · doi:10.1016/j.artint.2011.10.002 · Cited by 423
Feature selection for multi-label classification using multivariate mutual information
Lee, J., & Kim, D.-W. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.10.005 · Cited by 321
Multi-label feature selection based on max-dependency and min-redundancy
Lin, Y., Hu, Q., Liu, J., & Duan, J. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.06.010 · Cited by 255
Feature Selection Based on Neighborhood Discrimination Index
Wang, C., Hu, Q., Wang, X., Chen, D., Qian, Y., & Dong, Z. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2710422 · Cited by 240
Binless strategies for estimation of information from neural data
Victor, J. D. (2002) · Physical Review E · doi:10.1103/physreve.66.051903 · Cited by 238
Mutual information for the selection of relevant variables in spectrometric nonlinear modelling
Rossi, F., Lendasse, A., François, D., Wertz, V., & Verleysen, M. (2006) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2005.06.010 · Cited by 220
A Comparison of Multi-label Feature Selection Methods using the Problem Transformation Approach
Spolaôr, N., Cherman, E. A., Monard, M. C., & Lee, H. D. (2013) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2013.02.010 · Cited by 219
Quadratic Programming Feature Selection
Rodríguez-Luján, I., Huerta, R., Elkan, C., Cruz, C. S., & Ungar, L. (2010) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 207
Reyes, O., Morell, C., & Ventura, S. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.02.045 · Cited by 192
Self-citationSCLS: Multi-label feature selection based on scalable criterion for large label set
Lee, J., & Kim, D.-W. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.01.014 · Cited by 191
ReliefF for Multi-label Feature Selection
Spolaor, N., Cherman, E. A., Monard, M. C., & Lee, H. D. (2013) · 2013 Brazilian Conference on Intelligent Systems · doi:10.1109/bracis.2013.10 · Cited by 184
Mutual Information-based multi-label feature selection using interaction information
Lee, J., & Kim, D.-W. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.09.063 · Cited by 172
Multi-label feature selection with missing labels
Zhu, P., Xu, Q., Hu, Q., Zhang, C., & Zhao, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.036 · Cited by 171
Granular multi-label feature selection based on mutual information
Li, F., Miao, D., & Pedrycz, W. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.02.025 · Cited by 167
Fast multi-label feature selection based on information-theoretic feature ranking
Lee, J., & Kim, D.-W. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.04.009 · Cited by 165
Multi-label classification of music by emotion
Trohidis, K., Tsoumakas, G., Kalliris, G. M., & Vlahavas, I. P. (2011) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/1687-4722-2011-426793 · Cited by 155
Distributed multi-label feature selection using individual mutual information measures
Gonzalez-Lopez, J., Ventura, S., & Cano, A. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105052 · Cited by 155
Self-citationMutual information-based feature selection for multilabel classification
Doquire, G., & Verleysen, M. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.06.035 · Cited by 152
Document Transformation for Multi-label Feature Selection in Text Categorization
Chen, W., Yan, J., Zhang, B., Chen, Z., & Yang, Q. (2007) · Proceedings · doi:10.1109/icdm.2007.18 · Cited by 140
A pruned problem transformation method for multi-label classification
Read, J. (2008) · Cited by 129
An Easy-to-hard Learning Paradigm for Multiple Classes and Multiple Labels
Liu, W., Tsang, I. W.-H., & Müller, K. (2017) · MPG.PuRe (Max Planck Society) · Cited by 100
Entropy expressions for multivariate continuous distributions
Darbellay, G. A., & Vajda, I. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.825848 · Cited by 91
Perspectives on grid computing
Uwe Schwiegelshohn, A., Badia, R. M., Bubak, M., Danelutto, M., Dustdar, S., Gagliardi, F., Geiger, A., Hluchý, L., Kranzlmüller, D. A., Laure, E., et al. (2010) · Future Generation Computer Systems · doi:10.1016/j.future.2010.05.010 · Cited by 87
Making decision trees feasible in ultrahigh feature and label dimensions
Liu, W., & Tsang, I. W.-H. (2017) · OPUS - Open Publications of UTS Scholars (University of Technology Sydney) · doi:10.5555/3122009.3176825 · Cited by 87
Multilabel Prediction via Cross-View Search
Shen, X., Liu, W., Tsang, I. W.-H., Sun, Q., & Ong, Y.-S. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2763967 · Cited by 72
Feature Selection Based on the Neighborhood Entropy
Mariello, A., & Battiti, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2830700 · Cited by 50
A Framework to Generate Synthetic Multi-label Datasets
Tomás, J. T., Spolaôr, N., Cherman, E. A., & Monard, M. C. (2014) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2014.01.025 · Cited by 48
LAIM discretization for multi-label data
Cano, A., Luna, J. M., Gibaja, E., & Ventura, S. (2015) · Information Sciences · doi:10.1016/j.ins.2015.10.032 · Cited by 47
Self-citationDistributed nearest neighbor classification for large-scale multi-label data on spark
Gonzalez-Lopez, J., Ventura, S., & Cano, A. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.04.094 · Cited by 43
Self-citationConfiguring in-memory cluster computing using random forest
Bei, Z., Yu, Z., Luo, N., Jiang, C., Xu, C., & Feng, S. (2017) · Future Generation Computer Systems · doi:10.1016/j.future.2017.08.011 · Cited by 38
Learning safe multi-label prediction for weakly labeled data
Wei, T., Guo, L.-Z., Li, Y.-F., & Gao, W. (2017) · Machine Learning · doi:10.1007/s10994-017-5675-z · Cited by 35
Multi-Label Learning with PRO Loss
Xu, M., Li, Y.-F., & Zhou, Z. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8689 · Cited by 30
A Sequential Learning Approach for Scaling Up Filter-Based Feature Subset Selection
Ditzler, G., Polikar, R., & ROSEN, G. L. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2697407 · Cited by 29
ReliefF-ML: An Extension of ReliefF Algorithm to Multi-label Learning
Reyes, Ó., Morell, C., & Soto, S. V. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-41827-3_66 · Cited by 25
Does Tail Label Help for Large-Scale Multi-Label Learning
Wei, T., & Li, Y.-F. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/395 · Cited by 25
Shen, X., Liu, W., Tsang, I. W.-H., Sun, Q., & Ong, Y.-S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11708 · Cited by 18
Multi-Label Learning Using Mathematical Programming
Lim, H., Lee, J., & Kim, D. (2015) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2014edl8139 · Cited by 15
Large-Scale Multi-label Ensemble Learning on Spark
Gonzalez-Lopez, J., Cano, A., & Ventura, S. (2017) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom/bigdatase/icess.2017.328 · Cited by 14
Self-citationMulti-label regularized quadratic programming feature selection algorithm with Frank–Wolfe method
Xu, J., & Ma, Q. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.11.018 · Cited by 12
Deep Discrete Prototype Multilabel Learning
Shen, X., Liu, W., Luo, Y., Ong, Y.-S., & Tsang, I. W.-H. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/371 · Cited by 12
Learning Compact Model for Large-Scale Multi-Label Data
Wei, T., & Li, Y.-F. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015385 · Cited by 10
Accelerating Multi-Label Feature Selection Based on Low-Rank Approximation
Lim, H., Lee, J., & Kim, D. (2016) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2015edl8243 · Cited by 7
Doubly Approximate Nearest Neighbor Classification
Liu, W., Liu, Z., Tsang, I. W.-H., Zhang, W., & Lin, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11690 · Cited by 4
Research works printed but not linked: 2
- tsoumakas, 2007, Random $\kappa$ -labelsets: An ensemble method for multilabel classification, Proc Eur Conf Mach Learn, 406
- kozachenko, 1987, Sample estimate of the entropy of a random vector, Problemy Peredachi Inform, 23, 9
Cited by
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
“[300], Foong et al.”
Sun, L., Yin, T., Ding, W., Qian, Y., & Xu, J. (2022) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2021.3053844 · Cited by 177
Learning correlation information for multi-label feature selection
Fan, Y., Liu, J., Tang, J., Liu, P., Lin, Y., & Du, Y. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109899 · Cited by 140
Multi-objective PSO based online feature selection for multi-label classification
Paul, D., Jain, A., Saha, S., & Mathew, J. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106966 · Cited by 116
Group-preserving label-specific feature selection for multi-label learning
Zhang, J., Wu, H., Jiang, M., Liu, J., Li, S., Tang, Y. Z., & Long, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118861 · Cited by 111
Metadata
- Authors
- Gonzalez-Lopez, J., Ventura, S., & Cano, A.
- Affiliations
- Virginia Commonwealth University (US)
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2019
- Volume
- 31
- Issue
- 7
- Pages
- 1-14
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2982208318
- Cited by
- 60
- References
- 62
- Citations by year
- 2025: 6 · 2024: 7 · 2023: 10 · 2022: 15 · 2021: 11 · 2020: 11
- FWCI
- 4.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- Funders
- 2018 VCU Presidential Research Quest Fund
- Amazon AWS Machine Learning Research Award
- Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (TIN2017-83445-P)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- multi-label classification, feature selection, continuous attributes, mutual information, distributed computing, Apache Spark, minimum redundancy maximum relevance, feature redundancy, high-dimensional data, scalability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.