The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Mutual Information between Discrete and Continuous Data Sets
Open accessAbstract
Mutual information (MI) is a powerful method for detecting relationships between data sets. There are accurate methods for estimating MI that avoid problems with "binning" when both data sets are discrete or when both data sets are continuous. We present an accurate, non-binning MI estimator for the case of one discrete data set and one continuous data set. This case applies when measuring, for example, the relationship between base sequence and gene expression level, or the effect of a cancer drug on patient survival time. We also show how our method can be adapted to calculate the Jensen-Shannon divergence of two or more data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
(1972) · Cited by 17,806
Kraskov, A., Stögbauer, H., & Grassberger, P. (2004) · Physical Review E · doi:10.1103/physreve.69.066138 · Cited by 3,512
Analysis of symbolic sequences using the Jensen-Shannon divergence
Grosse, I., Bernaola-Galván, P., Carpena, P., Román-Roldán, R., Oliver, J., & Stanley, H. E. (2002) · Physical Review E · doi:10.1103/physreve.65.041905 · Cited by 297
Cited by
Prototypical Contrastive Learning of Unsupervised Representations
Li, J., Zhou, P., Xiong, C., & Hoi, S. C. H. (2020) · arXiv · doi:10.48550/arxiv.2005.04966 · Cited by 611
From explanations to feature selection: assessing SHAP values as feature selection mechanism
Marcilio, W. E., & Eler, D. M. (2020) · 2020 33rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi51738.2020.00053 · Cited by 504
Liu, B., Gao, X., & Zhang, H. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz740 · Cited by 409
Smallholder maize area and yield mapping at national scales with Google Earth Engine
Jin, Z., Azzari, G., You, C., Di Tommaso, S., Aston, S., Burke, M., & Lobell, D. B. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.04.016 · Cited by 385
Ince, R. A. A., Giordano, B. L., Kayser, C., Rousselet, G. A., Gross, J., & Schyns, P. G. (2017) · Human Brain Mapping · doi:10.1002/hbm.23471 · Cited by 366
Liu, B. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bbx165 · Cited by 322
Anbaee Farimani, S., Vafaei Jahan, M., Milani Fard, A., & Tabbakh, S. R. K. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108742 · Cited by 93
Root-Cause Metric Location for Microservice Systems via Log Anomaly Detection
Wang, L., Zhao, N., Chen, J., Li, P., Zhang, W., & Sui, K. (2020) · 2020 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws49710.2020.00026 · Cited by 84
APOE ε4 carriers share immune-related proteomic changes across neurodegenerative diseases
Shvetcov, A., Johnson, E. C. B., Winchester, L. M., Walker, K. A., Wilkins, H. M., Thompson, T. G., Rothstein, J. D., Krish, V., Imam, F. B., The Global Neurodegeneration Proteomics Consortium (GNPC), et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03835-z · Cited by 78
“We identified APOE ε4-associated proteins using mutual information, a statistical measure that quantifies the amount of information one variable provides about another 77 .”
Distributed selection of continuous features in multilabel classification using mutual information
Gonzalez-Lopez, J., Ventura, S., & Cano, A. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2944298 · Cited by 60
Averaging Is Probably Not the Optimum Way of Aggregating Parameters in Federated Learning
Xiao, P., Cheng, S., Stankovic, V., & Vukobratovic, D. (2020) · Entropy · doi:10.3390/e22030314 · Cited by 54
“MI can detect any kind of relationship between random variables even those that do not manifest themselves in the covariance [21], and has a straightforward interpretation as the amount of shared information between datasets (measured in, for example, bits) [22].”
BackgroundModeling generalization in machine learning: a methodological and computational study
Barbiero, P., Squillero, G., & Tonda, A. (2020) · arXiv · doi:10.48550/arxiv.2006.15680 · Cited by 39
Automated classification of cellular expression in multiplexed imaging data with Nimbus
(2025) · doi:10.1038/s41592-025-02826-9 · Cited by 24
Amorim, R., Simões, I., Veloso, C., Carvalho, A., Simões, R., Pereira, F., Thiel, T., Normann, A., Morais, C., Jurado, A., et al. (2021) · Nutrients · doi:10.3390/nu13051723 · Cited by 21
“, by applying a nonparametric method that approximates the decrease of entropy [37].”
BackgroundMethodLee, J. B., & Lee, H. G. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106014 · Cited by 15
Finding Neurons in a Haystack: Case Studies with Sparse Probing
Gurnee, W., Nanda, N., Pauly, M., Harvey, K., Troitskii, D., & Bertsimas, D. (2023) · arXiv · doi:10.48550/arxiv.2305.01610 · Cited by 15
“…the absolute difference between class means for each neuron (Antverg & Belinkov, 2021), the mutual information between each neuron and the labels (Ross, 2014; Voita & Titov, 2020; Pimentel et al., 2020), or the absolute magnitude of the coefficients of a dense probe trained with l 1…”
BackgroundMethodPartial information decomposition for discrete target and continuous source random variables
Barà, C., Antonacci, Y., Iovino, M., Lazic, I., & Faes, L. (2025) · Physical Review E · doi:10.1103/58bg-5n9s · Cited by 6
Metadata
- Authors
- Ross, B. C.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-02-19
- Volume
- 9
- Issue
- 2
- Pages
- e87357
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2082290707
- Cited by
- 854
- References
- 4
- FWCI
- 5.27
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.