The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Equitability, mutual information, and the maximal information coefficient
Open accessAbstract
Significance: Attention has recently focused on a basic yet unresolved problem in statistics: How can one quantify the strength of a statistical association between two variables without bias for relationships of a specific form? Here we propose a way of mathematically formalizing this “equitability” criterion, using core concepts from information theory. This criterion is naturally satisfied by a fundamental information-theoretic measure of dependence called “mutual information.” By contrast, a recently introduced dependence measure called the “maximal information coefficient” is seen to violate equitability. We conclude that estimating mutual information provides a natural and practical method for equitably quantifying associations in large datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This reasoning reflects a formal result known as the Data Processing Inequality (20) (Supp Methods 10.1).”
From Lineage tracing on transcriptional landscapes links state to fate during differentiation (2020) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Independent component analysis: algorithms and applications
Hyvärinen, A., & Oja, E. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00026-5 · Cited by 8,705 · cited 1×
“Although substantial difficulties with estimating mutual information on continuous data remain, such estimates have proved useful in a variety of realworld problems in neuroscience (14, 15, 25), molecular biology (16, 17, 26–28), medical imaging (29), and signal processing (13).”
BackgroundInformation theory and statistics
(1959) · Journal of the Franklin Institute · doi:10.1016/0016-0032(59)90368-0 · Cited by 7,094
Kraskov, A., Stögbauer, H., & Grassberger, P. (2004) · Physical Review E · doi:10.1103/physreve.69.066138 · Cited by 3,512 · cited 2×
“Mutual information was estimated using the KNN algorithm (18) with k=1.”
BackgroundMethodDetecting Novel Associations in Large Data Sets
Reshef, D. N., Reshef, Y. A., Finucane, H. K., Grossman, S. R., McVean, G., Turnbaugh, P. J., Lander, E. S., Mitzenmacher, M., & Sabeti, P. C. (2011) · Science · doi:10.1126/science.1205438 · Cited by 3,339 · cited 10×
“claim in their paper (1) that mutual information does not satisfy the heuristic notion of equitability.”
BackgroundInfluentialElements of Information Theory
Jacobs, K. (1992) · Discrete Stochastics · doi:10.1007/978-3-0348-8645-1_7 · Cited by 2,918
Mutual-information-based registration of medical images: a survey
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815867 · Cited by 2,890 · cited 1×
“Although substantial difficulties with estimating mutual information on continuous data remain, such estimates have proved useful in a variety of realworld problems in neuroscience (14, 15, 25), molecular biology (16, 17, 26–28), medical imaging (29), and signal processing (13).”
BackgroundSpikes: Exploring the Neural Code
Rieke, F. M., Warland, D., van Steveninck, R. R. D. R., & Bialek, W. (1996) · Medical Entomology and Zoology · Cited by 2,844
Research works printed but not linked: 1
- G Miller, Note on the bias of information estimates. Information Theory in Psychology II-B, ed H Quastler (Free Press, Glencoe, IL), pp. 95–100 (1955).
Cited by
Lineage tracing on transcriptional landscapes links state to fate during differentiation
Weinreb, C., Rodriguez-Fraticelli, A., Camargo, F. D., & Klein, A. M. (2020) · Science · doi:10.1126/science.aaw3381 · Cited by 759
“This reasoning reflects a formal result knownas data-processing inequality (20) (materials and methods, section 10.”
MethodMINE: Mutual Information Neural Estimation
Belghazi, M. I., Baratin, A., Rajeswar, S., Ozair, S., Bengio, Y., Courville, A. C., & Hjelm, R. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04062 · Cited by 405
“This important property, that guarantees the quantification dependence without bias for the relationship, is called equitability (Kinney & Atwal, 2014).”
BackgroundGene Regulatory Network Inference from Single-Cell Data Using Multivariate Information Measures
Chan, T. E., Stumpf, M. P. H., & Babtie, A. C. (2017) · Cell Systems · doi:10.1016/j.cels.2017.08.014 · Cited by 578
Ince, R. A. A., Giordano, B. L., Kayser, C., Rousselet, G. A., Gross, J., & Schyns, P. G. (2017) · Human Brain Mapping · doi:10.1002/hbm.23471 · Cited by 366
“It can be viewed as a statistical test against a null hypothesis that two variables are statistically independent, but in addition its effect size (measured in bits) has a number of useful properties and interpretations [Kinney and Atwal, 2014).”
BackgroundA variable selection method based on mutual information and variance inflation factor
Cheng, J., Sun, J., Yao, K., Xu, M., & Cao, Y. (2022) · Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy · doi:10.1016/j.saa.2021.120652 · Cited by 319
Metadata
- Authors
- Kinney, J. B., & Atwal, G. S.
- Affiliations
- Cold Spring Harbor Laboratory (US)
- Corresponding author
- Kinney, Justin B.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2014-02-18
- Volume
- 111
- Issue
- 9
- Pages
- 3354-3359
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC3948249
- OpenAlex
- W2149350210
- Cited by
- 667
- References
- 55
- Citations by year
- 2026: 42 · 2025: 87 · 2024: 69 · 2023: 68 · 2022: 71 · 2021: 75 · 2020: 54 · 2019: 38 · 2018: 46 · 2017: 33 · 2016: 32 · 2015: 24 · 2014: 23
- FWCI
- 39.47
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- other-oa
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Cold Spring Harbor Laboratory Institutional Repository (Cold Spring Harbor Laboratory) (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computability, Logic, AI Algorithms
- Keywords
- species evenness, mutual information, maximal information coefficient, dependence measures, data processing inequality, self-consistency condition, associative strength, statistical power
- MeSH terms
- Data Interpretation, Statistical, Information Theory, Mathematics, Statistics as Topic, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Equitability, mutual information, and the maximal information coefficient. https://app.cochat.ai/papers/10.1073/pnas.1309933111
- The paper
- Kinney, J. B., & Atwal, G. S. (2014). Equitability, mutual information, and the maximal information coefficient. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1309933111
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.