Integrating structured biological data by Kernel Maximum Mean Discrepancy
Open accessThe DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
Abstract
MOTIVATION: Many problems in data integration in bioinformatics can be posed as one common question: Are two sets of observations generated by the same distribution? We propose a kernel-based statistical test for this problem, based on the fact that two distributions are different if and only if there exists at least one function having different expectation on the two distributions. Consequently we use the maximum discrepancy between function means as the basis of a test statistic. The Maximum Mean Discrepancy (MMD) can take advantage of the kernel trick, which allows us to apply it not only to vectors, but strings, sequences, graphs, and other common structured data types arising in molecular biology. RESULTS: We study the practical feasibility of an MMD-based test on three central data integration tasks: Testing cross-platform comparability of microarray data, cancer diagnosis, and data-content based schema matching for two different protein function classification schemas. In all of these experiments, including high-dimensional ones, MMD is very accurate in finding samples that were generated from the same distribution, and outperforms its best competitors. CONCLUSIONS: We have defined a novel statistical test of whether two samples are from the same distribution, compatible with both multivariate and structured data, that is fast, easy to implement, and works well, as confirmed by our experiments. AVAILABILITY: http://www.dbs.ifi.lmu.de/~borgward/MMD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“For example, legs have different frequencies of kinematic and EMG oscillations from arms [45].”
From ContrasGAN: Unsupervised domain adaptation in Human Activity Recognition via adversarial and contrastive learning (2021) · cites this paper as [45]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Probability Inequalities for sums of Bounded Random Variables
Hoeffding, W. (1994) · Springer Series in Statistics · doi:10.1007/978-1-4612-0865-5_26 · Cited by 6,666
Kernel Methods for Pattern Analysis
Shawe-Taylor, J., & Cristianini, N. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809682 · Cited by 6,587
Approximation Theorems of Mathematical Statistics
Serfling, R. J. (1980) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316481 · Cited by 5,851
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Probability Inequalities for Sums of Bounded Random Variables
Hoeffding, W. (1963) · Journal of the American Statistical Association · doi:10.1080/01621459.1963.10500830 · Cited by 4,852
Gene expression correlates of clinical prostate cancer behavior
Singh, D., Febbo, P. G., Ross, K., Jackson, D. G., Manola, J., Ladd, C., Tamayo, P., Renshaw, A. A., D'Amico, A. V., Richie, J. P., et al. (2002) · Cancer Cell · doi:10.1016/s1535-6108(02)00030-2 · Cited by 2,512
A Class of Statistics with Asymptotically Normal Distribution
Hoeffding, W. (1948) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730196 · Cited by 1,928
A Class of Statistics with Asymptotically Normal Distribution
Hoeffding, W. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_20 · Cited by 1,851
(1972) · Elsevier eBooks · doi:10.1016/c2013-0-06164-6 · Cited by 1,728
Predicting the clinical status of human breast cancer by using gene expression profiles
West, M., Blanchette, C., Dressman, H., Huang, E., Ishida, S., Spang, R., Zuzan, H., Olson, J. A., Marks, J. R., & Nevins, J. R. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.201162998 · Cited by 1,318
Dudley, R. M. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511755347 · Cited by 1,281
Probability Inequalities for Sums of Bounded Random Variables
Hoeffding, W. (1963) · Journal of the American Statistical Association · doi:10.2307/2282952 · Cited by 1,166
Protein function prediction via graph kernels
Borgwardt, K. M., Ong, C. S., Schonauer, S., Vishwanathan, S. V. N., Smola, A. J., & Kriegel, H.-P. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti1007 · Cited by 1,105
Self-citationApproximation Theorems of Mathematical Statistics.
Serfling, R. J. (1981) · Biometrics · doi:10.2307/2530199 · Cited by 1,104
Kernel Methods in Computational Biology
(2004) · The MIT Press eBooks · doi:10.7551/mitpress/4057.001.0001 · Cited by 1,032
On Graph Kernels: Hardness Results and Efficient Alternatives
Gärtner, T., Flach, P., & Wrobel, S. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45167-9_11 · Cited by 879
Welsh, J. B., Sapinoso, L. M., Su, A. I., Kern, S. G., Wang‐Rodriguez, J., Moskaluk, C. A., Frierson, H. F., & Hampton, G. M. (2001) · PubMed · Cited by 856
Monti, S. (2005) · Blood · doi:10.1182/blood-2004-07-2947 · Cited by 820
(2001) · Probabilistic Risk Analysis · doi:10.1017/cbo9780511813597.005 · Cited by 714
Gruvberger-Saal, S. K., Ringnér, M., Chen, Y., Panavally, S., Saal, L. H., Borg, Å., Fernö, M., Peterson, C., & Meltzer, P. S. (2001) · PubMed · Cited by 673
Multivariate Generalizations of the Wald-Wolfowitz and Smirnov Two-Sample Tests
Friedman, J. H., & Rafsky, L. C. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344722 · Cited by 665
A Generalized T Test and Measure of Multivariate Dispersion
Hotelling, H. (1951) · Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability · doi:10.1525/9780520411586-004 · Cited by 335
Mining coherent dense subgraphs across massive biological networks for functional discovery
Hu, H., Yan, X., Huang, Y., Han, J., & Zhou, X. J. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti1049 · Cited by 333
Getting the Noise Out of Gene Arrays
Marshall, E. (2004) · Science · doi:10.1126/science.306.5696.630 · Cited by 301
Van den Bulcke, T., Van Leemput, K., Naudts, B., van Remortel, P., Ma, H., Verschoren, A., De Moor, B., & Marchal, K. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-43 · Cited by 293
Warnat, P., Eils, R., & Brors, B. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-265 · Cited by 228
Anderson, N. H., Hall, P., & Titterington, D. M. (1994) · Journal of Multivariate Analysis · doi:10.1006/jmva.1994.1033 · Cited by 205
Shi, L., Tong, W., Fang, H., Scherf, U., Han, J., Puri, R. K., Frueh, F. W., Goodsaid, F. M., Guo, L., Su, Z., et al. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-s2-s12 · Cited by 201
Convergence de la répartition empirique vers la répartition théorique
Fortet, R., & Mourier, E. (1953) · Annales scientifiques de l'École normale supérieure · doi:10.24033/asens.1013 · Cited by 188
A Distribution Free Version of the Smirnov Two Sample Test in the $p$-Variate Case
Bickel, P. J. (1969) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697800 · Cited by 143
Hilbertian Metrics and Positive Definite Kernels on Probability Measures
Hein, M., & Bousquet, O. (2005) · Cited by 135
Permutation tests for equality of distributions in high-dimensional settings
Hall, P. (2002) · Biometrika · doi:10.1093/biomet/89.2.359 · Cited by 135
Carter, S. L., Eklund, A. C., Mecham, B. H., Kohane, I. S., & Szallasi, Z. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-107 · Cited by 131
Approximation Theorems of Mathematical Statistics
Larsen, P. V. (2003) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.1111/1467-9884.t01-8-00356 · Cited by 109
Evaluation of the similarity of gene expression data estimated with SAGE and Affymetrix GeneChips
van Ruissen, F., Ruijter, J. M., Schaaf, G. J., Asgharnegad, L., Zwijnenburg, D. A., Kool, M., & Baas, F. (2005) · BMC Genomics · doi:10.1186/1471-2164-6-91 · Cited by 73
Cuturi, M., Fukumizu, K., & Vert, J. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1088712 · Cited by 70
Stec, J. J., Wang, J., Coombes, K. R., Ayers, M., Hoersch, S., Gold, D. L., Ross, J. S., Hess, K. R., Tirrell, S. M., Linette, G. P., et al. (2005) · Journal of Molecular Diagnostics · doi:10.1016/s1525-1578(10)60565-x · Cited by 52
On the Asymptotic Properties of a Nonparametric<tex>$L_1$</tex>-Test Statistic of Homogeneity
Biau, G., & Gyorfi, L. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.856979 · Cited by 46
Monti, S., Savage, K. J. J., Kutok, J. L., Feuerhake, F., Kurtin, P. J., Mihm, M. C., Wu, B., Pasqualucci, L., Neuberg, D. S., Aguiar, R. C. T., et al. (2004) · Blood · doi:10.1182/blood.v104.11.25.25 · Cited by 39
Research works printed but not linked: 3
- G. Biau and L. Gyorfi. On the asymptotic properties of a nonparametric l 1 -test statistic of homogeneity. IEEE Transactions on Information Theory, 51(11):3965-3973, 2005.
- B. Scho ¨lkopf and A. Smola. Learning with Kernels. MIT Press, Cambridge, MA, 2002.
- I. Steinwart. On the influence of the kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2:67-93, 2002.
Cited by
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
“The measurement termed maximum mean discrepancy (MMD) is widely used in the field of transfer learning, which is formulated as follows [35]:”
MethodWeiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
Self-citationUnsupervised Domain Adaptation by Backpropagation
Ganin, Y., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.7495 · Cited by 2,521
Metadata
- Authors
- Borgwardt, K. M., Gretton, A., Rasch, M. J., Kriegel, H.-P., Schölkopf, B., & Smola, A. J.
- Affiliations
- Ludwig-Maximilians-Universität München (DE)
- Max Planck Institute for Biological Cybernetics (DE)
- Graz University of Technology (AT)
- Data61 (AU)
- Corresponding author
- Borgwardt, Karsten M.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-07-15
- Volume
- 22
- Issue
- 14
- Pages
- e49-e57
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2164943005
- Cited by
- 1,674
- References
- 40
- Citations by year
- 2026: 70 · 2025: 167 · 2024: 215 · 2023: 189 · 2022: 193 · 2021: 191 · 2020: 156 · 2019: 127 · 2018: 83 · 2017: 48 · 2016: 42 · 2015: 34 · 2014: 31 · 2013: 33 · 2012: 29
- FWCI
- 4.76
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Bioinformatics (publishedVersion)
- PubMed (publishedVersion)
- Max Planck Institute for Plasma Physics (submittedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- National ICT Australia
- Deutsches Krebsforschungszentrum
- Australian Government
- Bundesministerium für Bildung und Forschung (031U112F)
- Austrian Science Fund
- Australian Research Council
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- maximum mean discrepancy, kernel methods, distribution comparison, hypothesis testing, structured data, cancer diagnosis, schema matching, protein function classification, high-dimensional data
- MeSH terms
- Algorithms, Computer Simulation, Data Interpretation, Statistical, Models, Biological, Models, Statistical, Statistical Distributions, Databases, Factual, Information Storage and Retrieval, Sample Size, Systems Integration, Computational Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.