The DOI matches its Crossref record; 234 of the 234 references it cites were found in a registry or an index.
Kernel Mean Embedding of Distributions: A Review and Beyond
Open accessAbstract
A Hilbert space embedding of a distribution—in short, a kernel mean embedding—has recently emerged as a powerful tool for machine learning and statistical inference. The basic idea behind this framework is to map distributions into a reproducing kernel Hilbert space (RKHS) in which the whole arsenal of kernel methods can be extended to probability measures. It can be viewed as a generalization of the original “feature map” common to support vector machines (SVMs) and other kernel methods. In addition to the classical applications of kernel methods, the kernel mean embedding has found novel applications in fields ranging from probabilistic modeling to statistical inference, causal discovery, and deep learning. This survey aims to give a comprehensive review of existing work and recent advances in this research area, and to discuss challenging issues and open problems that could potentially lead to new research directions. The survey begins with a brief introduction to the RKHS and positive definite kernels which forms the backbone of this survey, followed by a thorough discussion of the Hilbert space embedding of marginal distributions, theoretical guarantees, and a review of its applications. The embedding of distributions enables us to apply RKHS methods to probability measures which prompts a wide range of applications such as kernel two-sample testing, independent testing, and learning on distributional data. Next, we discuss the Hilbert space embedding for conditional distributions, give theoretical insights, and review some applications. The conditional mean embedding enables us to perform sum, product, and Bayes' rules—which are ubiquitous in graphical model, probabilistic inference, and reinforcement learning— in a non-parametric way using this new representation of distributions. We then discuss relationships between this framework and other related areas. Lastly, we give some suggestions on future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
(1988) · Cited by 16,582
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
LIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 11,934
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Self-citationAnalysis of a complex of statistical variables into principal components.
Hotelling, H. (1933) · Journal of Educational Psychology · doi:10.1037/h0071325 · Cited by 9,633
(2012) · Cited by 9,062
Coordination of groups of mobile autonomous agents using nearest neighbor rules
Jadbabaie, A., Lin, J., & Morse, A. S. (2003) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2003.812781 · Cited by 8,339
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Self-citationFlocks, herds and schools: A distributed behavioral model
Reynolds, C. W. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37406 · Cited by 7,714
Robust estimation of a location parameter
Huber, P. J. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703732 · Cited by 7,228
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Kernel Methods for Pattern Analysis
Shawe-Taylor, J., & Cristianini, N. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809682 · Cited by 6,587
Weiss, M. (1997) · Automatica · doi:10.1016/s0005-1098(97)00132-5 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (1993) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2748-9 · Cited by 4,617
Advances In Deep Learning On Graphs (Gsp'18 Workshop)
Defferrard, M. (2016) · Figshare · doi:10.5281/zenodo.1286817 · Cited by 4,613
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505
Vaart, A. W. V. D. (1998) · doi:10.1017/cbo9780511802256 · Cited by 4,159
Spectral Networks and Locally Connected Networks on Graphs
Bruna, J., Zaremba, W., Szlam, A., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6203 · Cited by 3,983
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
Self-citationDifferential Privacy: A Survey of Results
Dwork, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-79228-4_1 · Cited by 3,542
The explicit linear quadratic regulator for constrained systems
Bemporad, A., Morari, M., Dua, V., & Pistikopoulos, E. N. (2002) · Automatica · doi:10.1016/s0005-1098(01)00174-1 · Cited by 3,260
Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Dayan, P., & Abbott, L. F. (2001) · Cited by 3,153
Introductory functional analysis with applications
Kreyszig, E. (1978) · Cited by 2,889
Random Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783
Statistical Inference for Probabilistic Functions of Finite State Markov Chains
Baum, L. E., & Petrie, T. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699147 · Cited by 2,775
Measuring and testing dependence by correlation of distances
Székely, G. J., Rizzo, M. L., & Bakirov, N. K. (2007) · The Annals of Statistics · doi:10.1214/009053607000000505 · Cited by 2,684
Wendland, H. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511617539 · Cited by 2,538
Bellman, R. (1957) · Indiana University Mathematics Journal · doi:10.1512/iumj.1957.6.56038 · Cited by 2,408
AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles
Shah, S., Dey, D., Lovett, C., & Kapoor, A. (2018) · Springer Proceedings in Advanced Robotics · doi:10.1007/978-3-319-67361-5_40 · Cited by 2,254
Estimation with Quadratic Loss
James, W., & Stein, C. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_30 · Cited by 2,252
A Kernel Method for the Two-Sample-Problem
Gretton, A., Borgwardt, K. M., Rasch, M., Schölkopf, B., & Smola, A. J. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0069 · Cited by 2,167
Self-citationTheory of linear operators in Hilbert space
Ахиезер, Н. И., & Glazman, I. M. (1993) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,101
Bhattacharyya, A. (1943) · Medical Entomology and Zoology · Cited by 2,002
XVI. Functions of positive and negative type, and their connection the theory of integral equations
Mercer, J. (1909) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1909.0016 · Cited by 2,001
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
A Class of Statistics with Asymptotically Normal Distribution
Hoeffding, W. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_20 · Cited by 1,851
INADMISSIBILITY OF THE USUAL ESTIMATOR FOR THE MEAN OF A MULTIVARIATE NORMAL DISTRIBUTION
Stein, C. (1956) · Contribution to the Theory of Statistics · doi:10.1525/9780520313880-018 · Cited by 1,841
Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning)
Rasmussen, C. E., & Williams, C. K. I. (2005) · The MIT Press eBooks · Cited by 1,829
Integrating structured biological data by Kernel Maximum Mean Discrepancy
Borgwardt, K. M., Gretton, A., Rasch, M. J., Kriegel, H.-P., Schölkopf, B., & Smola, A. J. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl242 · Cited by 1,674
Self-citationUsing the Nyström Method to Speed Up Kernel Machines
Williams, C. K. I., & Seeger, M. (2000) · Cited by 1,646
A Generalized Representer Theorem
Schölkopf, B., Herbrich, R., & Smola, A. J. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44581-1_27 · Cited by 1,589
Self-citationCorrecting Sample Selection Bias by Unlabeled Data
Huang, J., Smola, A. J., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0080 · Cited by 1,571
Self-citationMeasuring Statistical Dependence with Hilbert-Schmidt Norms
Gretton, A., Bousquet, O., Smola, A., & Schölkopf, B. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564089_7 · Cited by 1,560
Self-citationReproducing Kernel Hilbert Spaces in Probability and Statistics
Berlinet, A., & Thomas-Agnan, C. (2004) · Springer eBooks · doi:10.1007/978-1-4419-9096-9 · Cited by 1,558
On the mathematical foundations of learning
Cucker, F., & Smale, S. (2001) · Bulletin of the American Mathematical Society · doi:10.1090/s0273-0979-01-00923-5 · Cited by 1,545
Conditional Independence in Statistical Theory
Dawid, A. P. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01052.x · Cited by 1,501
Maintaining Sensing Coverage and Connectivity in Large Sensor Networks
Zhang, H., & Hou, J. (2005) · Handbook on Theoretical and Algorithmic Aspects of Sensor, Ad Hoc Wireless, and Peer-to-Peer Networks · doi:10.1201/9780203323687.ch28 · Cited by 1,500
The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
Smallwood, R. D., & Sondik, E. J. (1973) · Operations Research · doi:10.1287/opre.21.5.1071 · Cited by 1,479
KERNEL METHODS IN MACHINE LEARNING
Hofmann, T., Schölkopf, B., & Smola, A. J. (2008) · Cited by 1,408
Self-citation(2020) · Data Mining and Machine Learning · doi:10.1017/9781108564175.026 · Cited by 1,401
ALVINN, an autonomous land vehicle in a neural network
Pomerleau, D. (2018) · doi:10.1184/r1/6603146 · Cited by 1,338
Exploiting Generative Models in Discriminative Classifiers
Jaakkola, T., & Haussler, D. H. (1998) · Cited by 1,271
Kernel k-means: spectral clustering and normalized cuts
Dhillon, I. S., Guan, Y., & Kulis, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014118 · Cited by 1,193
Foundations of Machine Learning
Mohri, M., Rostamizadeh, A., & Talwalkar, A. (2018) · doi:10.7551/mitpress/10290.001.0001 · Cited by 1,122
Distributed average consensus with least-mean-square deviation
Xiao, L., Boyd, S., & Kim, S.-J. (2007) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2006.08.010 · Cited by 1,107
All of Statistics: A Concise Course in Statistical Inference
Wasserman, L. (2004) · Springer Texts in Statistics · doi:10.1007/978-0-387-21736-9 · Cited by 1,090
Convolution kernels on discrete structures
Haussler, D. H. (1999) · Cited by 1,089
Unsupervised Domain Adaptation with Residual Transfer Networks
Long, M., Han, Z., Wang, J., & Jordan, M. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.04433 · Cited by 1,075
Probabilistic Inference Using Markov Chain Monte Carlo Methods
Neal, R. M. (2011) · Cited by 1,040
Monte Carlo Statistical Methods (Springer Texts in Statistics)
Robert, C. P., & Casella, G. (2005) · Springer eBooks · Cited by 1,002
All of Nonparametric Statistics
(2006) · Springer Texts in Statistics · doi:10.1007/0-387-30623-4 · Cited by 993
An elementary proof of a theorem of Johnson and Lindenstrauss
Dasgupta, S., & Gupta, A. (2003) · Random Structures & Algorithms · doi:10.1002/rsa.10073 · Cited by 932
Andrieu, C., & Thoms, J. (2008) · Statistics and Computing · doi:10.1007/s11222-008-9110-y · Cited by 903
A Counterexample in Stochastic Optimum Control
Witsenhausen, H. S. (1968) · SIAM Journal on Control · doi:10.1137/0306011 · Cited by 882
Székely, G. J., & Rizzo, M. L. (2009) · The Annals of Applied Statistics · doi:10.1214/09-aoas312 · Cited by 841
Domain Generalization via Invariant Feature Representation
Muandet, K., Balduzzi, D., & Schölkopf, B. (2013) · arXiv · doi:10.48550/arxiv.1301.2115 · Cited by 771
Self-citation(2005) · doi:10.5555/1046920.1088696 · Cited by 756
Dimensionality Reduction for Supervised Learning With Reproducing Kernel Hilbert Spaces
Fukumizu, K., Bach, F. R., & Jordan, M. I. (2003) · doi:10.21236/ada446572 · Cited by 723
Self-citationRényi, A. (1959) · Acta Mathematica Academiae Scientiarum Hungaricae · doi:10.1007/bf02024507 · Cited by 708
A Hilbert Space Embedding for Distributions
Smola, A., Gretton, A., Song, L., & Schölkopf, B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75225-7_5 · Cited by 706
Self-citationThe Algebra of Random Variables
Nelson, P. R. (1981) · Technometrics · doi:10.1080/00401706.1981.10486266 · Cited by 701
Efficient Additive Kernels via Explicit Feature Maps
Vedaldi, A., & Zisserman, A. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.153 · Cited by 688
A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping
Thrun, S., Burgard, W., & Fox, D. (2002) · Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) · doi:10.1109/robot.2000.844077 · Cited by 686
Discrete Signal Processing on Graphs: Sampling Theory
Chen, S., Varma, R., Sandryhaila, A., & Kovacevic, J. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2469645 · Cited by 666
A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots
Giusti, A., Guzzi, J., Ciresan, D. C., He, F.-L., Rodriguez, J. P., Fontana, F., Faessler, M., Forster, C., Schmidhuber, J., Caro, G. D., et al. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2015.2509024 · Cited by 665
Classes of kernels for machine learning: a statistics perspective
Genton, M. G. (2002) · doi:10.5555/944790.944815 · Cited by 607
The Efficiency of Some Nonparametric Competitors of the $t$-Test
Hodges, J. L., & Lehmann, E. L. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728261 · Cited by 587
Equivalence of distance-based and RKHS-based statistics in hypothesis testing
Sejdinovic, D., Sriperumbudur, B., Gretton, A., & Fukumizu, K. (2013) · The Annals of Statistics · doi:10.1214/13-aos1140 · Cited by 582
Self-citationEfficient svm training using low-rank kernel representations
Fine, S., & Scheinberg, K. (2002) · doi:10.5555/944790.944812 · Cited by 579
Optimal Rates for the Regularized Least-Squares Algorithm
Caponnetto, A., & De Vito, E. (2007) · Foundations of Computational Mathematics · doi:10.1007/s10208-006-0196-8 · Cited by 564
Optimal kernel choice for large-scale two-sample tests
Gretton, A., Sejdinović, D., Strathmann, H., Balakrishnan, S., Pontil, M., Fukumizu, K., & Sriperumbudur, B. K. (2012) · Cited by 563
Self-citation(2016) · neural information processing systems · Cited by 556
Learning Theory Estimates via Integral Operators and Their Approximations
Smale, S., & Zhou, D. (2007) · Constructive Approximation · doi:10.1007/s00365-006-0659-y · Cited by 555
Integral Probability Metrics and Their Generating Classes of Functions
Müller, A. (1997) · Advances in Applied Probability · doi:10.1017/s000186780002807x · Cited by 548
PARTIAL CORRELATION AND CONDITIONAL CORRELATION AS MEASURES OF CONDITIONAL INDEPENDENCE
Baba, K., Shibata, R., & Sibuya, M. (2004) · Australian & New Zealand Journal of Statistics · doi:10.1111/j.1467-842x.2004.00360.x · Cited by 520
Generative Moment Matching Networks
Li, Y., Swersky, K., & Zemel, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.02761 · Cited by 517
On Learning Vector-Valued Functions
Micchelli, C. A., & Pontil, M. (2005) · Neural Computation · doi:10.1162/0899766052530802 · Cited by 494
Determinantal Point Processes for Machine Learning
Kulesza, A. (2012) · now publishers, Inc. eBooks · doi:10.1561/9781601986290 · Cited by 493
Gärtner, T., Flach, P. A., Kowalczyk, A., & Smola, A. J. (2002) · Cited by 460
A survey of kernels for structured data
Gärtner, T. (2003) · ACM SIGKDD Explorations Newsletter · doi:10.1145/959242.959248 · Cited by 452
Linear Operators and their Spectra
Davies, E. B. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511618864 · Cited by 447
The Pre-Image Problem in Kernel Methods
Kwok, J. T.-Y., & Tsang, I. W.-H. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.837781 · Cited by 437
Kernel Measures of Conditional Dependence
Fukumizu, K., Gretton, A., Sun, X., & Schölkopf, B. (2007) · Cited by 435
Self-citationKernels for Vector-Valued Functions: A Review
Álvarez, M. A., Rosasco, L., & Lawrence, N. D. (2012) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000036 · Cited by 415
Herding dynamical weights to learn
Welling, M. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553517 · Cited by 401
Girard, A., Rasmussen, C. E., Candela, J. Q., & Murray‐Smith, R. (2002) · Cited by 384
A Kullback-Leibler Divergence Based Kernel for SVM Classification in Multimedia Applications
Moreno, P. J., Ho, P., & Vasconcelos, N. M. (2003) · Cited by 380
Supervised feature selection via dependence estimation
Song, L., Smola, A., Gretton, A., Borgwardt, K. M., & Bedo, J. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273600 · Cited by 379
Gordon, A. D., Henzinger, T. A., Nori, A. V., & Rajamani, S. K. (2014) · Future of Software Engineering Proceedings · doi:10.1145/2593882.2593900 · Cited by 357
Kernel-based Conditional Independence Test and Application in Causal Discovery
Zhang, K., Peters, J., Janzing, D., & Schölkopf, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3775 · Cited by 346
Self-citationThe Empirical Characteristic Function and Its Applications
Feuerverger, A., & Mureika, R. A. (1977) · The Annals of Statistics · doi:10.1214/aos/1176343742 · Cited by 337
Fastfood: approximating kernel expansions in loglinear time
Le, Q. V., Sarlós, T., & Smola, A. J. (2013) · Cited by 332
Kernel Methods for Measuring Independence
Gretton, A., Herbrich, R., Smola, A. J., Bousquet, O., & Schölkopf, B. (2005) · ANU Open Research (Australian National University) · doi:10.5555/1046920.1194914 · Cited by 332
Self-citationMonotone Funktionen, Stieltjessche Integrale und harmonische Analyse
Bochner, S. (1933) · Mathematische Annalen · doi:10.1007/bf01452844 · Cited by 318
A new test for multivariate normality
Székely, G. J., & Rizzo, M. L. (2005) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2003.12.002 · Cited by 317
UAV-Assisted Heterogeneous Networks for Capacity Enhancement
Sharma, V., Bennis, M., & Kumar, R. (2016) · IEEE Communications Letters · doi:10.1109/lcomm.2016.2553103 · Cited by 317
Convolutional Neural Network Architectures for Signals Supported on Graphs
Gama, F., Marques, A. G., Leus, G., & Ribeiro, A. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2887403 · Cited by 308
Fast and scalable polynomial kernels via explicit feature maps
Pham, N., & Pagh, R. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487591 · Cited by 306
Iterative kernel principal component analysis for image modeling
Kwa, Franz, M. O., & Scholkopf, B. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.181 · Cited by 306
Distinguishing cause from effect using observational data: methods and benchmarks
Mooij, J. M., Peters, J., Janzing, D., Jakob Zscheischler, A., & Schölkopf, B. (2014) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1412.3773 · Cited by 302
Self-citationKernel dimension reduction in regression
Fukumizu, K., Bach, F. R., & Jordan, M. I. (2009) · The Annals of Statistics · doi:10.1214/08-aos637 · Cited by 289
Self-citationSampling of Graph Signals With Successive Local Aggregations
Marques, A. G., Segarra, S., Leus, G., & Ribeiro, A. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2507546 · Cited by 287
A spectral algorithm for learning Hidden Markov Models
Hsu, D., Kakade, S. M., & Zhang, T. (2012) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2011.12.025 · Cited by 278
(2011) · Cited by 277
On causal and anticausal learning
Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., Mooij, J. M., & Schölkopf, B. (2012) · MPG.PuRe (Max Planck Society) · Cited by 263
Self-citationOn regularization algorithms in learning theory
Bauer, F., Pereverzev, S., & Rosasco, L. (2007) · Journal of Complexity · doi:10.1016/j.jco.2006.07.001 · Cited by 262
Hilbert space embeddings of conditional distributions with applications to dynamical systems
Song, L., Huang, J., Smola, A., & Fukumizu, K. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553497 · Cited by 255
Self-citationLearning a theory of causality.
Goodman, N. D., Ullman, T. D., & Tenenbaum, J. B. (2011) · Psychological Review · doi:10.1037/a0021336 · Cited by 247
Chapelle, O., Weston, J., Bottou, L., & Vapnik, V. N. (2000) · Cited by 244
Statistical Consistency of Kernel Canonical Correlation Analysis
Fukumizu, K., Bach, F., & Gretton, A. (2007) · doi:10.5555/1248659.1248673 · Cited by 239
Self-citationUniversality, Characteristic Kernels and RKHS Embedding of Measures
Sriperumbudur, B. K., Fukumizu, K., & Lanckriet, G. R. G. (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021077 · Cited by 236
Self-citationA kernel between sets of vectors
Kondor, R., & Jebara, T. (2003) · Cited by 235
Point-Based Value Iteration for Continuous POMDPs
Porta, J. M., Vlassis, N. A., Spaan, M. T. J., & Poupart, P. (2006) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · doi:10.13039/501100000780 · Cited by 234
Joint measures and cross-covariance operators
Baker, C. R. (1973) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1973-0336795-3 · Cited by 226
On the empirical estimation of integral probability metrics
Sriperumbudur, B. K., Fukumizu, K., Gretton, A., Schölkopf, B., & Lanckriet, G. R. G. (2012) · Electronic Journal of Statistics · doi:10.1214/12-ejs722 · Cited by 225
Self-citationA NONPARAMETRIC HELLINGER METRIC TEST FOR CONDITIONAL INDEPENDENCE
Su, L., & White, H. (2008) · Econometric Theory · doi:10.1017/s0266466608080341 · Cited by 218
JebaraTony, KondorRisi, & HowardAndrew (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1016786 · Cited by 216
VECTOR VALUED REPRODUCING KERNEL HILBERT SPACES OF INTEGRABLE FUNCTIONS AND MERCER THEOREM
Carmeli, C., Vito, E. D., & Toigo, A. (2006) · Analysis and Applications · doi:10.1142/s0219530506000838 · Cited by 210
A kernelized stein discrepancy for goodness-of-fit tests
Liu, Q., Lee, J. D., & Jordan, M. I. (2016) · International Conference on Machine Learning · Cited by 206
Anderson, N. H., Hall, P., & Titterington, D. M. (1994) · Journal of Multivariate Analysis · doi:10.1006/jmva.1994.1033 · Cited by 205
Stability Properties of Graph Neural Networks
Gama, F., Bruna, J., & Ribeiro, A. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3026980 · Cited by 204
Song, L., Fukumizu, K., & Gretton, A. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2252713 · Cited by 198
Self-citationSecond Order Cone Programming Approaches for Handling Missing and Uncertain Data
Shivaswamy, P. K., Bhattacharyya, C., & Smola, A. J. (2006) · NOT FOUND REPOSITORY (Indian Institute of Science Bangalore) · doi:10.5555/1248547.1248594 · Cited by 197
Mercer’s Theorem on General Domains: On the Interaction between Measures, Kernels, and RKHSs
Steinwart, I., & Scovel, C. (2012) · Constructive Approximation · doi:10.1007/s00365-012-9153-3 · Cited by 183
Hilbert space embeddings and metrics on probability measures
Sriperumbudur, B. K., Gretton, A., Fukumizu, K., Schölkopf, B., & Lanckriet, G. R. G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0907.5309 · Cited by 183
Self-citationBayes meets bellman: the Gaussian process approach to temporal difference learning
Engel, Y., Mannor, S., & Meir, R. (2003) · Cited by 174
Observable Operator Models for Discrete Stochastic Time Series
Jaeger, H. (2000) · Neural Computation · doi:10.1162/089976600300015411 · Cited by 174
Multi-robot SLAM with Sparse Extended Information Filers
Thrun, S., & Liu, Y. (2005) · Springer Tracts in Advanced Robotics · doi:10.1007/11008941_27 · Cited by 173
Robust kernel density estimation
Kim, J., & Scott, C. D. (2012) · Journal of Machine Learning Research · doi:10.5555/2503308.2503323 · Cited by 169
Hilbert Space Embeddings of Hidden Markov Models
Song, L., Boots, B., Siddiqi, S. M., Gordon, G. J., & Smola, A. J. (2018) · Figshare · doi:10.1184/r1/6475772 · Cited by 161
Training generative neural networks via Maximum Mean Discrepancy optimization
Dziugaite, G. K., Roy, D. M., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.03906 · Cited by 159
On Learning with Integral Operators
Rosasco, L., Belkin, M. A., & Vito, E. D. (2010) · doi:10.5555/1756006.1756036 · Cited by 159
Control Functionals for Monte Carlo Integration
Oates, C. J., Girolami, M., & Chopin, N. (2016) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12185 · Cited by 153
Nonparametric belief propagation
Sudderth, E. B., Ihler, A., Isard, M., Freeman, W. T., & Willsky, A. S. (2010) · Communications of the ACM · doi:10.1145/1831407.1831431 · Cited by 149
Kernel Choice and Classifiability for RKHS Embeddings of Probability Distributions
Fukumizu, K., Gretton, A., Lanckriet, G. R. G., Schölkopf, B., & Sriperumbudur, B. K. (2009) · neural information processing systems · Cited by 147
Self-citationGhahramani, Z., & Rasmussen, C. E. (2002) · neural information processing systems · Cited by 147
A Kernel Test of Goodness of FitPreprint
Chwialkowski, K., Strathmann, H., & Gretton, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02964 · Cited by 141
Harchaoui, Z., Moulines, É., & Bach, F. (2008) · Cited by 135
Ramdas, A., Reddi, S. J., Póczos, B., Singh, A., & Wasserman, L. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9692 · Cited by 130
Kernel Bayes' rule: Bayesian inference with positive definite kernels
Fukumizu, K., Song, L., & Gretton, A. (2013) · Journal of Machine Learning Research · doi:10.5555/2567709.2627677 · Cited by 127
Self-citationIhler, A., & McAllester, D. (2009) · Cited by 120
Caponnetto, A., Micchelli, C. A., Pontil, M., et al. (2008) · doi:10.5555/1390681.1442785 · Cited by 120
Deep reinforcement learning for swarm systems
HüttenrauchMaximilian, ŠošićAdrian, & NeumannGerhard (2019) · Journal of Machine Learning Research · doi:10.5555/3322706.3361995 · Cited by 119
On the Error of Random Fourier FeaturesPreprint
Sutherland, D. J., & Schneider, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02785 · Cited by 118
Injective hilbert space embeddings of probability measures
Sriperumbudur, B. K., Gretton, A., Fukumizu, K., Lanckriet, G. R. G., & Schölkopf, B. (2008) · Cited by 117
Self-citationA dependence maximization view of clustering
Song, L., Smola, A. J., Gretton, A., & Borgwardt, K. M. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273599 · Cited by 116
Random Projection, Margins, Kernels, and Feature-Selection
Blum, A. L. (2006) · Lecture notes in computer science · doi:10.1007/11752790_3 · Cited by 114
Mean Map Kernel Methods for Semisupervised Cloud Classification
Gómez‐Chova, L., Camps‐Valls, G., Bruzzone, L., & Calpe‐Maravilla, J. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2026425 · Cited by 112
Flocking with obstacle avoidance in switching networks of interconnected vehicles
Tanner, H. G. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2004.1307518 · Cited by 96
Wu, S., & Амари, Ш.-И. (2002) · Neural Processing Letters · doi:10.1023/a:1013848912046 · Cited by 93
Nonextensive Information Theoretic Kernels on Measures
Martins, A. F. T., Smith, N. A., Xing, E. P., Aguiar, P. M. Q., & Figueiredo, M. A. T. (2009) · Cited by 93
Learning from Distributions via Support Measure MachinesPreprint
Muandet, K., Fukumizu, K., Dinuzzo, F., & Schölkopf, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.6504 · Cited by 91
Self-citationA general regression technique for learning transductions
Cortes, C., Mohri, M., & Weston, J. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102371 · Cited by 88
Conditional mean embeddings as regressorsPreprint
Lever, G., Baldassarre, L., Patterson, S., Gretton, A., Pontil, M., & lder, S. G. N. (2012) · Cited by 88
Random Feature Maps for Dot Product Kernels
Kar, P., & Karnick, H. (2012) · Cited by 87
A permutation-based kernel conditional independence test
Doran, G. B., Muandet, K., Zhang, K., & Schölkopf, B. (2014) · Cited by 85
Self-citationGroup Anomaly Detection using Flexible Genre Models
Xiong, L., Póczos, B., & Schneider, J. (2018) · Figshare · doi:10.1184/r1/6475745 · Cited by 83
A test for the two-sample problem based on empirical characteristic functions
Fernández, M. V. A., Jiménez-Gamero, M. D., & García, J. M. (2008) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2007.12.013 · Cited by 80
Characteristic Kernels on Groups and Semigroups
Fukumizu, K., Gretton, A., Schölkopf, B., & Sriperumbudur, B. K. (2008) · Cited by 79
Self-citationTesting for Homogeneity with Kernel Fisher Discriminant AnalysisPreprint
Harchaoui, Z., Bach, F., & Moulines, É. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0804.1026 · Cited by 78
Nonparametric Divergence Estimation with Applications to Machine Learning on DistributionsPreprint
Póczos, B., Xiong, L., & Schneider, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3758 · Cited by 76
Estimating divergence functionals and the likelihood ratio by penalized convex risk minimization
Nguyen, L., Wainwright, M. J., & Jordan, M. I. (2007) · Cited by 76
Big Data Analysis with Signal Processing on Graphs
Sandryhaila, A., & Moura, J. M. F. (2014) · IEEE Signal Processing Magazine · Cited by 76
A regularized kernel-based approach to unsupervised audio segmentation
Harchaoui, Z., Vallet, F., Lung-Yut-Fong, A., & Cappé, O. (2009) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2009.4959921 · Cited by 73
Hierarchical Probabilistic Models for Group Anomaly Detection
Xiong, L., Póczos, B., Schneider, J., Connolly, A. J., & Vanderplas, J. (2018) · doi:10.1184/r1/6475763 · Cited by 73
Cuturi, M., Fukumizu, K., & Vert, J. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1088712 · Cited by 70
Self-citationStatistical model criticism using kernel two sample tests
Lloyd, J. R., & Ghahramani, Z. (2015) · neural information processing systems · Cited by 65
Universal Kernels on Non-Standard Input Spaces
Christmann, A., & Steinwart, I. (2010) · Cited by 63
Tailoring density estimation via reproducing kernel moment matching
Song, L., Zhang, X., Smola, A. J., Gretton, A., & Schölkopf, B. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390281 · Cited by 63
Self-citationA Test of Relative Similarity For Model Selection in Generative ModelsPreprint
Bounliphone, W., Belilovsky, E., Blaschko, M. B., Antonoglou, I., & Gretton, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.04581 · Cited by 63
Relational Forward Models for Multi-Agent LearningPreprint
Tacchetti, A., Song, H., Mediano, P. A. M., Zambaldi, V., Rabinowitz, N. C., Graepel, T., Botvinick, M., & Battaglia, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.11044 · Cited by 62
k-NN Regression Adapts to Local Intrinsic DimensionPreprint
Kpotufe, S. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1110.4300 · Cited by 60
Distribution to Distribution Regression
Oliva, J. B., Póczos, B., & Schneider, J. (2018) · Figshare · doi:10.1184/r1/6475571 · Cited by 53
Sequential Kernel Herding: Frank-Wolfe Optimization for Particle FilteringPreprint
Lacoste-Julien, S., Lindsten, F., & Bach, F. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1501.02056 · Cited by 51
Consistent testing of total independence based on the empirical characteristic function
Kankainen, A. (1995) · Jyväskylä University Digital Archive (University of Jyväskylä) · Cited by 49
B-test: A Non-parametric, Low Variance Kernel Two-sample TestPreprint
Zaremba, W., Gretton, A., & Blaschko, M. B. (2013) · arXiv (Cornell University) · Cited by 48
Permutation Testing Improves Bayesian Network Learning
Tsamardinos, I., & Borboudakis, G. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15939-8_21 · Cited by 47
FastMMD: Ensemble of Circular Discrepancy for Efficient Two-Sample Test
Zhao, J. Y., & Meng, D. (2015) · Neural Computation · doi:10.1162/neco_a_00732 · Cited by 47
Spherical Random Features for polynomial kernels
Pennington, J., Yu, F. X., & Kumar, S. (2015) · neural information processing systems · Cited by 47
On the Asymptotic Properties of a Nonparametric $L_1$ -Test Statistic of Homogeneity
Gérard Biau, A., & Györfi, L. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.856979 · Cited by 46
Cited by
Pros and cons of GAN evaluation measures
Borji, A. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.009 · Cited by 963
The Born supremacy: quantum advantage and training of an Ising Born machine
Coyle, B., Mills, D., Danos, V., & Kashefi, E. (2020) · npj Quantum Information · doi:10.1038/s41534-020-00288-9 · Cited by 155
In Search of Lost Domain Generalization
Gulrajani, I., & Lopez-Paz, D. (2020) · arXiv · doi:10.48550/arxiv.2007.01434 · Cited by 440
Metadata
- Authors
- Muandet, K., Fukumizu, K., Sriperumbudur, B., & Schölkopf, B.
- Venue
- Foundations and Trends® in Machine Learning
- Publisher
- Emerald
- Published
- 2017
- Volume
- 10
- Issue
- 1-2
- Pages
- 1-141
- ISSN
- 1935-8237 (ISSN-L)
- 1935-8245
- OpenAlex
- W2418306335
- Cited by
- 409
- References
- 234
- FWCI
- 15.42
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.