The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Kernel independent component analysis
Abstract
We present a class of algorithms for independent component analysis (ICA) which use contrast functions based on canonical correlations in a reproducing kernel Hilbert space. On the one hand, we show that our contrast functions are related to mutual information and have desirable mathematical properties as measures of statistical dependence. On the other hand, building on recent developments in kernel methods, we show that these criteria can be computed efficiently. Minimizing these criteria leads to flexible and robust algorithms for ICA. We illustrate with simulations involving a wide variety of source distributions, showing that our algorithms outperform many of the presently known algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Rayward-Smith, V. J. (1991) · Journal of the Operational Research Society · doi:10.1057/jors.1991.155 · Cited by 16,821
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,205
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Independent Component Analysis
(2004) · Independent Component Analysis · doi:10.7551/mitpress/3717.003.0014 · Cited by 7,903
Information theory and statistics
(1959) · Journal of the Franklin Institute · doi:10.1016/0016-0032(59)90368-0 · Cited by 7,094
RELATIONS BETWEEN TWO SETS OF VARIATES
HOTELLING, H. (1936) · Biometrika · doi:10.1093/biomet/28.3-4.321 · Cited by 5,263
Independent Component Analysis
Hyvärinen, A., Karhunen, J., & Oja, E. (2001) · Wiley eBooks · doi:10.1002/0471221317 · Cited by 5,007
An Introduction to Multivariate Statistical Analysis.
Skinner, C. J., & Anderson, T. W. (1985) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981950 · Cited by 3,245
Hastie, T., & Tibshirani, R. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat03141 · Cited by 3,156
The Geometry of Algorithms with Orthogonality Constraints
Edelman, A., Arias, T. A., & Smith, S. T. (1998) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479895290954 · Cited by 2,685
Natural Gradient Works Efficiently in Learning
Amari, S.-I. (1998) · Neural Computation · doi:10.1162/089976698300017746 · Cited by 2,681
Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
Jutten, C., & Herault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90079-x · Cited by 2,521
Lee, T.-W., Girolami, M., & Sejnowski, T. J. (1999) · Neural Computation · doi:10.1162/089976699300016719 · Cited by 1,967
A New Learning Algorithm for Blind Signal Separation
Амари, Ш.-И., Cichocki, A. S., & Yang, H. H. (1995) · Cited by 1,904
Estimating Optimal Transformations for Multiple Regression and Correlation
Breiman, L., & Friedman, J. H. (1985) · Journal of the American Statistical Association · doi:10.1080/01621459.1985.10478157 · Cited by 1,710
Using the Nyström Method to Speed Up Kernel Machines
Williams, C. K. I., & Seeger, M. (2000) · Cited by 1,646
Efficient and Adaptive Estimation for Semiparametric Models.
Do, K. A., Bickel, P. J., Klaassen, C. A. J., Ritov, Y., & Wellner, J. A. (1994) · Biometrics · doi:10.2307/2533465 · Cited by 1,403
Regularization Theory and Neural Networks Architectures
Girosi, F., Jones, M., & Poggio, T. (1995) · Neural Computation · doi:10.1162/neco.1995.7.2.219 · Cited by 1,349
High-Order Contrasts for Independent Component Analysis
Cardoso, J.-F. (1999) · Neural Computation · doi:10.1162/089976699300016863 · Cited by 1,213
The Numerical Treatment of Integral Equations
Baker, C. T. H., & Taylor, R. L. (1979) · Journal of Applied Mechanics · doi:10.1115/1.3424708 · Cited by 1,168
Efficient and Adaptive Estimation for Semiparametric Models.
Schick, A., Bickel, P. J., Klaassen, C. A. J., Ritov, Y., & Wellner, J. A. (1994) · Journal of the American Statistical Association · doi:10.2307/2291028 · Cited by 1,109
Canonical analysis of several sets of variables
KETTENRING, J. R. (1971) · Biometrika · doi:10.1093/biomet/58.3.433 · Cited by 896
Efficient svm training using low-rank kernel representations
Fine, S., & Scheinberg, K. (2002) · doi:10.5555/944790.944812 · Cited by 579
Sparse Greedy Matrix Approximation for Machine Learning
Smola, A. J., & Schökopf, B. (2000) · doi:10.5555/645529.657980 · Cited by 574
Attias, H. (1999) · Neural Computation · doi:10.1162/089976699300016458 · Cited by 504
Theory of Reproducing Kernels and Its Applications
Saitoh, S. (1988) · Longman Scientific & Technical , Wiley eBooks · Cited by 500
Blind separation of mixture of independent sources through a quasi-maximum likelihood approach
Pham, D. T., & Garat, P. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.599941 · Cited by 469
A kernel method for canonical correlation analysis
Akaho, S. (2006) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0609071 · Cited by 440
Multidimensional independent component analysis
Cardoso, J.-F. (2002) · Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181) · doi:10.1109/icassp.1998.681443 · Cited by 403
On the Shannon theory of information transmission in the case of continuous signals
Kolmogorov, A. (1956) · IRE Transactions on Information Theory · doi:10.1109/tit.1956.1056823 · Cited by 394
Canonical Correlation Analysis When the Data are Curves
Leurgans, S. E., Moyeed, R. A., & Silverman, B. W. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01936.x · Cited by 319
Asymptotic behavior of the eigenvalues of certain integral equations
Widom, H. (1963) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1963-0155161-0 · Cited by 121
Nonlinear Feature Extraction Using Generalized Canonical Correlation Analysis
Melzer, T., Reiter, M. J., & Bischof, H. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44668-0_50 · Cited by 109
Modified Cholesky Factorizations in Interior-Point Algorithms for Linear Programming
Wright, S. J. (1999) · SIAM Journal on Optimization · doi:10.1137/s1052623496304712 · Cited by 52
Tree-dependent Component AnalysisPreprint
Bach, F., & Jordan, M. I. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.0554 · Cited by 19
Self-citation
Cited by
Framing Image Description as a Ranking Task: Data, Models and Evaluation Metrics
Hodosh, M., Young, P., & Hockenmaier, J. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3994 · Cited by 1,314
Multi-view learning overview: Recent progress and new challenges
Zhao, J., Xie, X., Xu, X., & Sun, S. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.007 · Cited by 1,002
What you saw is not what you get: Domain adaptation using asymmetric kernel transforms
Kulis, B., Saenko, K., & Darrell, T. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995702 · Cited by 688
Efficient Additive Kernels via Explicit Feature Maps
Vedaldi, A., & Zisserman, A. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.153 · Cited by 688
Equivalence of distance-based and RKHS-based statistics in hypothesis testing
Sejdinovic, D., Sriperumbudur, B., Gretton, A., & Fukumizu, K. (2013) · The Annals of Statistics · doi:10.1214/13-aos1140 · Cited by 582
“(2008): we generated univariate random variables from the Independent Component Analysis (ICA) benchmark densities of Bach and Jordan (2002); rotated them in the product space by an angle between 0 and π/4 to introduce dependence; filled additional dimensions with independent Gaussian noise; and, finally, passed the r…”
Method
Metadata
- Authors
- Bach, F. R., & Jordan, M. I.
- Venue
- 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03).
- Publisher
- IEEE
- Published
- 2004-01-23
- Volume
- 4
- Pages
- IV-876-9
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W1588424744
- Cited by
- 568
- References
- 39
- FWCI
- 24.46
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.