The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Independent component analysis: recent advances
Open accessAbstract
Independent component analysis is a probabilistic method for learning a linear transform of a random vector. The goal is to find components that are maximally independent and non-Gaussian (non-normal). Its fundamental difference to classical multi-variate statistical methods is in the assumption of non-Gaussianity, which enables the identification of original, underlying components, in contrast to classical methods. The basic theory of independent component analysis was mainly developed in the 1990s and summarized, for example, in our monograph in 2001. Here, we provide an overview of some recent developments in the theory since the year 2000. The main topics are: analysis of causal relations, testing independent components, analysing multiple datasets (three-way data), modelling dependencies between the components and improved methods for estimating the basic model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Independent component analysis: algorithms and applications
Hyvärinen, A., & Oja, E. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00026-5 · Cited by 8,705
Self-citationIndependent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,205
Independent Component Analysis
(2004) · Independent Component Analysis · doi:10.7551/mitpress/3717.003.0014 · Cited by 7,903
Fast and robust fixed-point algorithms for independent component analysis
Hyvarinen, A. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.761722 · Cited by 6,246
Paatero, P., & Tapper, U. (1994) · Environmetrics · doi:10.1002/env.3170050203 · Cited by 6,023
Independent Component Analysis
Hyvärinen, A., Karhunen, J., & Oja, E. (2001) · Wiley eBooks · doi:10.1002/0471221317 · Cited by 5,007
Self-citationTraining Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“A recent trend in machine learning is “deep learning” which means learning multi-layer models, where each “layer” is a linear transformation followed by a nonlinear function taken separately of each linear component, like in a neural network, see e.g. (Hinton, 2007; Hinton and Salakhutdinov, 2006; Lee et al., 2011).”
BackgroundMethodA blind source separation technique using second-order statistics
Belouchrani, A., Abed-Meraim, K., Cardoso, J.-F., & Moulines, E. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.554307 · Cited by 2,775
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,701
Non-negative matrix factorization with sparseness constraints
Hoyer, P. O. (2004) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0408058 · Cited by 2,591
Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
Jutten, C., & Herault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90079-x · Cited by 2,521
Harshman, R. A. (1970) · Cited by 2,255
Least squares formulation of robust non-negative factor analysis
Paatero, P. (1997) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(96)00044-5 · Cited by 1,978
A New Learning Algorithm for Blind Signal Separation
Амари, Ш.-И., Cichocki, A. S., & Yang, H. H. (1995) · Cited by 1,904
Advances in Neural Information Processing Systems 21
Griffiths, T. L., Lucas, C. G., Williams, J. J., & Kalish, M. L. (2009) · neural information processing systems · Cited by 1,854
Handbook of Blind Source Separation
Comon, P., & Jutten, C. (2010) · Elsevier eBooks · doi:10.1016/c2009-0-19334-0 · Cited by 1,627
Cichocki, A., Zdunek, R., Phan, A. H., & Amari, S. (2009) · doi:10.1002/9780470747278 · Cited by 1,540
Validating the independent components of neuroimaging time series via clustering and visualization
Himberg, J., Hyvärinen, A., & Esposito, F. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.03.027 · Cited by 1,244
Self-citationA Linear Non-Gaussian Acyclic Model for Causal Discovery
Shimizu, S., Hoyer, P. O., Hyvärinen, A., & Kerminen, A. (2006) · Cited by 1,161
Self-citationA review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data
Calhoun, V. D., Liu, J., & Adalı, T. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.057 · Cited by 1,145
Learning multiple layers of representation
Hinton, G. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.004 · Cited by 1,011
A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals
Bingham, E. (2000) · International Journal of Neural Systems · doi:10.1016/s0129-0657(00)00002-8 · Cited by 854
Blind Source Separation by Sparse Decomposition in a Signal Dictionary
Zibulevsky, M., & Pearlmutter, B. A. (2001) · Neural Computation · doi:10.1162/089976601300014385 · Cited by 766
Tensorial extensions of independent component analysis for multisubject FMRI analysis
Beckmann, C. F., & Smith, S. M. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.043 · Cited by 761
(2005) · doi:10.5555/1046920.1088696 · Cited by 756
Self-citationWhen Does Non-Negative Matrix Factorization Give a Correct Decomposition into Parts?
Donoho, D. L., & Stodden, V. (2004) · doi:10.7916/d88d05n7 · Cited by 685
Infomax and maximum likelihood for blind source separation
Cardoso, J.-F. (1997) · IEEE Signal Processing Letters · doi:10.1109/97.566704 · Cited by 684
A Kernel Statistical Test of Independence
Gretton, A., Fukumizu, K., Teo, C. H., Song, L., Schölkopf, B., & Smola, A. J. (2007) · ANU Open Research (Australian National University) · Cited by 656
Nonlinear causal discovery with additive noise models
Hoyer, P. O., Janzing, D., Mooij, J. M., Peters, J., & Schölkopf, B. (2008) · Cited by 652
Gutmann, M. U., & Hyvärinen, A. (2012) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.5555/2503308.2188396 · Cited by 581
Self-citationHyvärinen, A., & Hoyer, P. (2000) · Neural Computation · doi:10.1162/089976600300015312 · Cited by 533
Self-citationBlind separation of instantaneous mixtures of nonstationary sources
Pham, D.-T., & Cardoso, J.-F. (2001) · IEEE Transactions on Signal Processing · doi:10.1109/78.942614 · Cited by 516
Blind separation of mixture of independent sources through a quasi-maximum likelihood approach
Pham, D. T., & Garat, P. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.599941 · Cited by 469
Topographic Independent Component Analysis
Hyvärinen, A., Hoyer, P. O., & Inki, M. (2001) · Neural Computation · doi:10.1162/089976601750264992 · Cited by 459
Self-citationDirectLiNGAM: A direct method for learning a linear non-gaussian structural equation model
Shimizu, S., Inazumi, T., Sogawa, Y., Hyvärinen, A., Kawahara, Y., Washio, T., Hoyer, P. O., & Bollen, K. A. (2013) · Cited by 399
Self-citationHyvärinen, A., Hurri, J., & Hoyer, P. O. (2009) · Computational Imaging and Vision · doi:10.1007/978-1-84882-491-1 · Cited by 398
Self-citationUnsupervised learning of hierarchical representations with convolutional deep belief networks
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2011) · Communications of the ACM · doi:10.1145/2001269.2001295 · Cited by 388
Independent component analysis of fMRI group studies by self-organizing clustering
Esposito, F., Scarabino, T., Hyvarinen, A., Himberg, J., Formisano, E., Comani, S., Tedeschi, G., Goebel, R., Seifritz, E., & Di Salle, F. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.042 · Cited by 364
Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer
Nadal, J., & Parga, N. (1994) · Network Computation in Neural Systems · doi:10.1088/0954-898x/5/4/008 · Cited by 282
Estimation of a Structural Vector Autoregression Model Using Non-Gaussianity
Hyvärinen, A., Zhang, K., Shimizu, S., & Hoyer, P. O. (2010) · doi:10.5555/1756006.1859907 · Cited by 254
Self-citationKernel Independent Component Analysis
(2014) · Blind Source Separation · doi:10.1002/9781118679852.ch9 · Cited by 232
On the Identifiability of the Post-Nonlinear Causal Model
Zhang, K., & Hyvärinen, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2599 · Cited by 229
Self-citationAlgorithms for nonnegative independent component analysis
Plumbley, M. D. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.810616 · Cited by 223
Emergence of complex cell properties by learning to generalize in natural scenes
Karklin, Y., & Lewicki, M. S. (2009) · Nature · doi:10.1038/nature07481 · Cited by 218
The Fixed-Point Algorithm and Maximum Likelihood Estimation for Independent Component Analysis
Hyvärinen, A. (1999) · Neural Processing Letters · doi:10.1023/a:1018647011077 · Cited by 215
Self-citationMulti-subject Dictionary Learning to Segment an Atlas of Brain Spontaneous Activity
Varoquaux, G., Gramfort, A., Pedregosa, F., Michel, V., & Thirion, B. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-22092-0_46 · Cited by 205
Least-dependent-component analysis based on mutual information
Stögbauer, H., Kraskov, A., Astakhov, S. A., & Grassberger, P. (2004) · Physical Review E · doi:10.1103/physreve.70.066123 · Cited by 197
Independent component analysis of short-time Fourier transforms for spontaneous EEG/MEG analysis
Hyvärinen, A., Ramkumar, P., Parkkonen, L., & Hari, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.028 · Cited by 181
Self-citationFactored 3-Way Restricted Boltzmann Machines For Modeling Natural Images
Ranzato, M., Krizhevsky, A., & Hinton, G. E. (2010) · International Conference on Artificial Intelligence and Statistics · Cited by 181
Pairwise Likelihood Ratios for Estimation of Non-Gaussian Structural Equation Models.
Hyvärinen, A., & Smith, S. M. (2013) · PubMed · doi:10.5555/2567709.2502585 · Cited by 176
Self-citationA multi-layer sparse coding network learns contour coding from natural images
Hoyer, P. O., & Hyvärinen, A. (2002) · Vision Research · doi:10.1016/s0042-6989(02)00017-2 · Cited by 158
Self-citationKarklin, Y., & Lewicki, M. S. (2005) · Neural Computation · doi:10.1162/0899766053011474 · Cited by 153
Complexity Pursuit: Separating Interesting Components from Time Series
Hyvärinen, A. (2001) · Neural Computation · doi:10.1162/089976601300014394 · Cited by 152
Self-citationMeasuring directional coupling between EEG sources
Gómez-Herrero, G., Atienza, M., Egiazarian, K., & Cantero, J. L. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.07.032 · Cited by 134
Topographic Product Models Applied to Natural Scene Statistics
Osindero, S., Welling, M., & Hinton, G. E. (2005) · Neural Computation · doi:10.1162/089976606775093936 · Cited by 108
Ramsey, J., Hanson, S. J., & Glymour, C. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.068 · Cited by 103
Modeling Sparse Connectivity Between Underlying Brain Sources for EEG/MEG
Haufe, S., Tomioka, R., Nolte, G., Müller, K., & Kawanabe, M. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2046325 · Cited by 102
Meinecke, F. C., Ziehe, A., Kawanabe, M., & Müller, K. R. (2002) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2002.805480 · Cited by 96
On Asymmetric Properties of the Correlation Coeffcient in the Regression Setting
Dodge, Y., & Rousson, V. (2001) · The American Statistician · doi:10.1198/000313001300339932 · Cited by 83
Efficient independent component analysis
Chen, A., & Bickel, P. J. (2006) · The Annals of Statistics · doi:10.1214/009053606000000939 · Cited by 61
Efficient independent component analysis
Chen, A., & Bickel, P. J. (2003) · UC Berkeley · Cited by 59
Testing the ICA mixing matrix based on inter-subject or inter-session consistency
Hyvärinen, A. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.086 · Cited by 49
Self-citationJoint estimation of linear non-Gaussian acyclic models
Shimizu, S. (2011) · Neurocomputing · doi:10.1016/j.neucom.2011.11.005 · Cited by 46
An Adaptive Method for Subband Decomposition ICA
Zhang, K., & Chan, L. (2005) · Neural Computation · doi:10.1162/089976606774841620 · Cited by 46
A unifying model for blind separation of independent sources
Hyvärinen, A. (2005) · Signal Processing · doi:10.1016/j.sigpro.2005.02.003 · Cited by 44
Self-citationBlind separation of sources that have spatiotemporal variance dependencies
Hyvärinen, A., & Hurri, J. (2003) · Signal Processing · doi:10.1016/j.sigpro.2003.10.010 · Cited by 37
Self-citationEstimating Functions for Blind Separation when Sources Have Variance-Dependencies
Kawanabe, M., & Müller, K. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30110-3_18 · Cited by 28
Testing Independent Component Patterns by Inter-Subject or Inter-Session Consistency
Hyvärinen, A., & Ramkumar, P. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00094 · Cited by 28
Self-citationA Two-Layer Model of Natural Stimuli Estimated with Score Matching
Köster, U., & Hyvärinen, A. (2010) · Neural Computation · doi:10.1162/neco_a_00010 · Cited by 27
Self-citationSecond-order methods based on color
Yeredor, A. (2010) · Elsevier eBooks · doi:10.1016/b978-0-12-374726-6.00012-6 · Cited by 20
Pairwise Measures of Causal Direction in Linear Non-Gaussian Acyclic Models
Hyvärinen, A. (2010) · Cited by 20
Self-citation
Cited by
Cichocki, A., Mandic, D., De Lathauwer, L., Zhou, G., Zhao, Q., Caiafa, C., & PHAN, H. A. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2297439 · Cited by 1,384
Dynamic Mode Decomposition and Its Variants
Schmid, P. J. (2022) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-030121-015835 · Cited by 640
Cluster-based reduced-order modelling of a mixing layer
Kaiser, E., Noack, B. R., Cordier, L., Spohn, A., Segond, M., Abel, M., Daviller, G., Östh, J., Krajnović, S., & Niven, R. K. (2014) · Journal of Fluid Mechanics · doi:10.1017/jfm.2014.355 · Cited by 294
Unsupervised machine learning for exploratory data analysis in imaging mass spectrometry
Verbeeck, N., Caprioli, R. M., & Van de Plas, R. (2020) · Mass Spectrometry Reviews · doi:10.1002/mas.21602 · Cited by 281
Integrating Machine Learning with Human Knowledge
Deng, C., Ji, X., Rainey, C., Zhang, J., & Lu, W. (2020) · iScience · doi:10.1016/j.isci.2020.101656 · Cited by 243
Metadata
- Authors
- Hyvärinen, A.
- Venue
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2013-02-13
- Volume
- 371
- Issue
- 1984
- Pages
- 20110534
- ISSN
- 1364-503X (ISSN-L)
- 1471-2962
- OpenAlex
- W1976137296
- Cited by
- 390
- References
- 76
- FWCI
- 23.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.