The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Fast and robust fixed-point algorithms for independent component analysis
Abstract
Independent component analysis (ICA) is a statistical method for transforming an observed multidimensional random vector into components that are statistically as independent from each other as possible. In this paper, we use a combination of two different approaches for linear ICA: Comon's information-theoretic approach and the projection pursuit approach. Using maximum entropy approximations of differential entropy, we introduce a family of new contrast (objective) functions for ICA. These contrast functions enable both the estimation of the whole decomposition by minimizing mutual information, and estimation of individual independent components as projection pursuit directions. The statistical properties of the estimators based on such contrast functions are analyzed under the assumption of the linear mixture model, and it is shown how to choose contrast functions that are robust and/or of minimum variance. Finally, we introduce simple fixed-point algorithms for practical optimization of the contrast functions. These algorithms optimize the contrast functions very fast and reliably.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Probability, Random Variables, and Stochastic Processes.
Abrahams, J., & Papoulis, A. (1984) · Journal of the American Statistical Association · doi:10.2307/2288754 · Cited by 16,226
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Probability, Random Variables, and Stochastic Processes
Miller, I. (1966) · Technometrics · doi:10.1080/00401706.1966.10490365 · Cited by 8,452
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,205
Optimization by Vector Space Methods
(1970) · Students Quarterly Journal · doi:10.1049/sqj.1970.0088 · Cited by 6,004
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Harman, H. H. (1960) · Cited by 5,148
A Fast Fixed-Point Algorithm for Independent Component Analysis
Hyvärinen, A., & Oja, E. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1483 · Cited by 3,391
Andersen, E. B., & Harman, H. H. (1968) · Revue de l'Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1401485 · Cited by 3,177
Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
Jutten, C., & Herault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90079-x · Cited by 2,521
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
A New Learning Algorithm for Blind Signal Separation
Амари, Ш.-И., Cichocki, A. S., & Yang, H. H. (1995) · Cited by 1,904
Maxwell, A. E., & Harman, H. H. (1968) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2343736 · Cited by 1,819
A Projection Pursuit Algorithm for Exploratory Data Analysis
Friedman, J. H., & Tukey, J. W. (1974) · IEEE Transactions on Computers · doi:10.1109/t-c.1974.224051 · Cited by 1,652
Equivariant adaptive source separation
Cardoso, J.-F., & Laheld, B. H. (1996) · IEEE Transactions on Signal Processing · doi:10.1109/78.553476 · Cited by 1,349
Huber, P. J. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349519 · Cited by 1,277
Possible Principles Underlying the Transformations of Sensory Messages
Barlow, H. B. (2012) · Sensory Communication · doi:10.7551/mitpress/9780262518420.003.0013 · Cited by 1,269
Independent component filters of natural images compared with simple cells in primary visual cortex
van Hateren, J. H., & van der Schaaf, A. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0303 · Cited by 1,106
Principal components, minor components, and linear neural networks
Oja, E. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80089-9 · Cited by 814
Exploratory Projection Pursuit
Friedman, J. H. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478427 · Cited by 794
Extraction of ocular artefacts from EEG using independent component analysis
Vigário, R. N. (1997) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(97)00042-8 · Cited by 639
Natural image statistics and efficient coding
Olshausen, B. A., & Field, D. J. (1996) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_7_2_014 · Cited by 561
Jones, M. C., & Sibson, R. (1987) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981662 · Cited by 522
Adaptive blind separation of independent sources: A deflation approach
Delfosse, N., & Loubaton, P. (1995) · Signal Processing · doi:10.1016/0165-1684(95)00042-c · Cited by 499
Blind separation of mixture of independent sources through a quasi-maximum likelihood approach
Pham, D. T., & Garat, P. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.599941 · Cited by 469
A class of neural networks for independent component analysis
Karhunen, J., Oja, E., Wang, L., Vigario, R., & Joutsensalo, J. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572090 · Cited by 402
Independent component analysis by general nonlinear Hebbian-like learning rules
Hyvärinen, A., & Oja, E. (1998) · Signal Processing · doi:10.1016/s0165-1684(97)00197-7 · Cited by 248
Independent Component Analysis for Identification of Artifacts in Magnetoencephalographic Recordings
Vigário, R., Jousmäki, V., Hämäläinen, M., Hari, R., & Erkki Oja, A. (1997) · neural information processing systems · Cited by 219
The nonlinear PCA learning rule in independent component analysis
Oja, E. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)00045-3 · Cited by 218
The Fixed-Point Algorithm and Maximum Likelihood Estimation for Independent Component Analysis
Hyvärinen, A. (1999) · Neural Processing Letters · doi:10.1023/a:1018647011077 · Cited by 215
Mansour, A. (1999) · HAL · Cited by 214
A family of fixed-point algorithms for independent component analysis
Hyvarinen, A. (2002) · 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1997.604766 · Cited by 199
Self-citationOne-unit contrast functions for independent component analysis: a statistical analysis
Hyvärinen, A. (2002) · Machine learning for signal processing ... · doi:10.1109/nnsp.1997.622420 · Cited by 119
Image feature extraction by sparse coding and independent component analysis
Hyvärinen, A., Erkki Oja, A., Hoyer, P. O., & Hurri, J. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1998.711932 · Cited by 97
A fast algorithm for estimating overcomplete ICA bases for image windows
Hyvärinen, A., Cristescu, R., & Erkki Oja, A. (2003) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1999.831071 · Cited by 65
Cited by
Independent component analysis: algorithms and applications
Hyvärinen, A., & Oja, E. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00026-5 · Cited by 8,705
Statistical shape analysis: clustering, learning, and testing
Srivastava, A., Joshi, S. H., Mio, W., & Liu, X. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.86 · Cited by 2,727
Multimodal population brain imaging in the UK Biobank prospective epidemiological study
Miller, K. L., Alfaro-Almagro, F., Bangerter, N. K., Thomas, D. L., Yacoub, E., Xu, J., Bartsch, A. J., Jbabdi, S., Sotiropoulos, S. N., Andersson, J. L. R., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4393 · Cited by 2,020
Electrophysiological signatures of resting state networks in the human brain
Mantini, D., Perrucci, M. G., Del Gratta, C., Romani, G. L., & Corbetta, M. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700668104 · Cited by 1,938
Independent Component Analysis: Principles and Practice
(2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511624148 · Cited by 1,917
Metadata
- Authors
- Hyvarinen, A.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 1999-05
- Volume
- 10
- Issue
- 3
- Pages
- 626-634
- ISSN
- 1045-9227 (ISSN-L)
- 1941-0093
- OpenAlex
- W2141224535
- Cited by
- 6,246
- References
- 36
- FWCI
- 90.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.