The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Abstract
We derive a new self-organizing learning algorithm that maximizes the information transferred in a network of nonlinear units. The algorithm does not assume any knowledge of the input distributions, and is defined here for the zero-noise limit. Under these conditions, information maximization has extra properties not found in the linear case (Linsker 1989). The nonlinearities in the transfer function are able to pick up higher-order moments of the input distributions and perform something akin to true redundancy reduction between units in the output representation. This enables the network to separate statistically independent components in the inputs: a higher-order generalization of principal components analysis. We apply the network to the source separation (or cocktail party) problem, successfully separating unknown mixtures of up to 10 speakers. We also show that a variant on the network architecture is able to perform blind deconvolution (cancellation of unknown echoes and reverberation in a speech signal). Finally, we derive dependencies of information transfer on time delays. We suggest that information maximization provides a unifying framework for problems in "blind" signal processing.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Subsequently, extended infomax independent components analysis (ICA)63,64 was applied to detect eye movement-related artifacts.”
From Event-related potentials of automatic imitation are modulated by ethnicity during stimulus processing, but not during motor execution (2018) · cites this paper as [63]
In the citing paper
“Independent component analysis (ICA) decomposes the observed response into a linear mixture of non-Gaussian causes [36].”
From Hierarchical Models in the Brain (2008) · cites this paper as [36]
In the citing paper
“Next, we ran the Infomax ICA algorithm [Bell and Sejnowski, 1995], repeating it 15 times in ICASSO, implemented in GIFT, to generate a stable set of 75 final components.”
From Specific default mode subnetworks support mentalizing as revealed through opposing network recruitment by social and semantic FMRI tasks: Mentalizing and Default-Mode Subnetworks (2015) · cites this paper as Bell and Sejnowski, 1995
Citations
Cites
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Probability, Random Variables, and Stochastic Processes.
Abrahams, J., & Papoulis, A. (1984) · Journal of the American Statistical Association · doi:10.2307/2288754 · Cited by 16,301
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,324
A Fast Fixed-Point Algorithm for Independent Component Analysis
Hyvärinen, A., & Erkki Oja, A. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1483 · Cited by 3,373
Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
Jutten, C., & Hérault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90079-x · Cited by 2,550
Adaptive filter theory (2nd ed.)
Haykin, S. (1991) · Prentice-Hall, Inc eBooks · Cited by 1,905
Barlow, H. B. (1989) · The MIT Press eBooks · doi:10.1162/neco.1989.1.3.295 · Cited by 1,709
First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method
Battiti, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.2.141 · Cited by 1,193
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183
A Simple Coding Procedure Enhances a Neuron's Information Capacity
Laughlin, S. B. (1981) · Zeitschrift für Naturforschung C · doi:10.1515/znc-1981-9-1040 · Cited by 1,015
Research works printed but not linked: 1
- Li S., 1994, I E E E J. Oceanic Eng., 20, 73
Cited by
Sorted by citations
Items 1,001–1,038 of 1,038
Default-Mode Network Abnormalities in Pediatric Posttraumatic Stress Disorder
Patriat, R., Birn, R. M., Keding, T. J., & Herringa, R. J. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.01.010 · Cited by 78
Resting-state time-varying analysis reveals aberrant variations of functional connectivity in autism
Yao, Z., Hu, B., Xie, Y., Zheng, F., Liu, G., Chen, X., & Zheng, W. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00463 · Cited by 74
Infraslow Electroencephalographic and Dynamic Resting State Network Activity
Grooms, J. K., Thompson, G. J., Pan, W.-J., Billings, J., Schumacher, E. H., Epstein, C. M., & Keilholz, S. D. (2017) · Brain Connectivity · doi:10.1089/brain.2017.0492 · Cited by 74
Rudrauf, D. (2014) · Advances in Neuroscience · doi:10.1155/2014/462765 · Cited by 74
Rosch, K. S., Mostofsky, S. H., & Nebel, M. B. (2018) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-018-9254-9 · Cited by 69
van de Ven, V., Esposito, F., & Christoffels, I. K. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.057 · Cited by 72
Cai, X., Xie, D., Madsen, K. H., Wang, Y., Bögemann, S. A., Cheung, E. F. C., Møller, A., & Chan, R. C. K. (2020) · Human Brain Mapping · doi:10.1002/hbm.24797 · Cited by 62
Distinct EEG signatures differentiate unconsciousness and disconnection during anaesthesia and sleep
Casey, C. P., Tanabe, S., Farahbakhsh, Z., Parker, M., Bo, A., White, M., Ballweg, T., Mcintosh, A., Filbey, W., Saalmann, Y., et al. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2022.01.010 · Cited by 66
Hyatt, C. J., Calhoun, V. D., Pearlson, G. D., & Assaf, M. (2015) · Human Brain Mapping · doi:10.1002/hbm.22827 · Cited by 65
Learning to denoise astronomical images with U-nets
Vojtekova, A., Lieu, M., Valtchanov, I., Altieri, B., Old, L., Chen, Q., & Hroch, F. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa3567 · Cited by 63
Lackner, C. L., Santesso, D. L., Dywan, J., O’Leary, D. D., Wade, T. J., & Segalowitz, S. J. (2018) · Biological Psychology · doi:10.1016/j.biopsycho.2018.01.006 · Cited by 60
Stuldreher, I. V., Thammasan, N., van Erp, J. B. F., & Brouwer, A.-M. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/aba87d · Cited by 58
An Information-Theoretic Perspective on Intrinsic Motivation in Reinforcement Learning: A Survey
Aubret, A., Matignon, L., & Hassas, S. (2023) · Entropy · doi:10.3390/e25020327 · Cited by 52
Functional connectivity and cannabis use in high-risk adolescents
Houck, J. M., Bryan, A. D., & Feldstein Ewing, S. W. (2013) · The American Journal of Drug and Alcohol Abuse · doi:10.3109/00952990.2013.837914 · Cited by 50
Quattrini, G., Pini, L., Pievani, M., Magni, L. R., Lanfredi, M., Ferrari, C., Boccardi, M., Bignotti, S., Magnaldi, S., Cobelli, M., et al. (2019) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2018.12.010 · Cited by 48
Kim, H. J., Cha, J., Lee, J.-M., Shin, J. S., Jung, N.-Y., Kim, Y. J., Choe, Y. S., Lee, K. H., Kim, S. T., Kim, J. S., et al. (2016) · Journal of Alzheimer's Disease · doi:10.3233/jad-150637 · Cited by 46
Independent component analysis: fetal signal reconstruction from magnetocardiographic recordings
Comani, S., Mantini, D., Pennesi, P., Lagatta, A., & Cancellieri, G. (2004) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2003.12.005 · Cited by 46
Developmental differences in higher-order resting-state networks in Autism Spectrum Disorder
Bos, D. J., van Raalten, T. R., Oranje, B., Smits, A. R., Kobussen, N. A., Belle, J. V., Rombouts, S. A. R. B., & Durston, S. (2014) · NeuroImage: Clinical · doi:10.1016/j.nicl.2014.05.007 · Cited by 45
Li, Z., Duan, M., Xiao, B., & Yang, S. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3231923 · Cited by 45
Dementia ConnEEGtome: towards multicentric harmonization of EEG connectivity in neurodegeneration
Prado, P., Birba, A., Cruzat, J., Santamaría-García, H., Parra, M., Moguilner, S., Tagliazucchi, E., & Ibáñez, A. (2022) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.12.008 · Cited by 43
Pfabigan, D. M., Alexopoulos, J., Bauer, H., Lamm, C., & Sailer, U. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00100 · Cited by 41
COMANI, S., LIBERATI, M., MANTINI, D., GABRIELE, E., BRISINDA, D., DI LUZIO, S., FENICI, R., & LUCA ROMANI, G. (2004) · Pacing and Clinical Electrophysiology · doi:10.1111/j.1540-8159.2004.00699.x · Cited by 38
Co-maturation of theta and low-beta rhythms during child development
Rodríguez-Martínez, E. I., Barriga-Paulino, C. I., Rojas-Benjumea, M. A., & Gómez, C. M. (2015) · Brain Topography · doi:10.1007/s10548-014-0369-3 · Cited by 36
Ambrosino, S., Bos, D. J., van Raalten, T. R., Kobussen, N. A., van Belle, J., Oranje, B., & Durston, S. (2014) · Journal of Neural Transmission · doi:10.1007/s00702-014-1237-8 · Cited by 29
Identifying brain networks in synaptic density PET (11C-UCB-J) with independent component analysis
Fang, X. T., Toyonaga, T., Hillmer, A. T., Matuskey, D., Holmes, S. E., Radhakrishnan, R., Mecca, A. P., van Dyck, C. H., D'Souza, D. C., Esterlis, I., et al. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118167 · Cited by 30
EEG Signal Diversity Varies With Sleep Stage and Aspects of Dream Experience
Aamodt, A., Nilsen, A. S., Thürer, B., Moghadam, F. H., Kauppi, N., Juel, B. E., & Storm, J. F. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.655884 · Cited by 23
Fang, X. T., Volpi, T., Holmes, S. E., Esterlis, I., Carson, R. E., & Worhunsky, P. D. (2023) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1124254 · Cited by 18
McCauley, S. M., Hestvik, A., & Vogel, I. (2013) · Language and Speech · doi:10.1177/0023830911434277 · Cited by 19
Developmental language disorder as syntactic prediction impairment
Hestvik, A., Epstein, B., Schwartz, R. G., & Shafer, V. L. (2022) · Frontiers in Communication · doi:10.3389/fcomm.2021.637585 · Cited by 11
Rauchbauer, B., Pfabigan, D. M., & Lamm, C. (2018) · Scientific Reports · doi:10.1038/s41598-018-30926-4 · Cited by 15
Naumer, M. J., van den Bosch, J. J. F., Wibral, M., Kohler, A., Singer, W., Kaiser, J., van de Ven, V., & Muckli, L. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2669-0 · Cited by 11
Močilnik, V., Rutar Gorišek, V., Sajovic, J., Pretnar Oblak, J., Drevenšek, G., & Rogelj, P. (2024) · Sensors · doi:10.3390/s24020329 · Cited by 8
Rauchbauer, B., Lorenz, C., Lamm, C., & Pfabigan, D. M. (2021) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-021-00878-w · Cited by 8
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
- Self-citation
(2003) · Cited by 1,680
Deep Semi-Supervised Anomaly Detection
Ruff, L., Vandermeulen, R. A., Görnitz, N., Binder, A., Müller, E., Müller, K.-R., & Kloft, M. (2019) · arXiv · doi:10.48550/arxiv.1906.02694 · Cited by 388
Metadata
- Authors
- Bell, A. J., & Sejnowski, T. J.
- Affiliations
- Howard Hughes Medical Institute (US)
- Howard Hughes Medical Institute, Computational Neurobiology Laboratory, The Salk Institute, 10010 N. Torrey Pines Road, La Jolla, CA 92037 USA and Department of Biology, University of California, San Diego, La Jolla, CA 92093 USA
- ORCID
- Bell, Anthony J.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 1995-11
- Volume
- 7
- Issue
- 6
- Pages
- 1129-1159
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2108384452
- Cited by
- 8,986
- References
- 52
- Citations by year
- 2026: 151 · 2025: 242 · 2024: 264 · 2023: 286 · 2022: 329 · 2021: 375 · 2020: 349 · 2019: 372 · 2018: 343 · 2017: 334 · 2016: 346 · 2015: 357 · 2014: 365 · 2013: 352 · 2012: 328
- FWCI
- 130.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Office of Naval Research
- Topics
- Physical Sciences › Computer Science › Signal Processing › Blind Source Separation Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- information maximization, blind source separation, blind deconvolution, self-organized learning, nonlinear neural networks, higher-order statistics, redundancy reduction, principal component analysis, cocktail party problem, time delay dependence, blind signal processing
- MeSH terms
- Algorithms, Humans, Learning, Neurons, Probability, Problem Solving, Speech, Models, Statistical, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review