An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Abstract
We derive a new self-organizing learning algorithm that maximizes the information transferred in a network of nonlinear units. The algorithm does not assume any knowledge of the input distributions, and is defined here for the zero-noise limit. Under these conditions, information maximization has extra properties not found in the linear case (Linsker 1989). The nonlinearities in the transfer function are able to pick up higher-order moments of the input distributions and perform something akin to true redundancy reduction between units in the output representation. This enables the network to separate statistically independent components in the inputs: a higher-order generalization of principal components analysis. We apply the network to the source separation (or cocktail party) problem, successfully separating unknown mixtures of up to 10 speakers. We also show that a variant on the network architecture is able to perform blind deconvolution (cancellation of unknown echoes and reverberation in a speech signal). Finally, we derive dependencies of information transfer on time delays. We suggest that information maximization provides a unifying framework for problems in "blind" signal processing.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Extended infomax independent components analysis (ICA) was applied to detect eye movement-related artifacts.
“Subsequently, extended infomax independent components analysis (ICA)63,64 was applied to detect eye movement-related artifacts.”
From Event-related potentials of automatic imitation are modulated by ethnicity during stimulus processing, but not during motor execution (2018) · cites this paper as [63]
Independent component analysis (ICA) decomposes the observed response into a linear mixture of non-Gaussian causes.
“Independent component analysis (ICA) decomposes the observed response into a linear mixture of non-Gaussian causes [36].”
From Hierarchical Models in the Brain (2008) · cites this paper as [36]
The Infomax ICA algorithm was repeated 15 times in ICASSO to generate a stable set of 75 final components.
“Next, we ran the Infomax ICA algorithm [Bell and Sejnowski, 1995], repeating it 15 times in ICASSO, implemented in GIFT, to generate a stable set of 75 final components.”
From Specific default mode subnetworks support mentalizing as revealed through opposing network recruitment by social and semantic FMRI tasks: Mentalizing and Default-Mode Subnetworks (2015) · cites this paper as Bell and Sejnowski, 1995
Cites
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070 · see citing works
Probability, Random Variables, and Stochastic Processes.
Abrahams, J., & Papoulis, A. (1984) · Journal of the American Statistical Association · doi:10.2307/2288754 · Cited by 16,326 · see citing works
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,150 · see citing works
A Fast Fixed-Point Algorithm for Independent Component Analysis
Hyvärinen, A., & Erkki Oja, A. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1483 · Cited by 3,373 · see citing works
Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
Jutten, C., & Hérault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90079-x · Cited by 2,550 · see citing works
Adaptive filter theory (2nd ed.)
Haykin, S. (1991) · Prentice-Hall, Inc eBooks · Cited by 1,905 · see citing works
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,677 · see citing works
First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method
Battiti, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.2.141 · Cited by 1,193 · see citing works
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183 · see citing works
A Simple Coding Procedure Enhances a Neuron's Information Capacity
Laughlin, S. B. (1981) · Zeitschrift für Naturforschung C · doi:10.1515/znc-1981-9-1040 · Cited by 1,015 · see citing works
Separation of a mixture of independent signals using time delayed correlations
Molgedey, L., & Schuster, H. G. (1994) · Physical Review Letters · doi:10.1103/physrevlett.72.3634 · Cited by 882 · see citing works
Could information theory provide an ecological theory of sensory processing?
Atick, J. J. (2011) · Network: Computation in Neural Systems · doi:10.3109/0954898x.2011.638888 · Cited by 679 · see citing works
Self-organizing neural network that discovers surfaces in random-dot stereograms
Becker, S., & Hinton, G. E. (1992) · Nature · doi:10.1038/355161a0 · Cited by 559 · see citing works
Space or time adaptive signal processing by neural network models
Hérault, J., & Jutten, C. (1986) · AIP conference proceedings · doi:10.1063/1.36258 · Cited by 406 · see citing works
A class of neural networks for independent component analysis
Karhunen, J., Erkki Oja, A., Wang, L., Vigário, R., & Joutsensalo, J. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572090 · Cited by 402 · see citing works
Blind separation of sources, part II: Problems statement
Comon, P., Jutten, C., & Hérault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90080-3 · Cited by 401 · see citing works
Representation and separation of signals using nonlinear PCA type learning
Karhunen, J., & Joutsensalo, J. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90060-4 · Cited by 374 · see citing works
Local Synaptic Learning Rules Suffice to Maximize Mutual Information in a Linear Network
Linsker, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.5.691 · Cited by 280 · see citing works
Learning Factorial Codes by Predictability Minimization
Schmidhuber, J. (1992) · Neural Computation · doi:10.1162/neco.1992.4.6.863 · Cited by 270 · see citing works
Adaptation and decorrelation in the cortex
Barlow, H. B., & Földiák, P. (1989) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 263 · see citing works
Cichocki, A. S., & Unbehauen, R. (1996) · IEEE Transactions on Circuits and Systems I Fundamental Theory and Applications · doi:10.1109/81.542280 · Cited by 259 · see citing works
Biswal, B. B., & Ulmer, J. L. (1999) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199903000-00016 · Cited by 255 · see citing works
Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer
Nadal, J., & Parga, N. (1994) · Network Computation in Neural Systems · doi:10.1088/0954-898x_5_4_008 · Cited by 254 · see citing works
Could information theory provide an ecological theory of sensory processing?
Atick, J. J. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x/3/2/009 · Cited by 234 · see citing works
Blind separation of sources: A nonlinear neural algorithm
Burel, G. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80090-5 · Cited by 216 · see citing works
Olfactory computation and object perception.
Hopfield, J. J. (1991) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.88.15.6462 · Cited by 190 · see citing works
Criteria for multichannel signal separation
Yellin, D., & Weinstein, E. (1994) · IEEE Transactions on Signal Processing · doi:10.1109/78.301850 · Cited by 185 · see citing works
Neural networks expand SP's horizons
Haykin, S. (1996) · IEEE Signal Processing Magazine · doi:10.1109/79.487040 · Cited by 157 · see citing works
An Application of the Principle of Maximum Information Preservation to Linear Systems
Linsker, R. (1988) · Cited by 148 · see citing works
Statistical Independence and Novelty Detection with Information Preserving Nonlinear Maps
Parra, L. C., Deco, G., & Miesbach, S. (1996) · Neural Computation · doi:10.1162/neco.1996.8.2.260 · Cited by 141 · see citing works
Blind separation of sources, part III: Stability analysis
Sorouchyari, E. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90081-s · Cited by 138 · see citing works
Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer
Nadal, J., & Parga, N. (1994) · Network Computation in Neural Systems · doi:10.1088/0954-898x/5/4/008 · Cited by 128 · see citing works
Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures
Deco, G., & Brauer, W. (1995) · Neural Networks · doi:10.1016/0893-6080(94)00108-x · Cited by 122 · see citing works
Convergent Algorithm for Sensory Receptive Field Development
Atick, J. J., & Redlich, A. (1993) · Neural Computation · doi:10.1162/neco.1993.5.1.45 · Cited by 91 · see citing works
Multidimensional density shaping by sigmoids
Roth, Z., & Baram, Y. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536322 · Cited by 83 · see citing works
Current-mode subthreshold MOS implementation of the Herault-Jutten autoadaptive network
Cohen, M. H., & Andreou, A. G. (1992) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.133158 · Cited by 59 · see citing works
CMOS Integration of Herault-Jutten Cells for Separation of Sources
Vittoz, E. A., & Arreguit, X. (1989) · Kluwer international series in engineering and computer science · doi:10.1007/978-1-4613-1639-8_3 · Cited by 48 · see citing works
Networks for the Separation of Sources that are Superimposed and Delayed
Platt, J. C., & Faggin, F. (1991) · Cited by 41 · see citing works
Redundancy reduction with information-preserving nonlinear maps
Parra, L. C., Deco, G., & Miesbach, S. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x_6_1_004 · Cited by 38 · see citing works
Li, S., & Sejnowski, T. J. (1995) · IEEE Journal of Oceanic Engineering · doi:10.1109/48.380244 · Cited by 34 · see citing works
Self-citationAnalog CMOS integration and experimentation with an autoadaptive independent component analyzer
Cohen, M. H., & Andreou, A. G. (1995) · IEEE Transactions on Circuits and Systems II Analog and Digital Signal Processing · doi:10.1109/82.365346 · Cited by 33 · see citing works
A Non-linear Information Maximisation Algorithm that Performs Blind Separation
Bell, A. J., & Sejnowski, T. J. (1994) · Cited by 31 · see citing works
Self-citationA temporal model of linear anti-Hebbian learning
Girolami, M., & Fyfe, C. (1996) · Neural Processing Letters · doi:10.1007/bf00426022 · Cited by 28 · see citing works
Optimal Sampling of Natural Images: A Design Principle for the Visual System
Bialek, W., Ruderman, D., & Zee, A. (1990) · neural information processing systems · Cited by 27 · see citing works
Competitive Anti-Hebbian Learning of Invariants
Schraudolph, N. N., & B, T. J. S. A. (1991) · Cited by 26 · see citing works
Adaptive approach to blind source separation with cancellation of additive and convolutional noise
Cichocki, A. S., Kasprzak, W., & Амари, Ш.-И. (2002) · International Conference on Signal Processing · doi:10.1109/icsigp.1996.567290 · Cited by 17 · see citing works
Redundancy reduction with information-preserving nonlinear maps
Parra, L. C., Deco, G., & Miesbach, S. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x/6/1/004 · Cited by 12 · see citing works
Schuster, H. G. (1992) · Physical Review A · doi:10.1103/physreva.46.2131 · Cited by 11 · see citing works
Blind equalization formulated as a self-organized learning process
Haykin, S. (2003) · Asilomar Conference on Signals, Systems & Computers (ACSSC) · doi:10.1109/acssc.1992.269177 · Cited by 8 · see citing works
Girolami, M., & Fyfe, C. (1996) · Elsevier eBooks · doi:10.1016/b978-044482587-2/50031-8 · Cited by 7 · see citing works
Príncipe, J. C., Wang, C., & Wu, H. (2002) · doi:10.1109/nnsp.1996.548371 · Cited by 7 · see citing works
Fynmore, R. J. (1908) · Notes and Queries · doi:10.1093/nq/s10-ix.229.393g · Cited by 5 · see citing works
Multi-Dimensional Density Shaping by Sigmoidal Networks
Baram, Y., & Roth, Z. (2005) · doi:10.1109/icnn.1995.487270 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371 · see citing works
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570 · see citing works
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,799 · see citing works
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585 · see citing works
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. M. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,464 · see citing works
Independent component analysis: algorithms and applications
Hyvärinen, A., & Erkki Oja, A. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00026-5 · Cited by 8,726 · see citing works
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · see citing works
Statistical pattern recognition: a review
Jain, A. K., Duin, P., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,795 · see citing works
Fast and robust fixed-point algorithms for independent component analysis
Hyvärinen, A. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.761722 · Cited by 6,239 · see citing works
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,174 · see citing works
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · see citing works
Correspondence of the brain's functional architecture during activation and rest
Smith, S. M., Fox, P. T., Miller, K. L., Glahn, D. C., Fox, P. M., Mackay, C. E., Filippini, N., Watkins, K. E., Toro, R., Laird, A. R., et al. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905267106 · Cited by 5,150 · see citing works
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 5,037 · see citing works
A theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · see citing works
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642 · see citing works
Investigations into resting-state connectivity using independent component analysis
Beckmann, C. F., DeLuca, M., Devlin, J. T., & Smith, S. M. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1634 · Cited by 3,398 · see citing works
A Fast Fixed-Point Algorithm for Independent Component Analysis
Hyvärinen, A., & Erkki Oja, A. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1483 · Cited by 3,373 · see citing works
Removing electroencephalographic artifacts by blind source separation
Jung, T., Makeig, S., Humphries, C., Lee, T.-W., McKeown, M. J., Iragui, V. J., & B, T. J. S. A. (2000) · Psychophysiology · doi:10.1111/1469-8986.3720163 · Cited by 3,342 · see citing works
A method for making group inferences from functional MRI data using independent component analysis
Calhoun, V. D., Adali, T., Pearlson, G. D., & Pekar, J. J. (2001) · Human Brain Mapping · doi:10.1002/hbm.1048 · Cited by 2,994 · see citing works
Reservoir computing approaches to recurrent neural network training
Lukoševičius, M., & Jaeger, H. (2009) · Computer Science Review · doi:10.1016/j.cosrev.2009.03.005 · Cited by 2,956 · see citing works
Tracking whole-brain connectivity dynamics in the resting state
Allen, E. A., Damaraju, E., Plis, S. M., Erhardt, E. B., Eichele, T., & Calhoun, V. D. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs352 · Cited by 2,992 · see citing works
Natural Gradient Works Efficiently in Learning
Амари, Ш.-И. (1998) · Neural Computation · doi:10.1162/089976698300017746 · Cited by 2,745 · see citing works
Probabilistic Independent Component Analysis for Functional Magnetic Resonance Imaging
Beckmann, C. F., & Smith, S. M. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.822821 · Cited by 2,707 · see citing works
Gazzaniga, M. S., & Bizzi, E. (2000) · Cited by 2,525 · see citing works
ICLabel: An automated electroencephalographic independent component classifier, dataset, and website
Pion-Tonachini, L., Kreutz-Delgado, K., & Makeig, S. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.05.026 · Cited by 2,331 · see citing works
Parameterizing neural power spectra into periodic and aperiodic components
Donoghue, T., Haller, M., Peterson, E. J., Varma, P., Sebastian, P., Gao, R., Noto, T., Lara, A. H., Wallis, J. D., Knight, R. T., et al. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-00744-x · Cited by 2,294 · see citing works
Definitions, methods, and applications in interpretable machine learning
Murdoch, W. J., Singh, C., Kumbier, K., Abbasi-Asl, R., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900654116 · Cited by 2,167 · see citing works
“Methods such as principal components analysis (48), independent components analysis (49), and canonical correlation analysis (50) can often identify a few interpretable dimensions, which can then be used as input to a model or to provide insights in their own right.”
BackgroundThe “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 1,592 · see citing works
Self-citationBrain Computer Interfaces, a Review
Nicolas-Alonso, L. F., & Gomez-Gil, J. (2012) · Sensors · doi:10.3390/s120201211 · Cited by 2,143 · see citing works
Dimensionality Reduction: A Comparative Review
van der Maaten, L., Postma, E. O., & van den Herik, H. J. (2009) · Cited by 2,066 · see citing works
Lee, T.-W., Girolami, M., & Sejnowski, T. J. (1999) · Neural Computation · doi:10.1162/089976699300016719 · Cited by 1,967 · see citing works
Independent Component Analysis of Electroencephalographic Data
Makeig, S., Bell, A. J., Jung, T., & B, T. J. S. A. (1995) · Cited by 1,957 · see citing works
Self-citationFace recognition by independent component analysis
Bartlett, M. S., Movellan, J. R., & B, T. J. S. A. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.804287 · Cited by 1,931 · see citing works
Independent Component Analysis
(2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511624148 · Cited by 1,949 · see citing works
A New Learning Algorithm for Blind Signal Separation
Амари, Ш.-И., Cichocki, A. S., & Yang, H. H. (1995) · Cited by 1,904 · see citing works
Blind signal separation: statistical principles
Cardoso, J.-F. (1998) · Proceedings of the IEEE · doi:10.1109/5.720250 · Cited by 1,886 · see citing works
Adaptive Blind Signal and Image Processing
Cichocki, A. S., & Амари, Ш.-И. (2002) · Wiley eBooks · doi:10.1002/0470845899 · Cited by 1,866 · see citing works
Neural correlations, population coding and computation
Averbeck, B. B., Latham, P. E., & Pouget, A. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1888 · Cited by 1,743 · see citing works
Dynamic Brain Sources of Visual Evoked Responses
Makeig, S., Westerfield, M., Jung, T.-P., Enghoff, S., Townsend, J., Courchesne, E., & Sejnowski, T. J. (2002) · Science · doi:10.1126/science.1066168 · Cited by 1,630 · see citing works
Measuring Statistical Dependence with Hilbert-Schmidt Norms
Gretton, A., Bousquet, O., Smola, A. J., & Schölkopf, B. (2005) · Lecture notes in computer science · doi:10.1007/11564089_7 · Cited by 1,668 · see citing works
Delorme, A., Sejnowski, T., & Makeig, S. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.11.004 · Cited by 1,759 · see citing works
Supervised Speech Separation Based on Deep Learning: An Overview
Wang, D., & Chen, J. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2842159 · Cited by 1,530 · see citing works
Mining event-related brain dynamics
Makeig, S., Debener, S., Onton, J., & Arnaud Delorme, A. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.03.008 · Cited by 1,499 · see citing works
Slow Feature Analysis: Unsupervised Learning of Invariances
Wiskott, L., & B, T. J. S. A. (2002) · Neural Computation · doi:10.1162/089976602317318938 · Cited by 1,351 · see citing works
Combinations of muscle synergies in the construction of a natural motor behavior
d’Avella, A., Saltiel, P., & Bizzi, E. (2003) · Nature Neuroscience · doi:10.1038/nn1010 · Cited by 1,348 · see citing works
Jung, T., Makeig, S., Westerfield, M., Townsend, J., Courchesne, E., & B, T. J. S. A. (2000) · Clinical Neurophysiology · doi:10.1016/s1388-2457(00)00386-2 · Cited by 1,326 · see citing works
A Baseline for the Multivariate Comparison of Resting-State Networks
Allen, E. A., Erhardt, E. B., Damaraju, E., Gruner, W. E., Segall, J. M., Silva, R. F., Havlíček, M., Rachakonda, S., Fries, J. F., Kalyanam, R., et al. (2011) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2011.00002 · Cited by 1,286 · see citing works
ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features
Mognon, A., Jovicich, J., Bruzzone, L., & Buiatti, M. (2010) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01061.x · Cited by 1,274 · see citing works
Map-Reduce for Machine Learning on Multicore
Chu, C.-T., Kim, S. K., Lin, Y.-A., Yu, Y., Bradski, G. R., Ng, A. Y., & Olukotun, K. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0040 · Cited by 1,247 · see citing works
Validating the independent components of neuroimaging time series via clustering and visualization
Himberg, J., Hyvärinen, A., & Esposito, F. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.03.027 · Cited by 1,246 · see citing works
Blind separation of auditory event-related brain responses into independent components
Makeig, S., Jung, T., Bell, A. J., Ghahremani, D. G., & B, T. J. S. A. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.20.10979 · Cited by 1,211 · see citing works
Self-citationHigh-Order Contrasts for Independent Component Analysis
Cardoso, J.-F. (1999) · Neural Computation · doi:10.1162/089976699300016863 · Cited by 1,209 · see citing works
Regularization Networks and Support Vector Machines
Evgeniou, T., Pontil, M., & Poggio, T. (2000) · Advances in Computational Mathematics · doi:10.1023/a:1018946025316 · Cited by 1,191 · see citing works
A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data
Calhoun, V. D., Liu, J., & Adalı, T. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.057 · Cited by 1,148 · see citing works
Learning Overcomplete Representations
Lewicki, M. S., & B, T. J. S. A. (2000) · Neural Computation · doi:10.1162/089976600300015826 · Cited by 1,127 · see citing works
BOLD correlates of EEG topography reveal rapid resting-state network dynamics
Britz, J., Van De Ville, D., & Michel, C. M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.02.052 · Cited by 1,070 · see citing works
Exploring Strategies for Training Deep Neural Networks
Larochelle, H., Bengio, Y., Louradour, J., & Lamblin, P. (2009) · doi:10.1145/1577069.1577070 · Cited by 1,109 · see citing works
Aberrant “Default Mode” Functional Connectivity in Schizophrenia
Garrity, A. G., Pearlson, G. D., McKiernan, K., Lloyd, D., Kiehl, K. A., & Calhoun, V. D. (2007) · American Journal of Psychiatry · doi:10.1176/ajp.2007.164.3.450 · Cited by 1,114 · see citing works
Fields of Experts: A Framework for Learning Image Priors
Roth, S., & Black, M. J. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.160 · Cited by 1,087 · see citing works
FASTER: Fully Automated Statistical Thresholding for EEG artifact Rejection
Nolan, H., Whelan, R., & Reilly, R. B. (2010) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2010.07.015 · Cited by 1,080 · see citing works
Damaraju, E., Allen, E. A., Belger, A., Ford, J. M., McEwen, S. C., Mathalon, D. H., Mueller, B. A., Pearlson, G. D., Potkin, S. G., Preda, A., et al. (2014) · NeuroImage Clinical · doi:10.1016/j.nicl.2014.07.003 · Cited by 1,066 · see citing works
Debener, S., Ullsperger, M., Siegel, M., Fiehler, K., von Cramon, D. Y., & Engel, A. K. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.3286-05.2005 · Cited by 1,055 · see citing works
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 1,080 · see citing works
The neural basis of romantic love
Bartels, A., & Zeki, S. (2000) · NeuroReport · doi:10.1097/00001756-200011270-00046 · Cited by 1,020 · see citing works
Learning multiple layers of representation
Hinton, G. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.004 · Cited by 1,016 · see citing works
Hierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · see citing works
“) decomposes the observed response into a linear mixture of non-Gaussian causes”
Surface Electromyography Signal Processing and Classification Techniques
Chowdhury, R. H., Reaz, M. B. I., Ali, M. H., Bakar, A. A. A., Chellappan, K., & Chang, T. (2013) · Sensors · doi:10.3390/s130912431 · Cited by 1,013 · see citing works
Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., & B, T. J. S. A. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799905 · Cited by 999 · see citing works
Jafri, M. J., Pearlson, G. D., Stevens, M. C. G., & Calhoun, V. D. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.001 · Cited by 976 · see citing works
EEG artifact removal—state-of-the-art and guidelines
Urigüen, J. A., & García-Zapirain, B. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/3/031001 · Cited by 973 · see citing works
Estimating the number of independent components for functional magnetic resonance imaging data
Li, Y., Adalı, T., & Calhoun, V. D. (2007) · Human Brain Mapping · doi:10.1002/hbm.20359 · Cited by 912 · see citing works
Tosic, I., & Pascal Frossard, B. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.939537 · Cited by 899 · see citing works
A Unifying Review of Linear Gaussian Models
Roweis, S. T., & Zoubin Ghahramani, A. (1999) · Neural Computation · doi:10.1162/089976699300016674 · Cited by 873 · see citing works
Frontal midline EEG dynamics during working memory
Onton, J., Arnaud Delorme, A., & Makeig, S. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.04.014 · Cited by 846 · see citing works
Goulden, N., Khusnulina, A., Davis, N. J., Bracewell, R. M., Bokde, A. L., McNulty, J. P., & Mullins, P. G. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.052 · Cited by 810 · see citing works
Separating Style and Content with Bilinear Models
Tenenbaum, J. B., & Freeman, W. T. (2000) · Neural Computation · doi:10.1162/089976600300015349 · Cited by 840 · see citing works
Tresch, M. C., Cheung, V. C. K., & d’Avella, A. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00222.2005 · Cited by 835 · see citing works
Dictionary Learning Algorithms for Sparse Representation
Kreutz-Delgado, K., Murray, J. F., Rao, B. D., Engan, K., Lee, T.-W., & B, T. J. S. A. (2003) · Neural Computation · doi:10.1162/089976603762552951 · Cited by 838 · see citing works
Hyperscanning: Simultaneous fMRI during Linked Social Interactions
Montague, P. (2002) · NeuroImage · doi:10.1006/nimg.2002.1150 · Cited by 833 · see citing works
Independent EEG Sources Are Dipolar
Delorme, A., Palmer, J., Onton, J., Oostenveld, R., & Makeig, S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0030135 · Cited by 810 · see citing works
Independent component approach to the analysis of EEG and MEG recordings
Vigário, R., Särelä, J., Jousmiki, V., Hämäläinen, M., & Erkki Oja, A. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.841330 · Cited by 796 · see citing works
Kernel independent component analysis
Bach, F., & Jordan, M. I. (2004) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2003.1202783 · Cited by 780 · see citing works
Blind separation of convolved mixtures in the frequency domain
Smaragdis, P. (1998) · Neurocomputing · doi:10.1016/s0925-2312(98)00047-2 · Cited by 777 · see citing works
Convolutive blind separation of non-stationary sources
Parra, L. C., & Spence, C. D. (2000) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.841214 · Cited by 765 · see citing works
Blind Source Separation by Sparse Decomposition in a Signal Dictionary
Zibulevsky, M., & Pearlmutter, B. A. (2001) · Neural Computation · doi:10.1162/089976601300014385 · Cited by 765 · see citing works
Learning and inference in the brain
Friston, K. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.06.005 · Cited by 724 · see citing works
Celone, K., Calhoun, V. D., Dickerson, B. C., Atri, A., Chua, E. F., Miller, S. L., DePeau, K. M., Rentz, D., Selkoe, D. J., Blacker, D., et al. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.2250-06.2006 · Cited by 733 · see citing works
Density estimation using Real NVP
Dinh, L., Sohl-Dickstein, J., & Bengio, S. (2016) · arXiv · Cited by 2,067 · see citing works
Spatiotemporal Analysis of Multichannel EEG: CARTOOL
Brunet, D., Murray, M. M., & Michel, C. M. (2011) · Computational Intelligence and Neuroscience · doi:10.1155/2011/813870 · Cited by 732 · see citing works
Underdetermined blind source separation using sparse representations
Bofill, P., & Zibulevsky, M. (2001) · Signal Processing · doi:10.1016/s0165-1684(01)00120-7 · Cited by 714 · see citing works
Motor Patterns in Human Walking and Running
Cappellini, G., Ivanenko, Y. P., Poppele, R. E., & Lacquaniti, F. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00081.2006 · Cited by 798 · see citing works
Automated Analysis of Cellular Signals from Large-Scale Calcium Imaging Data
Mukamel, E. A., Nimmerjahn, A., & Schnitzer, M. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.08.009 · Cited by 711 · see citing works
Analysing connectivity with Granger causality and dynamic causal modelling
Friston, K., Moran, R., & Seth, A. K. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.010 · Cited by 684 · see citing works
Mourão-Miranda, J., Bokde, A. L. W., Born, C., Hampel, H. J., & Stetter, M. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.070 · Cited by 700 · see citing works
Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using kernel methods
Yang, M. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2002.4527207 · Cited by 705 · see citing works
Roth, S., & Black, M. J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0197-6 · Cited by 847 · see citing works
Calhoun, V. D., Adalı, T., Pearlson, G. D., & Pekar, J. J. (2001) · Human Brain Mapping · doi:10.1002/hbm.1024 · Cited by 697 · see citing works
Natural Frequencies of Human Corticothalamic Circuits
Rosanova, M., Casali, A. G., Bellina, V., Resta, F., Mariotti, M., & Massimini, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0445-09.2009 · Cited by 689 · see citing works
Infomax and maximum likelihood for blind source separation
Cardoso, J.-F. (1997) · IEEE Signal Processing Letters · doi:10.1109/97.566704 · Cited by 681 · see citing works
Friston, K. J., & Stephan, K. E. (2007) · Synthese · doi:10.1007/s11229-007-9237-y · Cited by 673 · see citing works
- Authors
- Bell, A. J., & Sejnowski, T. J.
- Affiliations
- Howard Hughes Medical Institute (US)
- Howard Hughes Medical Institute, Computational Neurobiology Laboratory, The Salk Institute, 10010 N. Torrey Pines Road, La Jolla, CA 92037 USA and Department of Biology, University of California, San Diego, La Jolla, CA 92093 USA
- ORCID
- Bell, Anthony J.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 1995-11
- Volume
- 7
- Issue
- 6
- Pages
- 1129-1159
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2108384452
- Cited by
- 8,986
- References
- 52
- Citations by year
- 2026: 151 · 2025: 242 · 2024: 264 · 2023: 286 · 2022: 329 · 2021: 375 · 2020: 349 · 2019: 372 · 2018: 343 · 2017: 334 · 2016: 346 · 2015: 357 · 2014: 365 · 2013: 352 · 2012: 328
- FWCI
- 130.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Office of Naval Research
- Topics
- Physical Sciences › Computer Science › Signal Processing › Blind Source Separation Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- information maximization, blind source separation, blind deconvolution, self-organized learning, nonlinear neural networks, higher-order statistics, redundancy reduction, principal component analysis, cocktail party problem, time delay dependence, blind signal processing
- MeSH terms
- Algorithms, Humans, Learning, Neurons, Probability, Problem Solving, Speech, Models, Statistical, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review