The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Blind Source Separation by Sparse Decomposition in a Signal Dictionary
Abstract
The blind source separation problem is to extract the underlying source signals from a set of linear mixtures, where the mixing matrix is unknown. This situation is common in acoustics, radio, medical signal and image processing, hyperspectral imaging, and other areas. We suggest a two-stage separation process: a priori selection of a possibly overcomplete signal dictionary (for instance, a wavelet frame or a learned dictionary) in which the sources are assumed to be sparsely representable, followed by unmixing the sources by exploiting the their sparse representability. We consider the general case of more sources than mixtures, but also derive a more efficient algorithm in the case of a nonovercomplete dictionary and an equal numbers of sources and mixtures. Experiments with artificial signals and musical sounds demonstrate significantly better separation than other known techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
Horn, R. A., & Johnson, C. R. (1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810817 · Cited by 10,280
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,205
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
Fast and robust fixed-point algorithms for independent component analysis
Hyvarinen, A. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.761722 · Cited by 6,246
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
A Fast Fixed-Point Algorithm for Independent Component Analysis
Hyvärinen, A., & Oja, E. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1483 · Cited by 3,391
Removing electroencephalographic artifacts by blind source separation
Jung, T., Makeig, S., Humphries, C., Lee, T.-W., McKeown, M. J., Iragui, V. J., & Sejnowski, T. J. (2000) · Psychophysiology · doi:10.1017/s0048577200980259 · Cited by 3,334
Entropy-based algorithms for best basis selection
Coifman, R. R., & Wickerhauser, M. V. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119732 · Cited by 3,188
A blind source separation technique using second-order statistics
Belouchrani, A., Abed-Meraim, K., Cardoso, J.-F., & Moulines, E. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.554307 · Cited by 2,775
Natural Gradient Works Efficiently in Learning
Amari, S.-I. (1998) · Neural Computation · doi:10.1162/089976698300017746 · Cited by 2,681
Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
Jutten, C., & Herault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90079-x · Cited by 2,521
Application of the Karhunen-Loeve procedure for the characterization of human faces
Kirby, M., & Sirovich, L. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.41390 · Cited by 2,448
Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models
Kitagawa, G. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474692 · Cited by 2,404
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
Lee, T.-W., Girolami, M., & Sejnowski, T. J. (1999) · Neural Computation · doi:10.1162/089976699300016719 · Cited by 1,967
A New Learning Algorithm for Blind Signal Separation
Амари, Ш.-И., Cichocki, A. S., & Yang, H. H. (1995) · Cited by 1,904
Mixtures of Probabilistic Principal Component Analyzers
Tipping, M. E., & Bishop, C. M. (1999) · Neural Computation · doi:10.1162/089976699300016728 · Cited by 1,873
GTM: The Generative Topographic Mapping
Bishop, C. M., Svensén, M., & Williams, C. K. I. (1998) · Neural Computation · doi:10.1162/089976698300017953 · Cited by 1,388
High-Order Contrasts for Independent Component Analysis
Cardoso, J.-F. (1999) · Neural Computation · doi:10.1162/089976699300016863 · Cited by 1,213
Blind separation of auditory event-related brain responses into independent components
Makeig, S., Jung, T.-P., Bell, A. J., Ghahremani, D., & Sejnowski, T. J. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.20.10979 · Cited by 1,206
Factorial Hidden Markov Models
Ghahramani, Z., & Jordan, M. I. (1997) · Machine Learning · doi:10.1023/a:1007425814087 · Cited by 1,157
Learning Overcomplete Representations
Lewicki, M. S., & Sejnowski, T. J. (2000) · Neural Computation · doi:10.1162/089976600300015826 · Cited by 1,129
SURVEY OF INDEPENDENT COMPONENT ANALYSIS
Hyvärinen, A. (1999) · Cited by 1,120
Independent component filters of natural images compared with simple cells in primary visual cortex
van Hateren, J. H., & van der Schaaf, A. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0303 · Cited by 1,106
Image reconstruction from incomplete and noisy data
Gull, S. F., & Daniell, G. J. (1978) · Nature · doi:10.1038/272686a0 · Cited by 965
An Information Measure for Classification
Wallace, C. S., & Boulton, D. M. (1968) · The Computer Journal · doi:10.1093/comjnl/11.2.185 · Cited by 933
Separation of a mixture of independent signals using time delayed correlations
Molgedey, L., & Schuster, H. G. (1994) · Physical Review Letters · doi:10.1103/physrevlett.72.3634 · Cited by 882
A Unifying Review of Linear Gaussian Models
Roweis, S., & Ghahramani, Z. (1999) · Neural Computation · doi:10.1162/089976699300016674 · Cited by 869
A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals
Bingham, E. (2000) · International Journal of Neural Systems · doi:10.1016/s0129-0657(00)00002-8 · Cited by 854
Dictionary Learning Algorithms for Sparse Representation
Kreutz-Delgado, K., Murray, J. F., Rao, B. D., Engan, K., Lee, T.-W., & Sejnowski, T. J. (2003) · Neural Computation · doi:10.1162/089976603762552951 · Cited by 838
Exploratory Projection Pursuit
Friedman, J. H. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478427 · Cited by 794
Infomax and maximum likelihood for blind source separation
Cardoso, J.-F. (1997) · IEEE Signal Processing Letters · doi:10.1109/97.566704 · Cited by 684
Extraction of ocular artefacts from EEG using independent component analysis
Vigário, R. N. (1997) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(97)00042-8 · Cited by 639
Towards a Theory of Early Visual Processing
Atick, J. J., & Redlich, A. N. (1990) · Neural Computation · doi:10.1162/neco.1990.2.3.308 · Cited by 554
Nonlinear independent component analysis: Existence and uniqueness results
Hyvärinen, A., & Pajunen, P. (1999) · Neural Networks · doi:10.1016/s0893-6080(98)00140-3 · Cited by 524
Jones, M. C., & Sibson, R. (1987) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981662 · Cited by 522
Attias, H. (1999) · Neural Computation · doi:10.1162/089976699300016458 · Cited by 504
Adaptive blind separation of independent sources: A deflation approach
Delfosse, N., & Loubaton, P. (1995) · Signal Processing · doi:10.1016/0165-1684(95)00042-c · Cited by 499
Blind separation of mixture of independent sources through a quasi-maximum likelihood approach
Pham, D. T., & Garat, P. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.599941 · Cited by 469
Spatially independent activity patterns in functional MRI data during the Stroop color-naming task
McKeown, M. J., Jung, T.-P., Makeig, S., Brown, G., Kindermann, S. S., Lee, T.-W., & Sejnowski, T. J. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.3.803 · Cited by 461
Source separation in post-nonlinear mixtures
Taleb, A., & Jutten, C. (1999) · IEEE Transactions on Signal Processing · doi:10.1109/78.790661 · Cited by 419
van Hateren, J. H., & Ruderman, D. L. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0577 · Cited by 407
Blind source separation of more sources than mixtures using overcomplete representations
Lee, T.-W., Lewicki, M. S., Girolami, M., & Sejnowski, T. J. (1999) · IEEE Signal Processing Letters · doi:10.1109/97.752062 · Cited by 405
Blind separation of sources, part II: Problems statement
Comon, P., Jutten, C., & Herault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90080-3 · Cited by 394
Representation and separation of signals using nonlinear PCA type learning
Karhunen, J., & Joutsensalo, J. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90060-4 · Cited by 371
Origins of scaling in natural images
Ruderman, D. L. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00008-4 · Cited by 355
Super-exponential methods for blind deconvolution
Shalvi, O., & Weinstein, E. (1993) · IEEE Transactions on Information Theory · doi:10.1109/18.212280 · Cited by 337
Mean Field Theory for Sigmoid Belief Networks
Saul, L. K., Jaakkola, T., & Jordan, M. I. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.251 · Cited by 327
A First Application of Independent Component Analysis to Extracting Structure from Stock Returns
Back, A. D., & Weigend, A. S. (1997) · International Journal of Neural Systems · doi:10.1142/s0129065797000458 · Cited by 309
Probabilistic framework for the adaptation and comparison of image codes
Lewicki, M. S., & Olshausen, B. A. (1999) · Journal of the Optical Society of America A · doi:10.1364/josaa.16.001587 · Cited by 308
Stability Analysis of Learning Algorithms for Blind Source Separation
Amari, S.-I., Chen, T.-P., & Cichocki, A. (1997) · Neural Networks · doi:10.1016/s0893-6080(97)00039-7 · Cited by 293
Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer
Nadal, J., & Parga, N. (1994) · Network Computation in Neural Systems · doi:10.1088/0954-898x/5/4/008 · Cited by 282
Local Synaptic Learning Rules Suffice to Maximize Mutual Information in a Linear Network
Linsker, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.5.691 · Cited by 280
Kowalski, N., Depireux, D. A., & Shamma, S. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.5.3503 · Cited by 269
Atick, J. J., Griffin, P. A., & Redlich, A. N. (1996) · Neural Computation · doi:10.1162/neco.1996.8.6.1321 · Cited by 269
Independent component analysis by general nonlinear Hebbian-like learning rules
Hyvärinen, A., & Oja, E. (1998) · Signal Processing · doi:10.1016/s0165-1684(97)00197-7 · Cited by 248
Signal separation by symmetric adaptive decorrelation: stability, convergence, and uniqueness
Van Gerven, S., & Van Compernolle, D. (1995) · IEEE Transactions on Signal Processing · doi:10.1109/78.398721 · Cited by 244
The Fixed-Point Algorithm and Maximum Likelihood Estimation for Independent Component Analysis
Hyvärinen, A. (1999) · Neural Processing Letters · doi:10.1023/a:1018647011077 · Cited by 215
Blind separation of sources: A nonlinear neural algorithm
Burel, G. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80090-5 · Cited by 213
Penalty/Barrier Multiplier Methods for Convex Programming Problems
Ben-Tal, A., & Zibulevsky, M. (1997) · SIAM Journal on Optimization · doi:10.1137/s1052623493259215 · Cited by 203
Self-citationTheunissen, F. E., & Doupe, A. J. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-10-03786.1998 · Cited by 191
McNair, A. (1961) · Philosophical Magazine · doi:10.1080/14786436108243332 · Cited by 187
Information–theoretic approach to blind separation of sources in non-linear mixture
Yang, H. H., Амари, Ш.-И., & Cichocki, A. S. (1998) · Signal Processing · doi:10.1016/s0165-1684(97)00196-5 · Cited by 153
A Context-Sensitive Generalization of ICA
Pearlmutter, B. A., & Parra, L. C. (1996) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 145
Self-citationStatistical Independence and Novelty Detection with Information Preserving Nonlinear Maps
Parra, L. C., Deco, G., & Miesbach, S. (1996) · Neural Computation · doi:10.1162/neco.1996.8.2.260 · Cited by 141
Description and generation of spherically invariant speech-model signals
Brehm, H., & Stammler, W. (1987) · Signal Processing · doi:10.1016/0165-1684(87)90001-6 · Cited by 138
Replicator Neural Networks for Universal Optimal Source Coding
Hecht-Nielsen, R. (1995) · Science · doi:10.1126/science.269.5232.1860 · Cited by 134
A method of blind separation for convolved non-stationary signals
Kawamoto, M., Matsuoka, K., & Ohnishi, N. (1998) · Neurocomputing · doi:10.1016/s0925-2312(98)00055-1 · Cited by 123
Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures
Deco, G., & Brauer, W. (1995) · Neural Networks · doi:10.1016/0893-6080(94)00108-x · Cited by 122
Independent Components of Magnetoencephalography: Localization
Tang, A. C., Pearlmutter, B. A., Malaszenko, N. A., Phung, D. B., & Reeb, B. C. (2002) · Neural Computation · doi:10.1162/089976602760128036 · Cited by 122
Self-citationAn Alternative Perspective on Adaptive Independent Component Analysis Algorithms
Girolami, M. (1998) · Neural Computation · doi:10.1162/089976698300016981 · Cited by 113
Nonlinear Blind Source Separation by Self-Organizing Maps
Pajunen, P., Hyvärinen, A., & Karhunen, J. (1996) · Cited by 104
A New Method for Spectral Decomposition Using a Bilinear Bayesian Approach
Ochs, M. F., Stoyanova, R. S., Arias‐Mendoza, F., & Brown, T. R. (1999) · Journal of Magnetic Resonance · doi:10.1006/jmre.1998.1639 · Cited by 101
Simulating the ‘Other-race Effect’ as a Problem in Perceptual Learning
O’Toole, A. J., Deffenbacher, K. A., Abdi, H., & Bartlett, J. C. (1991) · Connection Science · doi:10.1080/09540099108946583 · Cited by 100
Inferring the eigenvalues of covariance matrices from limited, noisy data
Everson, R., & Roberts, S. (2000) · IEEE Transactions on Signal Processing · doi:10.1109/78.847792 · Cited by 99
Blind source separation by sparse decomposition in a signal dictionary
Zibulevsky, M., Pearlmutter, B. A., Bofill, P., & Kisilev, P. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511624148.008 · Cited by 93
Self-citationDetection in the presence of spherically symmetric random vectors
Goldman, J. (1976) · IEEE Transactions on Information Theory · doi:10.1109/tit.1976.1055514 · Cited by 90
Independent Component Analysis: A Flexible Nonlinearity and Decorrelating Manifold Approach
Everson, R., & Roberts, S. (1999) · Neural Computation · doi:10.1162/089976699300016043 · Cited by 84
Multidimensional density shaping by sigmoids
Roth, Z., & Baram, Y. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536322 · Cited by 83
Faithful Representation of Separable Distributions
Lin, J. K., Grier, D. G., & Cowan, J. D. (1997) · Neural Computation · doi:10.1162/neco.1997.9.6.1305 · Cited by 82
Feature Extraction Through LOCOCODE
Hochreiter, S., & Schmidhuber, J. (1999) · Neural Computation · doi:10.1162/089976699300016629 · Cited by 80
Blind signal separation from optical imaging recordings with extended spatial decorrelation
Schießl, I., Stetter, M., Mayhew, J. E. W., McLoughlin, N. P., Lund, J. S., & Obermayer, K. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.841327 · Cited by 74
Convolutive blind source separation based on multiple decorrelation
Parra, L. C., Spence, C. D., & de Vries, B. (2002) · Machine learning for signal processing ... · doi:10.1109/nnsp.1998.710626 · Cited by 73
Redundancy reduction with information-preserving nonlinear maps
Parra, L. C., Deco, G., & Miesbach, S. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x_6_1_004 · Cited by 38
(1998) · doi:10.1002/(sici)1097-0193(1998)6:3<160::aid-hbm5>3.0.co;2-1
Cited by
Performance measurement in blind audio source separation
Vincent, E., Gribonval, R., & Fevotte, C. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tsa.2005.858005 · Cited by 2,889
Online Learning for Matrix Factorization and Sparse Coding
Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0908.0050 · Cited by 2,258
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
Bruckstein, A. M., Donoho, D. L., & Elad, M. (2009) · SIAM Review · doi:10.1137/060657704 · Cited by 2,183
Conv-TasNet: Surpassing Ideal Time–Frequency Magnitude Masking for Speech Separation
Luo, Y., & Mesgarani, N. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2915167 · Cited by 2,042
Blind Separation of Speech Mixtures via Time-Frequency Masking
Yilmaz, O., & Rickard, S. (2004) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2004.828896 · Cited by 1,474
Metadata
- Authors
- Zibulevsky, M., & Pearlmutter, B. A.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2001-04-01
- Volume
- 13
- Issue
- 4
- Pages
- 863-882
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2161219071
- Cited by
- 766
- References
- 92
- FWCI
- 43.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.