The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
On Tensors, Sparsity, and Nonnegative Factorizations
Open accessAbstract
Tensors have found application in a variety of fields, ranging from chemometrics to signal processing and beyond. In this paper, we consider the problem of multilinear modeling of sparse count data. Our goal is to develop a descriptive tensor factorization model of such data, along with appropriate algorithms and theory. To do so, we propose that the random variation is best described via a Poisson distribution, which better describes the zeros observed in the data as compared to the typical assumption of a Gaussian distribution. Under a Poisson assumption, we fit a model to observed data using the negative log-likelihood score. We present a new algorithm for Poisson tensor factorization called CANDECOMP--PARAFAC alternating Poisson regression (CP-APR) that is based on a majorization-minimization approach. It can be shown that CP-APR is a generalization of the Lee--Seung multiplicative updates. We show how to prevent the algorithm from converging to non-KKT points and prove convergence of CP-APR under mild conditions. We also explain how to implement CP-APR for large-scale sparse tensors and present results on several data sets, both real and simulated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
ALGORITHMS FOR NON-NEGATIVE MATRIX FACTORIZATION
Lee, D. D., & Seung, H. S. (2000) · neural information processing systems · Cited by 9,873
(1999) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/b98874 · Cited by 9,482
Paatero, P., & Tapper, U. (1994) · Environmetrics · doi:10.1002/env.3170050203 · Cited by 6,023
Parallel and Distributed Computation: Numerical Methods
Bertsekas, D. P., & Tsitsiklis, J. N. (1989) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5,293
ALGORITHMS FOR NON-NEGATIVE MATRIX FACTORIZATION
Seung, D., & Lee, L.-W. (2001) · Cited by 4,753
Carroll, J. D., & Chang, J.-J. (1970) · Psychometrika · doi:10.1007/bf02310791 · Cited by 4,678
Maximum Likelihood Reconstruction for Emission Tomography
Shepp, L. A., & Vardi, Y. (1982) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.1982.4307558 · Cited by 4,429
An iterative technique for the rectification of observed distributions
Lucy, L. B. (1974) · The Astronomical Journal · doi:10.1086/111605 · Cited by 3,866 · cited 2×
“This majorization is also a special case of the one derived in [14] when β = 1 and has a long history in image reconstruction that predates its use in NMF [36, 45, 28].”
Christensen, R. (1990) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4111-7_10 · Cited by 2,923
Harshman, R. A. (1970) · Cited by 2,255
EM reconstruction algorithms for emission and transmission tomography.
Lange, K. L., & Carson, R. E. (1984) · PubMed · Cited by 1,769
Projected Gradient Methods for Nonnegative Matrix Factorization
Lin, C.-J. (2007) · Neural Computation · doi:10.1162/neco.2007.19.10.2756 · Cited by 1,737
Multi‐Way Analysis with Applications in the Chemical Sciences
Smilde, A., Bro, R., & Geladi, P. (2004) · Wiley eBooks · doi:10.1002/0470012110 · Cited by 1,176
Nonlinear Programming: A Unified Approach
Peterson, D. W., & Zangwill, W. I. (1972) · Econometrica · doi:10.2307/1909424 · Cited by 1,005
Tensor Rank and the Ill-Posedness of the Best Low-Rank Approximation Problem
de Silva, V., & Lim, L.-H. (2008) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/06066518x · Cited by 927
A fast non-negativity-constrained least squares algorithm
Bro, R., & De Jong, S. (1997) · Journal of Chemometrics · doi:10.1002/(sici)1099-128x(199709/10)11:5<393::aid-cem483>3.0.co;2-l · Cited by 906
Algorithms for Nonnegative Matrix Factorization with the β-Divergence
Févotte, C., & Idier, J. (2011) · Neural Computation · doi:10.1162/neco_a_00168 · Cited by 663
Scalable tensor factorizations for incomplete data
Acar, E., Dunlavy, D. M., Kolda, T. G., & Mørup, M. (2011) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2010.08.004 · Cited by 602
Self-citationKim, H., & Park, H. (2008) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/07069239x · Cited by 574
Generalized Nonnegative Matrix Approximations with Bregman Divergences
Sra, S., & Dhillon, I. S. (2005) · MPG.PuRe (Max Planck Society) · Cited by 523
Beyond streams and graphs: dynamic tensor analysis
Sun, J., Tao, D., & Faloutsos, C. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150445 · Cited by 462
On the Convergence of Multiplicative Update Algorithms for Nonnegative Matrix Factorization
Lin, C.-J. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2007.895831 · Cited by 416
Convergence of EM image reconstruction algorithms with Gibbs smoothing
Lange, K. (1990) · IEEE Transactions on Medical Imaging · doi:10.1109/42.61759 · Cited by 400
A weighted non-negative least squares algorithm for three-way ‘PARAFAC’ factor analysis
Paatero, P. (1997) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(97)00031-2 · Cited by 340
Fast Nonnegative Matrix Factorization: An Active-Set-Like Method and Comparisons
Kim, J., & Park, H. (2011) · SIAM Journal on Scientific Computing · doi:10.1137/110821172 · Cited by 328
Damped Newton Algorithms for Matrix Factorization with Missing Data
Buchanan, A. M., & Fitzgibbon, A. W. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.118 · Cited by 299
Gillis, N., & Glineur, F. (2012) · Neural Computation · doi:10.1162/neco_a_00256 · Cited by 216
Weighted Least Squares Fitting Using Ordinary Least Squares Algorithms
Kiers, H. A. L. (1997) · Psychometrika · doi:10.1007/bf02295279 · Cited by 199
A quasi-Newton acceleration for high-dimensional optimization algorithms
Zhou, H., Alexander, D., & Lange, K. (2011) · Statistics and Computing · doi:10.1007/s11222-009-9166-3 · Cited by 190
Nonnegative approximations of nonnegative tensors
Lim, L., & Comon, P. (2009) · Journal of Chemometrics · doi:10.1002/cem.1244 · Cited by 183
Proceedings 2007 IEEE international conference on bioinformatics and biomedicine
(2007) · 2007 IEEE International Conference on Bioinformatics and Biomedicine Workshops · doi:10.1109/bibmw.2007.4425389 · Cited by 183
Welling, M., & Weber, M. (2001) · Pattern Recognition Letters · doi:10.1016/s0167-8655(01)00070-8 · Cited by 168
Algorithms for Sparse Nonnegative Tucker Decompositions
Mørup, M., Hansen, L. K., & Arnfred, S. M. (2008) · Neural Computation · doi:10.1162/neco.2008.11-06-407 · Cited by 167
Accelerating the Lee-Seung Algorithm for Nonnegative Matrix Factorization
Gonzalez, E. F., & Zhang, Y. (2005) · Rice Research Repository (Rice University) · Cited by 163
Non-Negative Tensor Factorization using Alpha and Beta Divergences
Cichocki, A. S., Zdunek, R., Choi, S., Plemmons, R. J., & Амари, Ш.-И. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367106 · Cited by 98
Tackling Box-Constrained Optimization via a New Projected Quasi-Newton Approach
Kim, D., Sra, S., & Dhillon, I. S. (2010) · SIAM Journal on Scientific Computing · doi:10.1137/08073812x · Cited by 86
Computing non-negative tensor factorizations
Friedlander, M. P., & Hatz, K. (2008) · Optimization methods & software · doi:10.1080/10556780801996244 · Cited by 83
Berry, M. W., & Castellanos, M. (2007) · Springer eBooks · doi:10.1007/978-1-84800-046-9 · Cited by 83
Nonnegative matrix factorization and I-divergence alternating minimization
Finesso, L., & Spreij, P. (2006) · Linear Algebra and its Applications · doi:10.1016/j.laa.2005.11.012 · Cited by 69
Multilinear algebra for analyzing data with multiple linkages.
Kegelmeyer, W. P., Dunlavy, D., & Kolda, T. G. (2006) · doi:10.2172/883132 · Cited by 59
Self-citationNonnegative Factorization and The Maximum Edge Biclique ProblemPreprint
Gillis, N., & Glineur, F. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0810.4225 · Cited by 58
7. Multilinear Algebra for Analyzing Data with Multiple Linkages
Dunlavy, D., Kolda, T. G., & Kegelmeyer, W. P. (2011) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898719918.ch7 · Cited by 43
Self-citationFitting Arma Time Series by Structural Equation Models
van Buuren, S. (1997) · Psychometrika · doi:10.1007/bf02295276 · Cited by 35
Mørup, M., Hansen, L. K., Parnas, J., & Arnfred, S. (2006) · Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) · Cited by 34
Single-Trial Decoding of Bistable Perception Based on Sparse Nonnegative Tensor Decomposition
Wang, Z., Maier, A., Logothetis, N. K., & Liang, H. (2008) · Computational Intelligence and Neuroscience · doi:10.1155/2008/642387 · Cited by 9
Cited by
Tensors for Data Mining and Data Fusion: Models, Applications, and Scalable Algorithms
Papalexakis, E. E., Faloutsos, C., & Sidiropoulos, N. D. (2017) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2915921 · Cited by 354
Williams, A. H., Kim, T. H., Wang, F., Vyas, S., Ryu, S. I., Shenoy, K. V., Schnitzer, M., Kolda, T. G., & Ganguli, S. (2018) · Neuron · doi:10.1016/j.neuron.2018.05.015 · Cited by 310
Self-citationMachine Learning for Lung Cancer Diagnosis, Treatment, and Prognosis
Li, Y., Wu, X., Yang, P., Jiang, G., & Luo, Y. (2022) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2022.11.003 · Cited by 263
Si, Y., Du, J., Li, Z., Jiang, X., Miller, T., Wang, F., Jim Zheng, W., & Roberts, K. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103671 · Cited by 235
Privacy-Preserving Tensor Factorization for Collaborative Health Data Analysis
Ma, J., Zhang, Q., Lou, J., Ho, J. C., Xiong, L., & Jiang, X. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3357878 · Cited by 51
Metadata
- Authors
- Chi, E. C., & Kolda, T. G.
- Venue
- SIAM Journal on Matrix Analysis and Applications
- Published
- 2012-01
- Volume
- 33
- Issue
- 4
- Pages
- 1272-1299
- ISSN
- 0895-4798 (ISSN-L)
- 1095-7162
- OpenAlex
- W2024356620
- Cited by
- 274
- References
- 49
- FWCI
- 4.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.