The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Relational learning via collective matrix factorization
Abstract
Relational learning is concerned with predicting unknown values of a relation, given a database of entities and observed relations among entities. An example of relational learning is movie rating prediction, where entities could include users, movies, genres, and actors. Relations encode users' ratings of movies, movies' genres, and actors' roles in movies. A common prediction technique given one pairwise relation, for example a #users x #movies ratings matrix, is low-rank matrix factorization. In domains with multiple relations, represented as multiple matrices, we may improve predictive accuracy by exploiting information from one relation while predicting another. To this end, we propose a collective matrix factorization model: we simultaneously factor several matrices, sharing parameters among factors when an entity participates in multiple relations. Each relation can have a different value type and error distribution; so, we allow nonlinear relationships between the parameters and outputs, using Bregman divergences to measure error. We extend standard alternating projection algorithms to our model, and derive an efficient Newton update for the projection. Furthermore, we propose stochastic optimization methods to deal with large, sparse matrices. Our model generalizes several existing matrix factorization methods, and therefore yields new large-scale optimization algorithms for these problems. Our model can handle any pairwise relational schema and a wide variety of error models. We demonstrate its efficiency, as well as the benefit of sharing parameters among relations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
ALGORITHMS FOR NON-NEGATIVE MATRIX FACTORIZATION
Lee, D. D., & Seung, H. S. (2000) · neural information processing systems · Cited by 9,878
(1999) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/b98874 · Cited by 9,482
The Entity Relationship Model — Toward a Unified View of Data
Chen, P. P.-S. (2002) · Software Pioneers · doi:10.1007/978-3-642-59412-0_18 · Cited by 5,751
ALGORITHMS FOR NON-NEGATIVE MATRIX FACTORIZATION
Seung, D., & Lee, L.-W. (2001) · Cited by 4,753
The entity-relationship model—toward a unified view of data
Chen, P. P.-S. (1976) · ACM Transactions on Database Systems · doi:10.1145/320434.320440 · Cited by 4,708
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Cited by
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
“The proposed approach is based on the collective matrix factorization technique [177], where a factor matrix is shared across domains.”
Method(2013) · Cited by 5,726
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252
Collaborative Deep Learning for Recommender Systems
Wang, H., Wang, N., & Yeung, D.-Y. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783273 · Cited by 1,657
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects
Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296
“combinations of the basic building blocks, thus leading to new mathematical models, algorithms and concepts [8], [16], [163], [164].”
BackgroundInfluentialMulti-View Clustering via Joint Nonnegative Matrix Factorization
Liu, J., Wang, C., Gao, J., & Han, J. (2013) · Proceedings of the 2013 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972832.28 · Cited by 900
Learning Structured Embeddings of Knowledge Bases
Bordes, A., Weston, J., Collobert, R., & Bengio, Y. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.7917 · Cited by 829
Shi, Y., Larson, M., & Hanjalic, A. (2014) · ACM Computing Surveys · doi:10.1145/2556270 · Cited by 806
Map-matching for low-sampling-rate GPS trajectories
Lou, Y., Zhang, C., Zheng, Y., Xie, X., Wang, W., & Huang, Y. (2009) · Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1653771.1653820 · Cited by 797
Bordes, A., Glorot, X., Weston, J., & Bengio, Y. (2014) · Machine Learning · doi:10.1007/s10994-013-5363-6 · Cited by 675
Collective Matrix Factorization Hashing for Multimodal Data
Ding, G., Guo, Y., & Zhou, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.267 · Cited by 680
Collaborative location and activity recommendations with GPS history data
Zheng, V. W., Zheng, Y., Xie, X., & Yang, Q. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772795 · Cited by 661
Modeling Relation Paths for Representation Learning of Knowledge Bases
Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., & Liu, S. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1082 · Cited by 657
A Comprehensive Survey of Neighborhood-Based Recommendation Methods
Ning, X., Desrosiers, C., & Karypis, G. (2015) · Recommender Systems Handbook · doi:10.1007/978-1-4899-7637-6_2 · Cited by 641
Aggarwal, C. C. (2015) · Data Mining · doi:10.1007/978-3-319-14142-8_13 · Cited by 606
Heterogeneous Network Embedding via Deep Architectures
Chang, S., Han, W., Tang, J., Qi, G.-J., Aggarwal, C. C., & Huang, T. S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783296 · Cited by 590
Recommendations in location-based social networks: a survey
Bao, J., Zheng, Y., Wilkie, D., & Mokbel, M. (2015) · GeoInformatica · doi:10.1007/s10707-014-0220-8 · Cited by 570
A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., et al. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02443-6 · Cited by 557
A Survey of Multi-View Representation Learning
Li, Y., Yang, M., & Zhang, Z. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2872063 · Cited by 524
Geng, S., Liu, S., Fu, Z., Ge, Y., & Zhang, Y. (2022) · Proceedings of the 16th ACM Conference on Recommender Systems · doi:10.1145/3523227.3546767 · Cited by 556
Label Informed Attributed Network Embedding
Huang, X., Li, J., & Hu, X. (2017) · Proceedings of the Tenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3018661.3018667 · Cited by 487
Learning Heterogeneous Knowledge Base Embeddings for Explainable Recommendation
Ai, Q., Azizi, V., Chen, X., & Zhang, Y. (2018) · Algorithms · doi:10.3390/a11090137 · Cited by 468
Methodologies for Cross-Domain Data Fusion: An Overview
Zheng, Y. (2015) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2015.2465959 · Cited by 454
Artificial intelligence in recommender systems
Zhang, Q., Lu, J., & Jin, Y. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-020-00212-w · Cited by 450
Collaborative Variational Autoencoder for Recommender Systems
Li, X., & She, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098077 · Cited by 442
Cross-Domain Recommendation: An Embedding and Mapping Approach
Man, T., Shen, H., Jin, X., & Cheng, X. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/343 · Cited by 439
Deep Collaborative Filtering via Marginalized Denoising Auto-encoder
Li, S., Kawale, J., & Fu, Y. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806527 · Cited by 422
Multi-behavior Recommendation with Graph Convolutional Networks
Jin, B., Gao, C., He, X., Jin, D., & Li, Y. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401072 · Cited by 415
Translation-based Recommendation
He, R., Kang, W.-C., & McAuley, J. (2017) · Proceedings of the Eleventh ACM Conference on Recommender Systems · doi:10.1145/3109859.3109882 · Cited by 412
Heterogeneous Transfer Learning for Image Classification
Zhu, Y., Chen, Y., Lu, Z., Pan, S., Xue, G.-R., Yu, Y., & Yang, Q. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.8090 · Cited by 378
Transfer Learning in Collaborative Filtering for Sparsity Reduction
Pan, W., Xiang, E., Liu, N., & Yang, Q. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7578 · Cited by 375
CoNet: Collaborative Cross Networks for Cross-Domain Recommendation
Hu, G., Zhang, Y., & Yang, Q. (2018) · Proceedings of the 27th ACM International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271684 · Cited by 374
Recurrent knowledge graph embedding for effective recommendation
Sun, Z., Yang, J., Zhang, J., Bozzon, A., Huang, L.-K., & Xu, C. (2018) · Proceedings of the 12th ACM Conference on Recommender Systems · doi:10.1145/3240323.3240361 · Cited by 367
A survey on heterogeneous transfer learning
Day, O., & Khoshgoftaar, T. M. (2017) · Journal of Big Data · doi:10.1186/s40537-017-0089-0 · Cited by 360
Like like alike: joint friendship and interest propagation in social networks
Yang, S.-H., Long, B., Smola, A., Sadagopan, N., Zheng, Z., & Zha, H. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963481 · Cited by 359
Tensors for Data Mining and Data Fusion: Models, Applications, and Scalable Algorithms
Papalexakis, E. E., Faloutsos, C., & Sidiropoulos, N. D. (2017) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2915921 · Cited by 354
Collaborative Filtering Meets Mobile Recommendation: A User-Centered Approach
Zheng, V., Cao, B., Zheng, Y., Xie, X., & Yang, Q. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7577 · Cited by 321
Clustering with Multiple Graphs
Tang, W., Lu, Z., & Dhillon, I. S. (2009) · 2009 Ninth IEEE International Conference on Data Mining · doi:10.1109/icdm.2009.125 · Cited by 316
Accelerated Attributed Network Embedding
Huang, X., Li, J., & Hu, X. (2017) · Proceedings of the 2017 SIAM International Conference on Data Mining · doi:10.1137/1.9781611974973.71 · Cited by 311
Ask the GRU: Multi-task Learning for Deep Text Recommendations
Bansal, T., Belanger, D., & McCallum, A. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959180 · Cited by 306
Poisson Noise Reduction with Non-local PCA
Salmon, J., Harmany, Z., Deledalle, C.-A., & Willett, R. (2014) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-013-0435-6 · Cited by 294
A Hybrid Collaborative Filtering Model with Deep Structure for Recommender Systems
Dong, X., Yu, L., Wu, Z., Sun, Y., Yuan, L., & Zhang, F. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10747 · Cited by 282
Multi-view clustering via multi-manifold regularized non-negative matrix factorization
Zong, L., Zhang, X., Zhao, L., Yu, H., & Zhao, Q. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.02.003 · Cited by 281
DDTCDR: Deep Dual Transfer Cross Domain Recommendation
Li, P., & Tuzhilin, A. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371793 · Cited by 269
fLDA: matrix factorization through latent dirichlet allocation
Agarwal, D., & Chen, B.-C. (2010) · Proceedings of the third ACM international conference on Web search and data mining · doi:10.1145/1718487.1718499 · Cited by 256
Personalized recommendation via cross-domain triadic factorization
Hu, L., Cao, J., Xu, G., Cao, L., Gu, Z., & Zhu, C. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488441 · Cited by 255
A Survey of Recommender Systems Based on Deep Learning
Mu, R. (2018) · IEEE Access · doi:10.1109/access.2018.2880197 · Cited by 254
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773 · Cited by 254
Towards Bayesian Deep Learning: A Framework and Some Existing Methods
Wang, H., & Yeung, D.-Y. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2606428 · Cited by 253
Large-Scale Cross-Modality Search via Collective Matrix Factorization Hashing
Ding, G., Guo, Y., Zhou, J., & Gao, Y. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2607421 · Cited by 218
(2012) · doi:10.1145/2365952.2365989 · Cited by 170
“While there has been work on collective matrix factorization [13] to take into account attributes of movies and users in addition to ratings for making recommendations, the work does not explore the specific task of inferring user demographics.”
BackgroundLeveraging Uncertainty in Machine Learning Accelerates Biological Discovery and Design
Hie, B., Bryson, B. D., & Berger, B. (2020) · Cell Systems · doi:10.1016/j.cels.2020.09.007 · Cited by 154
“We performed CMF using the compound-kinase Kds as the explicit data matrix and the neural-encoded compound and kinase features as side-information (Singh and Gordon, 2008).”
MethodData fusion in cyber-physical-social systems: State-of-the-art and perspectives
Wang, P., Yang, L. T., Li, J., Chen, J., & Hu, S. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.11.002 · Cited by 127
Palomares, I., Porcel, C., Pizzato, L., Guy, I., & Herrera-Viedma, E. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.12.001 · Cited by 109
Learning to recommend with multiple cascading behaviors
Gao, C., He, X., Gan, D., Chen, X., Feng, F., Li, Y., Chua, T.-S., Yao, L., Song, Y., & Jin, D. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2958808 · Cited by 136
A Survey of Transfer and Multitask Learning in Bioinformatics
Xu, Q., & Yang, Q. (2011) · Journal of Computing Science and Engineering · doi:10.5626/jcse.2011.5.3.257 · Cited by 89
(2015) · Cited by 70
(2014) · Cited by 66
FCMF: Federated collective matrix factorization for heterogeneous collaborative filtering
Yang, E., Huang, Y., Liang, F., Pan, W., & Ming, Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106946 · Cited by 58
Horizontal Federated Recommender System: A Survey
Wang, L., Zhou, H., Bao, Y., Yan, X., Shen, G., & Kong, X. (2024) · ACM Computing Surveys · doi:10.1145/3656165 · Cited by 37
Coupled matrix factorization with sparse factors to identify potential biomarkers in metabolomics
Acar, E., Gurdeniz, G., Rasmussen, M. A., Rago, D., Dragsted, L. O., & Bro, R. (2012) · International Journal of Knowledge Discovery in Bioinformatics · doi:10.4018/jkdb.2012070102 · Cited by 35
Metadata
- Authors
- Singh, A. P., & Gordon, G. J.
- Venue
- Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
- Publisher
- ACM
- Published
- 2008-08-24
- Pages
- 650-658
- OpenAlex
- W2117420919
- Cited by
- 1,204
- References
- 37
- FWCI
- 18.10
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.