The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Deep Partial Multi-View Learning
Open accessAbstract
Although multi-view learning has made significant progress over the past few decades, it is still challenging due to the difficulty in modeling complex correlations among different views, especially under the context of view missing. To address the challenge, we propose a novel framework termed Cross Partial Multi-View Networks (CPM-Nets), which aims to fully and flexibly take advantage of multiple partial views. We first provide a formal definition of completeness and versatility for multi-view representation and then theoretically prove the versatility of the learned latent representations. For completeness, the task of learning latent multi-view representation is specifically translated to a degradation process by mimicking data transmission, such that the optimal tradeoff between consistency and complementarity across different views can be implicitly achieved. Equipped with adversarial strategy, our model stably imputes missing views, encoding information from all views for each sample to be encoded into latent representation to further enhance the completeness. Furthermore, a nonparametric classification loss is introduced to produce structured representations and prevent overfitting, which endows the algorithm with promising generalization under view-missing cases. Extensive experimental results validate the effectiveness of our algorithm over existing state of the arts for classification, representation learning and data imputation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
(2010) · Cited by 7,034
A Singular Value Thresholding Algorithm for Matrix Completion
Cai, J.-F., Candès, E. J., & Shen, Z. (2010) · SIAM Journal on Optimization · doi:10.1137/080738970 · Cited by 5,809
RELATIONS BETWEEN TWO SETS OF VARIATES
HOTELLING, H. (1936) · Biometrika · doi:10.1093/biomet/28.3-4.321 · Cited by 5,263
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
Distributed Representations of Sentences and Documents
Le, Q. V., & Mikolov, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.4053 · Cited by 4,934
Prototypical Networks for Few-shot Learning
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 4,755
Missing Value Estimation Methods for DNA Microarrays
Troyanskaya, O., Cantor, M., Sherlock, G., Brown, P., Hastie, T., Tibshirani, R., Botstein, D., & Altman, R. B. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.6.520 · Cited by 4,230
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., & Saul, L. K. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577078 · Cited by 4,044
Caltech-UCSD Birds-200-2011 Dataset
Wah, C. (2024) · CaltechAUTHORS (California Institute of Technology) · doi:10.57702/i9oeewf6 · Cited by 3,525
Generative Adversarial Networks
(2022) · The Science of Deep Learning · doi:10.1017/9781108891530.013 · Cited by 2,402
Deep Canonical Correlation Analysis
Andrew, G., Arora, R., Bilmes, J., & Livescu, K. (2013) · International Conference on Machine Learning · Cited by 2,401
Information-theoretic metric learning
Davis, J. V., Kulis, B., Jain, P., Sra, S., & Dhillon, I. S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273523 · Cited by 2,006
Autoencoding beyond pixels using a learned similarity metric
Larsen, A., Sønderby, S. K., Larochelle, H., & Winther, O. (2016) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 1,990
Relations Between Two Sets of Variates
Hotelling, H. (1936) · Biometrika · doi:10.2307/2333955 · Cited by 1,645
Regularization methods for learning incomplete matrices
Mazumder, R., Hastie, T. J., & Tibshirani, R. J. (2009) · Journal of Machine Learning Research · doi:10.48550/arxiv.0906.2034 · Cited by 1,640
Image representation using 2D Gabor wavelets
Lee, T. S. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.541406 · Cited by 1,629
Attribute-Based Classification for Zero-Shot Visual Object Categorization
Lampert, C. H., Nickisch, H., & Harmeling, S. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.140 · Cited by 1,627
Co-regularized Multi-view Spectral Clustering
Kumar, A., Rai, P., & Daumé, H. (2011) · neural information processing systems · Cited by 1,467
A new approach to cross-modal multimedia retrieval
Rasiwasia, N., Costa Pereira, J., Coviello, E., Doyle, G., Lanckriet, G. R. G., Levy, R., & Vasconcelos, N. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1873987 · Cited by 1,334
A Survey on Multi-view Learning
Xu, C., Tao, D., & Xu, C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1304.5634 · Cited by 942
A Co-training Approach for Multi-view Spectral Clustering
Kumar, A., & Daumé, H. (2011) · International Conference on Machine Learning · Cited by 933
On Deep Multi-View Representation Learning
Wang, W., Livescu, K., & Bilmes, J. (2015) · Cited by 871
A Bayesian missing value estimation method for gene expression profile data
Oba, S., Sato, M.-A., Takemasa, I., Monden, M., Matsubara, K.-I., & Ishii, S. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg287 · Cited by 753
Spectral Regularization Algorithms for Learning Large Incomplete Matrices
MazumderRahul, HastieTrevor, & TibshiraniRobert (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859931 · Cited by 671
Latent Multi-view Subspace Clustering
Zhang, C., Hu, Q., Fu, H., Zhu, P., & Cao, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.461 · Cited by 611
Self-citationLow-Rank Tensor Constrained Multiview Subspace Clustering
Zhang, C., Fu, H., Liu, S., Liu, G., & Cao, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.185 · Cited by 566
Self-citationA kernel method for canonical correlation analysis
Akaho, S. (2006) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0609071 · Cited by 440
Li, S.-Y., Jiang, Y., & Zhou, Z.-H. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8973 · Cited by 431
Late Fusion Incomplete Multi-View Clustering
Liu, X., Zhu, X., Li, M., Wang, L., Tang, C., Yin, J., Shen, D., Wang, H., & Gao, W. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2879108 · Cited by 363
LSimpute: accurate estimation of missing values in microarray data with least squares methods
Bo, T. H. (2004) · Nucleic Acids Research · doi:10.1093/nar/gnh026 · Cited by 348
Supervised autoencoders: Improving generalization performance with unsupervised regularizers
Le, L., Patterson, A., & White, M. (2018) · neural information processing systems · Cited by 299
Missing Modalities Imputation via Cascaded Residual Autoencoder
Tran, L., Liu, X., Zhou, J., & Jin, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.528 · Cited by 256
Self-citationMulti-View Learning of Word Embeddings via CCA
Dhillon, P. S., Foster, D. P., & Ungar, L. (2011) · ScholarlyCommons (University of Pennsylvania) · Cited by 241
Learning Aligned Cross-Modal Representations from Weakly Aligned Data
Castrejon, L., Aytar, Y., Vondrick, C., Pirsiavash, H., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.321 · Cited by 188 · cited 2×
“The cross-modal convolutional neural networks are regularized to obtain a shared representation which is agnostic to the modality for cross-modal scene images [31].”
MethodVIGAN: Missing view imputation with generative adversarial networks
Shang, C., Palmer, A., Sun, J., Chen, K., Lü, J., & Bi, J. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8257992 · Cited by 187
Deep Adversarial Learning for Multi-Modality Missing Data Completion
Cai, L., Wang, Z., Gao, H., Shen, D., & Ji, S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219963 · Cited by 180
Flexible Multi-View Dimensionality Co-Reduction
Zhang, C., Fu, H., Hu, Q., Zhu, P., & Cao, X. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2627806 · Cited by 147
Self-citationDNA microarray data imputation and significance analysis of differential expression
Jörnsten, R., Wang, H.-Y., Welsh, W. J., & Ouyang, M. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti638 · Cited by 121
Split Multiplicative Multi-View Subspace Clustering
Yang, Z., Xu, Q., Zhang, W., Cao, X., & Huang, Q. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2913096 · Cited by 118
An Easy-to-hard Learning Paradigm for Multiple Classes and Multiple Labels
Liu, W., Tsang, I. W.-H., & Müller, K. (2017) · MPG.PuRe (Max Planck Society) · Cited by 100
Unsupervised Cross-Modal Alignment of Speech and Text Embedding SpacesPreprint
Chung, Y.-A., Weng, W., Tong, S., & Glass, J. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07467 · Cited by 95
Deep Variational Canonical Correlation Analysis
Wang, W., Yan, X., Lee, H., & Livescu, K. (2016) · arXiv · doi:10.48550/arxiv.1610.03454 · Cited by 89 · cited 1×
“The representative multi-view representation learning methods are CCA based, including kernelized CCA [10], deep neural network based CCA [11], [26], DVCCA [27] and semi-paired and semi-supervised generalized correlation analysis (S 2 GCA) [28].”
MethodA unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data
Chen, X., Chen, S., Xue, H., & Zhou, X. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.11.008 · Cited by 69
Multi-source learning for joint analysis of incomplete multi-modality neuroimaging data
Yuan, L., Wang, Y., Thompson, P. M., Narayan, V. A., & Ye, J. (2012) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2339530.2339710 · Cited by 61
Multi-class heterogeneous domain adaptation
Zhou, J. T., Tsang, I. W.-H., Pan, S. J., & Tan, M. (2019) · DR-NTU (Nanyang Technological University) · Cited by 57
Self-citationA deep learning framework for hybrid heterogeneous transfer learning
Zhou, J. T., Pan, S. J., & Tsang, I. W. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2019.06.001 · Cited by 53
Self-citationCross-View Policy Learning for Street Navigation
Li, A., Hu, H., Mirowski, P., & Farajtabar, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00819 · Cited by 50
Hierarchical Multimodal Metric Learning for Multimodal Classification
Zhang, H., Patel, V. M., & Chellappa, R. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.312 · Cited by 47
Xue, Z., Du, J., Du, D., Ren, W., & Lyu, S. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/559 · Cited by 38
Semi-Supervised Multi-Modal Learning with Incomplete Modalities
Yang, Y., Zhan, D., Sheng, X.-R., & Jiang, Y. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/416 · Cited by 33
Multi-View Subspace Clustering With Block Diagonal Representation
Guo, J., Yin, W., Sun, Y., et al. (2019) · IEEE Access · doi:10.1109/access.2019.2923614 · Cited by 23
Heterogeneous multi-metric learning for multi-sensor fusion
Zhang, H., Huang, T. S., Nasrabadi, N. M., & Yan, S. (2011) · Cited by 20
Liu, M., Zhang, J., Yap, P., & Shen, D. G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46720-7_36 · Cited by 17
Cited by
Robust Multi-View Clustering With Incomplete Information
Yang, M., Li, Y., Hu, P., Bai, J., Lv, J., & Peng, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3155499 · Cited by 332
Liu, R., Zuo, H., Lian, Z., Schuller, B. W., & Li, H. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3378570 · Cited by 96
(2025) · doi:10.1109/jbhi.2023.3346205 · Cited by 47
Metadata
- Authors
- Zhang, C., Cui, Y., Han, Z., Zhou, J. T., Fu, H., & Hu, Q.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2020
- Volume
- 44
- Issue
- 5
- Pages
- 1-1
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3098802639
- Cited by
- 270
- References
- 55
- FWCI
- 12.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.