Cited by 49Multimodal Machine Learning ApplicationsDomain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Decoupling Common and Unique Representations for Multimodal Self-supervised Learning

Open access
Wang, Yi, Albrecht, Conrad M., Braham, Nassim Ait Ali, Liu, Chenying, Xiong, Zhitong, Zhu, Xiao Xiang·2025·Lecture Notes in Computer Science

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/978-3-031-73397-0_17

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • For segmentation tasks, Prithvi-EO-2.0-600M-TL and Prithvi-EO-2.0-600M show the highest performance, with a noticeable margin over the next best models, DeCUR and DINO ResNets.

    “For segmentation, Prithvi-EO-2.0-600M-TL and Prithvi-EO-2.0-600M show the highest performance, with a noticeable margin over the next best models, DeCUR [7] and DINO [12] ResNets.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 44 references couldn’t be matched to a known paper.

Research works printed but not linked: 22

  1. Bardes, A., Ponce, J., LeCun, Y.: Vicreg: Variance-invariance-covariance regular- ization for self-supervised learning. arXiv preprint arXiv:2105.04906 (2021) 3 · arXiv
  2. Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., Joulin, A.: Unsupervised learning of visual features by contrasting cluster assignments. Advances in neural information processing systems 33, 9912-9924 (2020) 3
  3. Chen, T., Kornblith, S., Norouzi, M., Hinton, G.: A simple framework for con- trastive learning of visual representations. In: International conference on machine learning. pp. 1597-1607. PMLR (2020) 3
  4. Feng, Z., Song, L., Yang, S., Zhang, X., Jiao, L.: Cross-modal contrastive learn- ing for remote sensing image classification. IEEE Transactions on Geoscience and Remote Sensing (2023) 23
  5. Fuller, A., Millard, K., Green, J.: Croma: Remote sensing representations with contrastive radar-optical masked autoencoders. Advances in Neural Information Processing Systems 36 (2024) 3, 8, 9
  6. Hong, D., Zhang, B., Li, X., Li, Y., Li, C., Yao, J., Yokoya, N., Li, H., Jia, X., Plaza, A., et al.: Spectralgpt: Spectral foundation model. arXiv preprint arXiv:2311.07113 (2023) 8, 9 · arXiv
  7. Jha, A., Bose, S., Banerjee, B.: Gaf-net: improving the performance of remote sens- ing image fusion using novel global self and cross attention learning. In: Proceed- ings of the IEEE/CVF Winter Conference on Applications of Computer Vision. pp. 6354-6363 (2023) 23
  8. Liang, P.P., Deng, Z., Ma, M.Q., Zou, J.Y., Morency, L.P., Salakhutdinov, R.: Factorized contrastive learning: Going beyond multi-view redundancy. Advances in Neural Information Processing Systems 36 (2024) 4
  9. Loshchilov, I., Hutter, F.: Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983 (2016) 21 · arXiv
  10. Van der Maaten, L., Hinton, G.: Visualizing data using t-sne. Journal of machine learning research 9(11) (2008) 2
  11. Oord, A.v.d., Li, Y., Vinyals, O.: Representation learning with contrastive predic- tive coding. arXiv preprint arXiv:1807.03748 (2018) 3 · arXiv
  12. Sundararajan, M., Taly, A., Yan, Q.: Axiomatic attribution for deep networks. In: International conference on machine learning. pp. 3319-3328. PMLR (2017) 13
  13. Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.A., Bottou, L.: Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of machine learning research 11(12) (2010) 3
  14. Wang, L., Luc, P., Recasens, A., Alayrac, J.B., Oord, A.v.d.: Multi- modal self-supervised learning of general audio representations. arXiv preprint arXiv:2104.12807 (2021) 1 · arXiv
  15. Wang, Y., Braham, N.A.A., Xiong, Z., Liu, C., Albrecht, C.M., Zhu, X.X.: SSL4EO-S12: A large-scale multi-modal, multi-temporal dataset for self-supervised learning in earth observation. arXiv preprint arXiv:2211.07044 (2022) 7, 8, 9, 20 · arXiv
  16. Wang, Y., Hernández, H.H., Albrecht, C.M., Zhu, X.X.: Feature guided masked autoencoder for self-supervised learning in remote sensing. arXiv preprint arXiv:2310.18653 (2023) 8, 9 · arXiv
  17. Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: Cbam: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV). pp. 3-19 (2018) 23
  18. Xia, Z., Pan, X., Song, S., Li, L.E., Huang, G.: Dat++: Spatially dynamic vision transformer with deformable attention. arXiv preprint arXiv:2309.01430 (2023) 3, 6, 21 · arXiv
  19. Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J.M., Luo, P.: Segformer: Simple and efficient design for semantic segmentation with transformers. Advances in Neural Information Processing Systems 34, 12077-12090 (2021) 7, 10, 22
  20. Xiong, Z., Wang, Y., Zhang, F., Stewart, A.J., Hanna, J., Borth, D., Papoutsis, I., Saux, B.L., Camps-Valls, G., Zhu, X.X.: Neural plasticity-inspired foundation model for observing the earth crossing modalities. arXiv preprint arXiv:2403.15356 (2024) 1 · arXiv
  21. You, Y., Gitman, I., Ginsburg, B.: Large batch training of convolutional networks. arXiv preprint arXiv:1708.03888 (2017) 21 · arXiv
  22. Zbontar, J., Jing, L., Misra, I., LeCun, Y., Deny, S.: Barlow twins: Self-supervised learning via redundancy reduction. In: International Conference on Machine Learn- ing. pp. 12310-12320. PMLR (2021) 2, 3, 4, 7, 12

Cited by

Sorted by citations

Authors
Wang, Y., Albrecht, C. M., Braham, N. A. A., Liu, C., Xiong, Z., & Zhu, X. X.
Affiliations
  • Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE)
  • Technical University of Munich (DE)
  • Munich Center for Machine Learning (DE)
Corresponding author
Wang, Yi
Venue
Lecture Notes in Computer Science
Published
2024-11-03
Pages
286-303
ISSN
  • 0302-9743 (ISSN-L)
  • 1611-3349
OpenAlex
W4403998581
Cited by
49
References
44
Citations by year
2026: 19 · 2025: 27 · 2024: 3
FWCI
10.13
Type
conference paper
Language
en
Open access
Locations
  • Lecture notes in computer science (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • elib (German Aerospace Center) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • European Commission (101082130, 101130544, HORIZON2020)
  • Bundesministerium für Bildung und Forschung (01DD20001)
  • Helmholtz Artificial Intelligence Cooperation Unit (ZT-I-PF-5-01)
  • Bundesministerium für Umwelt, Naturschutz, nukleare Sicherheit und Verbraucherschutz (67KI32002B;)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
RGB-D fusion

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review