DataComp: In search of the next generation of multimodal datasets

Gadre, Samir Yitzhak, Ilharco, Gabriel, Fang, Alex, Hayase, Jonathan, Smyrnis, Georgios, Nguyen, Thao, Marten, Ryan, Wortsman, Mitchell, Ghosh, Dhruba, Zhang, Jieyu, Orgad, Eyal, Entezari, Rahim, Daras, Giannis, Pratt, Sarah, Ramanujan, Vivek, Bitton, Yonatan, Marathe, Kalyani, Mussmann, Stephen, Vencu, Richard, Cherti, Mehdi, Krishna, Ranjay, Koh, Pang Wei, Saukh, Olga, Ratner, Alexander, Song, Shuran, Hajishirzi, Hannaneh, Farhadi, Ali, Beaumont, Romain, Oh, Sewoong, Dimakis, Alex, Jitsev, Jenia, Carmon, Yair, Shankar, Vaishaal, Schmidt, Ludwig·2023·Advances in Neural Information Processing Systems 36
DOI 10.52202/075280-1179

Cited by (125)

Items 101–125 of 125

  1. Task Specification and Generalization in Multi-Task Reinforcement Learning
    Théo Cachet · 2025 · theses.fr (ABES)
  2. Multi-modal Identity Extraction
    Ryan Webster, Teddy Furon · 2025 · IEEE/CVF International Conference on Computer Vision (ICCV)
  3. Evaluating Text-to-Image and Text-to-Video Synthesis with a Conditional Fréchet Distance
    Jaywon Koo, Jefferson Hernandez, Moayed Haji-Ali, Ziyan Yang, Vicente Ordóñez · 2026 · IEEE Winter Conference on Applications of Computer Vision
  4. WinTok: A Win-Win Hybrid Tokenizer via Decomposing Visual Understanding and Generation with Transferable Tokens
    Yiwei Guo, Shaobin Zhuang, Zhipeng Huang, Canmiao Fu, Chen Li, Jing Lyu, Yali Wang · 2026 · Lecture notes in computer science
  5. Augmenting medical vision-language pretraining via domain-aware retrieval-augmented caption enrichment
    Xiaoyang Wei, Camille Kurtz, Florence Cloppet · 2026 · International Conference on Multimedia Retrieval
  6. ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP
    Sicheng Zhang, Muzammal Naseer, Binzhu Xie, Naufal Suryanto, Shi Qiu, Jamal Bentahar, Naveed Akhtar, M Kabiruzzaman Shah · 2026 · Lecture notes in computer science
  7. Adaptive Triple-Positive Contrastive Learning for Robust Vision-Language Representation
    贾世常, B Liu · 2026 · Lecture notes in computer science
  8. VisSemRender: Scaling Multi-Modal Contexts via Visual Token Compression and Semantic Color Encoding
    Pi Fang, Wenjun Huang, Ziyu Hu, Yong Wu, Yuechen Yin, Nan Zhan, Jialiang Ren, Zhichen He, Rongke Chen · 2026 · Communications in computer and information science
  9. AI Entanglement: Accounting for dependencies in general-purpose AI policy, regulation, and practice
    Rachel S. Hong, Jevan Alexander Hutson, Sarah Huiyi Cen, Jamie Morgenstern, Tadayoshi Kohno · 2026 · SSRN Electronic Journal
  10. A Novel Multimodal Hierarchical Large Language Model for Enhancing Image and Text Sequence Recommendations in Item and User Modeling
    Wen-Long Dong, Tai-Chiu Hsung, Sik‐Ho Tsang, Yulin Zhu, Alan Wai-lun Lo · 2026 · Big Data and Cognitive Computing
  11. What Matters for Grocery Product Retrieval with Open Source Vision Language Models
    Emmanuel G. Maminta, Rowel Atienza · 2026 · Lecture notes in computer science
  12. From Pixels to Purchase: Building and Evaluating a Taxonomy-Decoupled Visual Search Engine for Home Goods E-Commerce
    Cheng Lyu, Jingyue Zhang, Ryan Maunu, Mengwei Li, Vinny DeGenova, Yuanli Pei · 2026 · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)
  13. REMIX: Adaptive Open-Domain Signal Mixing for Efficient Sensing Data Augmentation
    Denizhan Kara, Tomoyoshi Kimura, Can Hu, Jinyang Li, Yizhuo Chen, Yigong Hu, Hongjue Zhao, Shengzhong Liu, Tarek Abdelzaher · 2026 · International Conference on Computer Communications and Networks (ICCCN)
  14. MedCure: Medical Data Curation for Efficient Vision–Language Pretraining
    Chong Wang, Fengbei Liu, Yuyuan Liu, Yuanhong Chen, Yu Tian, Leyuan Fang · 2026 · IEEE Transactions on Image Processing
  15. TEngineDB-V: An OLAP-Native Vector Search System for Large- k Workloads at Tencent
    Xufei Wu, Pengcheng Zhang, Yitong Song, Xiaobo Zhang, Anqi Liang, Kai Wang, Jijun Du, Yidi Xiong, Guangxu Cheng, Zhe Chen et al. · 2026 · Proceedings of the VLDB Endowment
  16. Architectural Vulnerability Mapping and Ethical Risk Taxonomy in Vision‐Language Models
    Çiğdem Bakır, Ayberk Gezer · 2026 · Journal of Software Evolution and Process
  17. Semantic alignment and multimodal fusion in image-text learning: A coupling-aware survey of methods, challenges, and future directions
    Meng Ran, Yang Wang · 2026 · Array
  18. Aggregating Cross-Domain Knowledge via Learnable Tokens for Multi-teacher Distillation
    Wu Ran, Weijia Zhang, Shuyang Pang, Jingsheng Liu, Xiaohui Zhang, Yichao Yan, Chao Ma · 2026 · Lecture notes in computer science
  19. Perturb and Recover: Fine-Tuning for Effective Backdoor Removal from CLIP
    Naman Deep Singh, Francesco Croce, Matthias Hein · 2026
  20. MART: Mechanism-Disentanglement Anchor-Routed Training for Learning with Open-World Noisy Data
    Changhui Hu, Bhalaji Nagarajan, Ricardo Marques, Petia I. Radeva · 2026
  21. Reasoning, perception, and control with vision language models: A survey of multimodal learning for autonomous vehicles
    Wajahat Akbar, Shuguang Li, Altaf Hussain, Ruzat Ullah, Nazar Waheed, Fahad Algarni, Insaf Ullah, Weiwei Jiang · 2026 · Internet of Things
  22. Training Sample Diagnosis and Type-Specific Repair Based on CLIP Class Support
    Peng Xiao, Hongyu Zou, Bo Wu, Fengyu Yang, Wei Zheng, Xinying Luo · 2026 · SSRN Electronic Journal
  23. OT-Curation: Sub-Trajectory Quality Estimation via State-Action Optimal Transport
    Junjie Xu, Xinyu Zhang · 2026 · International Joint Conference on Neural Networks (IJCNN)
  24. RCDIB: Robust CLIP Distillation via Information Bottleneck
    Zhikui Chen, Yilong Lin, Yuzhe Li, Xingheng Wan, Zhengyang Tang, Meng Liu · 2026 · International Joint Conference on Neural Networks (IJCNN)
  25. Does Spatial Cognition Emerge in Frontier Models?
    Ramakrishnan, Santhosh Kumar, Wijmans, Erik, Kraehenbuehl, Philipp, Koltun, Vladlen · 2024 · arXiv