Wortsman, Mitchell

LAION-5B: An open large-scale dataset for training next generation image-text models

Schuhmann, C., Beaumont, R., Vencu, R., Gordon, C., Wightman, R., Cherti, M., Coombes, T., Katta, A., Mullis, C., Wortsman, M., et al. (2022) · arXiv

Multimodal Machine Learning ApplicationsGenerative Adversarial Networks and Image Synthesis

Cited by 1,022

Reproducible Scaling Laws for Contrastive Language-Image Learning

Cherti, M., Beaumont, R., Wightman, R., Wortsman, M., Ilharco, G., Gordon, C., Schuhmann, C., Schmidt, L., & Jitsev, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Multimodal Machine Learning ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 673

Robust fine-tuning of zero-shot models

Wortsman, M., Ilharco, G., Kim, J. W., Li, M., Kornblith, S., Roelofs, R., Lopes, R. G., Hajishirzi, H., Farhadi, A., Namkoong, H., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 428

LAION-5B: An Open Large-Scale Dataset for Training Next Generation Image-Text Models

Schuhmann, C., Beaumont, R., Vencu, R., Gordon, C., Wightman, R., Cherti, M., Coombes, T., Katta, A., Mullis, C., Wortsman, M., et al. (2022) · Advances in Neural Information Processing Systems 35

Multimodal Machine Learning ApplicationsTopic Modeling

Cited by 325

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

Wortsman, M., Ilharco, G., Gadre, S. Y., Roelofs, R., Gontijo-Lopes, R., Morcos, A. S., Namkoong, H., Farhadi, A., Carmon, Y., Kornblith, S., et al. (2022) · arXiv

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 307

Supermasks in Superposition

Wortsman, M., Ramanujan, V., Liu, R., Kembhavi, A., Rastegari, M., Yosinski, J., & Farhadi, A. (2020) · arXiv

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 144

DataComp: In search of the next generation of multimodal datasets

Gadre, S. Y., Ilharco, G., Fang, A., Hayase, J., Smyrnis, G., Nguyen, T., Marten, R., Wortsman, M., Ghosh, D., Zhang, J., et al. (2023) · Advances in Neural Information Processing Systems 36

Multimodal Machine Learning ApplicationsImage Retrieval and Classification Techniques

Cited by 120

OLMo: Accelerating the Science of Language Models

Groeneveld, D., Beltagy, I., Walsh, E., Bhagia, A., Kinney, R., Tafjord, O., Jha, A., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 70

Editing Models with Task Arithmetic

Ilharco, G., Ribeiro, M. T., Wortsman, M., Gururangan, S., Schmidt, L., Hajishirzi, H., & Farhadi, A. (2022) · arXiv

Domain Adaptation and Few-Shot LearningTopic Modeling

Cited by 66

Detecting clinical medication errors with AI enabled wearable cameras

Chan, J., Nsumba, S., Wortsman, M., Dave, A., Schmidt, L., Gollakota, S., & Michaelsen, K. (2024) · npj Digital Medicine

Patient Safety and Medication ErrorsArtificial Intelligence in Healthcare and Education

Cited by 18

OLMo: Accelerating the Science of Language Models

Groeneveld, D., Beltagy, I., Walsh, P., Bhagia, A., Kinney, R., Tafjord, O., Jha, A. H., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 10

Exploring The Landscape of Distributional Robustness for Question Answering Models

Awadalla, A., Wortsman, M., Ilharco, G., Min, S., Magnusson, I., Hajishirzi, H., & Schmidt, L. (2022) · arXiv

Topic ModelingAdversarial Robustness in Machine Learning

Cited by 6

Small-scale proxies for large-scale Transformer training instabilities

Wortsman, M., Liu, P. J., Xiao, L., Everett, K., Alemi, A., Adlam, B., Co-Reyes, J. D., Gur, I., Kumar, A., Novak, R., et al. (2023) · arXiv

Stochastic Gradient Optimization TechniquesTopic Modeling

Cited by 5

Language models scale reliably with over-training and on downstream tasks

Gadre, S. Y., Smyrnis, G., Shankar, V., Gururangan, S., Wortsman, M., Shao, R., Mercat, J., Fang, A., Li, J., Keh, S., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 5