Morcos, Ari

Beyond neural scaling laws: beating power law scaling via data pruning

Sorscher, B., Geirhos, R., Shekhar, S., Ganguli, S., & Morcos, A. S. (2022) · arXiv

Advanced Neural Network ApplicationsMachine Learning and Data Classification

Cited by 142

Beyond Neural Scaling Laws: Beating Power Law Scaling Via Data Pruning

Sorscher, B., Geirhos, R., Shekhar, S., Ganguli, S., & Morcos, A. (2022) · Advances in Neural Information Processing Systems 35

Advanced Neural Network ApplicationsMachine Learning and Data Classification

Cited by 142

D4: Improving LLM Pretraining via Document De-Duplication and Diversification

Tirumala, K., Simig, D., Aghajanyan, A., & Morcos, A. (2023) · Advances in Neural Information Processing Systems 36

Topic ModelingNatural Language Processing Techniques

Cited by 28