Allal, Loubna Ben

StarCoder: may the source be with you!

Li, R., Allal, L. B., Zi, Y., Muennighoff, N., Kocetkov, D., Mou, C., Marone, M., Akiki, C., Li, J., Chim, J., et al. (2023) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 261

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset

Laurençon, H., Saulnier, L., Wang, T., Akiki, C., del Moral, A. V., Scao, T. L., Von Werra, L., Mou, C., Ponferrada, E. G., Nguyen, H., et al. (2023) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 93

StarCoder 2 and The Stack v2: The Next Generation

Lozhkov, A., Li, R., Allal, L. B., Cassano, F., Lamy-Poirier, J., Tazi, N., Tang, A., Pykhtar, D., Liu, J., Wei, Y., et al. (2024) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 74

SantaCoder: don't reach for the stars!

Allal, L. B., Li, R., Kocetkov, D., Mou, C., Akiki, C., Ferrandis, C. M., Muennighoff, N., Mishra, M., Gu, A., Dey, M., et al. (2023) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 61

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Penedo, G., Kydlíček, H., allal, L. B., Lozhkov, A., Mitchell, M., Raffel, C., Von Werra, L., & Wolf, T. (2024) · arXiv

Topic ModelingComputational and Text Analysis Methods

Cited by 53

The Stack: 3 TB of permissively licensed source code

Kocetkov, D., Li, R., Allal, L. B., Li, J., Mou, C., Ferrandis, C. M., Jernite, Y., Mitchell, M., Hughes, S., Wolf, T., et al. (2022) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 42

SmolLM2: When Smol Goes Big - Data-Centric Training of a Small Language Model

Allal, L. B., Lozhkov, A., Bakouch, E., Blázquez, G. M., Penedo, G., Tunstall, L., Marafioti, A., Kydlíček, H., Lajarín, A. P., Srivastav, V., et al. (2025) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 13

SmolVLM: Redefining small and efficient multimodal models

Marafioti, A., Zohar, O., Farré, M., Noyan, M., Bakouch, E., Cuenca, P., Zakka, C., Allal, L. B., Lozhkov, A., Tazi, N., et al. (2025) · arXiv

Multimodal Machine Learning ApplicationsAdvanced Neural Network Applications

Cited by 11

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Hägele, A., Bakouch, E., Kosson, A., Allal, L. B., Von Werra, L., & Jaggi, M. (2024) · arXiv

Stochastic Gradient Optimization TechniquesMachine Learning and Data Classification

Cited by 2