PreprintCited by 64Topic ModelingAdvanced Neural Network ApplicationsNatural Language Processing Techniques

The DOI matches its DataCite record; 4 of the 4 references it cites were found in a registry or an index.

Ministral 3

Open access
Liu, Alexander H., Khandelwal, Kartik, Subramanian, Sandeep, Jouault, Victor, Rastogi, Abhinav, Sadé, Adrien, Jeffares, Alan, Jiang, Albert, Cahill, Alexandre, Gavaudan, Alexandre, Sablayrolles, Alexandre, Héliou, Amélie, You, Amos, Ehrenberg, Andy, Lo, Andy, Eliseev, Anton, Calvi, Antonia, Sooriyarachchi, Avinash, Bout, Baptiste, Rozière, Baptiste, De Monicault, Baudouin, Lanfranchi, Clémence, Barreau, Corentin, Courtot, Cyprien, Grattarola, Daniele, Dabert, Darius, Casas, Diego de las, Chane-Sane, Elliot, Ahmed, Faruk, Berrada, Gabrielle, Ecrepont, Gaëtan, Guinet, Gauthier, Novikov, Georgii, Kunsch, Guillaume, Lample, Guillaume, Martin, Guillaume, Gupta, Gunshi, Ludziejewski, Jan, Rute, Jason, Studnia, Joachim, Amar, Jonas, Delas, Joséphine, Roberts, Josselin Somerville, Yadav, Karmesh, Chandu, Khyathi, Jain, Kush, Aitchison, Laurence, Fainsin, Laurent, Blier, Léonard, Zhao, Lingxiao, Martin, Louis, Saulnier, Lucile, Gao, Luyu, Buyl, Maarten, Jennings, Margaret, Pellat, Marie, Prins, Mark, Poirée, Mathieu, Guillaumin, Mathilde, Dinot, Matthieu, Futeral, Matthieu, Darrin, Maxime, Augustin, Maximilian, Chiquier, Mia, Schimpf, Michel, Grinsztajn, Nathan, Gupta, Neha, Raghuraman, Nikhil, Bousquet, Olivier, Duchenne, Olivier, Wang, Patricia, von Platen, Patrick, Jacob, Paul, Wambergue, Paul, Kurylowicz, Paula, Muddireddy, Pavankumar Reddy, Chagniot, Philomène, Stock, Pierre, Agrawal, Pravesh, Torroba, Quentin, Sauvestre, Romain, Soletskyi, Roman, Menneer, Rupert, Vaze, Sagar, Barry, Samuel, Gandhi, Sanchit, Waghjale, Siddhant, Gandhi, Siddharth, Ghosh, Soham, Mishra, Srijan, Aithal, Sumukh, Antoniak, Szymon, Scao, Teven Le, Cachet, Théo, Sorg, Theo Simon, Lavril, Thibaut, Saada, Thiziri Nait, Chabal, Thomas, Foubert, Thomas, Robert, Thomas, Wang, Thomas, Lawson, Tim, Bewley, Tom, Bewley, Tom, Edwards, Tom, Jamil, Umar, Tomasini, Umberto, Nemychnikova, Valeriia, Phung, Van, Maladière, Vincent, Richard, Virgile, Bouaziz, Wassim, Li, Wen-Ding, Marshall, William, Li, Xinghui, Yang, Xinyu, Ouahidi, Yassine El, Wang, Yihan, Tang, Yunhao, Ramzi, Zaccharie·2026·arXiv

Abstract

We introduce the Ministral 3 series, a family of parameter-efficient dense language models designed for compute and memory constrained applications, available in three model sizes: 3B, 8B, and 14B parameters. For each model size, we release three variants: a pretrained base model for general-purpose use, an instruction finetuned, and a reasoning model for complex problem-solving. In addition, we present our recipe to derive the Ministral 3 models through Cascade Distillation, an iterative pruning and continued training with distillation technique. Each model comes with image understanding capabilities, all under the Apache 2.0 license.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2601.08584

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • RoFormer: Enhanced transformer with rotary position embedding

    Su, J., Ahmed, M., Lu, Y., Pan, S., Bo, W., & Liu, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2023.127063 · Cited by 1,957

  • Gemma 3 Technical Report

    Gemma Team, Kamath, A., Ferret, J., Pathak, S., Vieillard, N., Merhej, R., Perrin, S., Matejovicova, T., Ramé, A., Rivière, M., et al. (2025) · arXiv · doi:10.48550/arxiv.2503.19786 · Cited by 1,156

  • The Llama 3 Herd of Models

    Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.21783 · Cited by 505 · cited 1×

    “Unlike popular pretrained models such as Qwen3 [Yang et al., 2025] or Llama3 [Dubey et al., 2024] that are trained on 36 trillion and 15 trillion tokens respectively, we are able to produce competitive models trained for between 1 and 3 trillion tokens by leveraging Mistral Small 3.1, a strong…”
    Influential
  • AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models

    Zhong, W., Cui, R., Guo, Y., Liang, Y., Lu, S., Wang, Y., Saied, A., Chen, W., & Duan, N. (2023) · arXiv · doi:10.48550/arxiv.2304.06364 · Cited by 211 · cited 1×

    “We evaluated on the following benchmarks: General: MMLU [Hendrycks et al., 2020], MMLU-Redux [Perez et al., 2024], ARC-Challenge [Clark et al., 2018], RACE High [Lai et al., 2017], TriviaQA [Joshi et al., 2017], NaturalQS [Kwiatkowski et al., 2019], and AGIEval [Zhong et al., 2023].”

Flagged first, then by citations

Cited by

Sorted by citations

Metadata

Authors
Liu, A. H., Khandelwal, K., Subramanian, S., Jouault, V., Rastogi, A., Sadé, A., Jeffares, A., Jiang, A., Cahill, A., Gavaudan, A., Sablayrolles, A., Héliou, A., You, A., Ehrenberg, A., Lo, A., Eliseev, A., Calvi, A., Sooriyarachchi, A., Bout, B., Rozière, B., De Monicault, B., Lanfranchi, C., Barreau, C., Courtot, C., Grattarola, D., Dabert, D., Casas, D. D. L., Chane-Sane, E., Ahmed, F., Berrada, G., Ecrepont, G., Guinet, G., Novikov, G., Kunsch, G., Lample, G., Martin, G., Gupta, G., Ludziejewski, J., Rute, J., Studnia, J., Amar, J., Delas, J., Roberts, J. S., Yadav, K., Chandu, K., Jain, K., Aitchison, L., Fainsin, L., Blier, L., Zhao, L., Martin, L., Saulnier, L., Gao, L., Buyl, M., Jennings, M., Pellat, M., Prins, M., Poirée, M., Guillaumin, M., Dinot, M., Futeral, M., Darrin, M., Augustin, M., Chiquier, M., Schimpf, M., Grinsztajn, N., Gupta, N., Raghuraman, N., Bousquet, O., Duchenne, O., Wang, P., von Platen, P., Jacob, P., Wambergue, P., Kurylowicz, P., Muddireddy, P. R., Chagniot, P., Stock, P., Agrawal, P., Torroba, Q., Sauvestre, R., Soletskyi, R., Menneer, R., Vaze, S., Barry, S., Gandhi, S., Waghjale, S., Gandhi, S., Ghosh, S., Mishra, S., Aithal, S., Antoniak, S., Scao, T. L., Cachet, T., Sorg, T. S., Lavril, T., Saada, T. N., Chabal, T., Foubert, T., Robert, T., Wang, T., Lawson, T., Bewley, T., Bewley, T., Edwards, T., Jamil, U., Tomasini, U., Nemychnikova, V., Phung, V., Maladière, V., Richard, V., Bouaziz, W., Li, W.-D., Marshall, W., Li, X., Yang, X., Ouahidi, Y. E., Wang, Y., Tang, Y., & Ramzi, Z.
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
OpenAlex
W7124165156
Cited by
64
References
4
Citations by year
2026: 64
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
instruction tuning, reasoning models, image understanding, open-source language models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review