The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Crosslingual Generalization through Multitask Finetuning
Open accessAbstract
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Colin Raffel. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The scientific documentation of BloomZ also includes multiple peer-reviewed papers , from a scientific description of the multitask fine-tuning procedures [41] to an estimation of the carbon footprint [36] currently one of the very few scientifically vetted sources of data on the energy footprint of training large language models. No peerreviewed papers providing scientific documentation or eval”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [41]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“We try to avoid using machine-translated data to finetune the model in order to prevent translationese (Bizzoni et al., 2020; Muennighoff et al., 2023) or possible name bias (Wang et al., 2022a), gender bias (Savoldi et al., 2021), or cultural bias (Ji et al., 2023).”
From The Llama 3 Herd of Models (2024) · cites this paper as Muennighoff et al., 2023
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2106.09685 · Cited by 13,453
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 10,387
Multilingual Denoising Pre-training for Neural Machine Translation
Liu, Y., Gu, J., Goyal, N., Li, X., Edunov, S., Ghazvininejad, M., Lewis, M., & Zettlemoyer, L. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00343 · Cited by 1,762
mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer
Xue, L., Constant, N., Roberts, A., Kale, M., Al-Rfou, R., Siddhant, A., Barua, A., & Raffel, C. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.41 · Cited by 1,629
Self-citationCross-lingual Language Model Pretraining
Lample, G., & Conneau, A. (2019) · arXiv · doi:10.48550/arxiv.1901.07291 · Cited by 1,586
Training Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2176 · Cited by 932
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
Ben Zaken, E., Goldberg, Y., & Ravfogel, S. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/2022.acl-short.1 · Cited by 765
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Liu, H., Tam, D., Muqeeth, M., Mohta, J., Huang, T., Bansal, M., & Raffel, C. (2022) · neural information processing systems · doi:10.52202/068431-0142 · Cited by 634
Self-citationThe Flan Collection: Designing Data and Methods for Effective Instruction TuningPreprint
Longpre, S., Hou, L., Vu, T., Webson, A., Chung, H. W., Tay, Y., Zhou, D., Le, Q. V., Zoph, B., Wei, J., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.13688 · Cited by 553
Self-citationMLQA: Evaluating Cross-lingual Extractive Question Answering
Lewis, P., Oğuz, B., Rinott, R., Riedel, S., & Schwenk, H. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.653 · Cited by 509
Cited by
Sorted by citations
Items 501–540 of 540
Abdelali, E. A. E. M., Salma, E.-M., Sabri, M. A., & Yahyaouy, A. (2026) · International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · doi:10.1109/iraset68627.2026.11538759
When Bigger Isn’t Better: Evaluating LLMs for Arabic Sentiment Analysis
Ibrahim, M., Makki, A., Barakat, Y., Samy, N., & Alhumoud, S. O. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2kimof4u6y8x
Ji, S., Li, Z., Paavola, J., Luo, H., & Tiedemann, J. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.937
BOUZIANE, Y., Moukafih, Y., & Ghogho, M. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.435 · Cited by 1
Corpora Generation for Urdu Grammatical Error Correction
Ahad, S., Ezzi, B. A., Hussain, M. A., Kumar, S., & Samad, A. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.2156
Conflict-Aware Memory for Embodied Agents: Enhancing Vector Data Quality via Detection Rules
Ma, K., Wang, H., Chen, S., Cai, Y., Huangyuyu, & Jin, R. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.1306
VFA: Empowering Multilingual MLLMs via Vision-Free Adaptation
Li, Y., Shi, Y., Ruan, Z., Zhang, D., Jiang, L., Huang, S., Chen, Y., Chen, G., & Wei, F. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.407
LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
Fan, Y., Li, B., Li, P., Wang, Y., Mu, Y., Yang, J., Chen, X., Weng, R., Wang, J., Cai, X., et al. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.2029
Language-Aware Token Boosting: LLM Language Confusion Reduction Without Tuning
Ukarapol, T., Sarapat, P., & Chukamphaeng, N. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-short.40
Gained in Translation: Privileged Pairwise Judges Enhance Multilingual Reasoning
Sutawika, L., Swamy, G., Wu, S., & Neubig, G. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.393 · Cited by 8
Self-citationVerifying the Subjective: Structured Multilingual Rewards for Low-Resource Alignment
Sha, J., & Zhu, M. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1174
Liu, T., Tian, Z., Huang, Z., Liu, T., Huang, J., Zhang, Z., Shao, C., & Li, D. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.180
LLMs as Idiomatic Decompilers: Recovering High-Level Code from x86-64 Assembly for Dart
Abualazm, R., & Elhassan, A. A. (2026) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner67736.2026.00052
VIPO-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation
Hasanaath, A. A., Xu, B., Hossain, M. R. I., Sigal, L., & Luqman, H. (2026) · Proceedings - International Conference on Image Processing · doi:10.1109/icip61757.2026.11630033
VTaMo: Video-Text Alignment Model for Sign Language Translation
Hu, J., He, Z., Huang, H., Yang, A., & Fang, Y. D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37232-1_24
TigXMM: A Multimodal Cross-Lingual Transfer LLM Method for Low-Resource Sentiment Analysis
Gebremeskel, H. G., Feng, C., Abera, A. M., & Zhao, X. (2026) · doi:10.1145/3810987.3815534
Cross-Linguistic Epistemic Variance in Large Language Model Cognition
Nizami, M. S., Khan, M. R. S., & Bilal¹, M. (2026) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/1932 · Cited by 1
Semantic Association vs. Position: Which Information Do Attention Heads Prefer?
Wang, M., Niu, S., Zhang, S., Wang, H., Song, S., Yin, Z., Yang, J., & Liang, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818196
Zhou, K., Wang, K., Wu, T., & Zhang, J. (2026) · Scientific Reports · doi:10.1038/s41598-026-66422-3
Data and Knowledge Dual-Driven Text Embedding Approaches: A Survey
Chen, X., 詹佳青, Lin, J., Liu, H., Zhang, Q., Chen, J., & Chen, H. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3721883
Tabashum, T., Rifat, F. Y., Wang, S., Krzak, J. J., Kruger, K. M., Graf, A., Chafetz, R. S., Davids, J. R., Bagley, A. M., Woloff, J., et al. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00062
Toward Reliable Multilingual LLMs in JointCloud via Auto-Constriction Tuning
Dai, S., Liu, X., Deng, L., & Yu, Y. (2026) · IEEE International Conference on Joint Cloud Computing (JCC) · doi:10.1109/jcc72984.2026.00059
STAR: instruction tuning for Arabic across tasks, datasets, and models
Al-shaibani, M. S., Alyafeai, Z., & Ahmad, I. (2026) · Language Resources and Evaluation · doi:10.1007/s10579-026-09942-8
Self-citation“Chi nas dal soch el sent de legn”
Signoroni, E., & Rychlý, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37249-9_9
Savant, S., Deshpande, U. U., & D’Silva, J. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01750-x
Binegde, G. N., Zhang, H., Li, Q., Zhang, B., Gao, C., & Gebremeskel, H. G. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105123
What do cross-lingual clone detectors really learn? A protocol and semantic counterfactual study
(1327728), P. D., Zhao, Y., Zhang, Q., & Gong, Y. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.113141
Generalized Biomedicine Discovery
Tang, L., Yang, Y., Chen, H., Zheng, J., Chen, C., & Chen, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37324-3_24
Mussa, A., Туймебаев, Ж. К., Мансурова, М., & Shihab, A. H. (2026) · Information · doi:10.3390/info17090921
S andhi : Fine-Grained Merging for Memory Efficient Multi-Model Serving
Gupta, V., Duran, O. K., Meda, N. S., An, I., Ananthanarayanan, G., & Iyer, A. P. (2026) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3830418.3843911
Enem-VL: A Multimodal Benchmark of Brazilian Exams for Evaluating Vision-Language Models
Soares, A. L. B., Ferreira, L. N., Leme, G. M., Scatolin, M. F., Interian, R., & Dias, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39882-6_21
Computational Linguistics and Natural Language Processing for Languages of Africa
Adelani, D. I. (2026) · Oxford University Press eBooks · doi:10.1093/9780197851463.003.1137
Vy, D. N.-L., Truong, N.-N., Nguyen, V. D., Vo, D. T. D., & Le, M.-H. (2026) · International Conference on Green Technology and Sustainable Development (GTSD) · doi:10.1109/gtsd70918.2026.11722489
Length and Meaning for Language Model Maps
Oyama, M., Kishino, R., Yamagiwa, H., & Shimodaira, H. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1510
MutQA: A Cross-Validated Q&A Dataset for Genetic MutationsPreprint
McCourt, R., Arredondo, D., Macaulay, O., Poshiya, S., Edeh, O., Virupakshappa, K., Bach, M. N., Ruiz, E. A., Hu, Y., Tafoya, L. E., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.27.762236
Language Induced Structural Efficiency Modeling in Multilingual Prompt Code Generation
Nakkella, M., Latchipatruni, Y., Bojja, R., Dharani, A., & Dasharadhi, D. S. (2026) · International Conference on Information, Implementation, and Innovation in Technology (I2ITCON) · doi:10.1109/i2itcon69735.2026.11747271
Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.21783 · Cited by 505
Self-citation
Metadata
- Authors
- Muennighoff, N., Wang, T., Sutawika, L., Roberts, A., Biderman, S., Le Scao, T., Bari, M. S., Shen, S., Yong, Z. X., Schoelkopf, H., Tang, X., Radev, D., Aji, A. F., Almubarak, K., Albanie, S., Alyafeai, Z., Webson, A., Raff, E., & Raffel, C.
- Affiliations
- University of Cambridge (GB)
- Google (United States) (US)
- Booz Allen Hamilton (United States) (US)
- University of California, Berkeley (US)
- Brown University (US)
- King Fahd University of Petroleum and Minerals (SA)
- Corresponding author
- Muennighoff, Niklas
- ORCID
- Venue
- Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2023
- Pages
- 15991-16111
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W4385571124
- Cited by
- 361
- References
- 33
- Citations by year
- 2026: 57 · 2025: 76 · 2024: 112 · 2023: 116
- FWCI
- 63.96
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Funders
- Centre National de la Recherche Scientifique
- Grand Équipement National De Calcul Intensif
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- cross-lingual generalization, multilingual language models, transfer learning, low-resource languages
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review