The DOI matches its DataCite record; 3 of the 13 references it cites were found in a registry or an index, and 10 are not checked yet.
Scaling Instruction-Finetuned Language Models
Open accessAbstract
Finetuning language models on a collection of datasets phrased as instructions has been shown to improve model performance and generalization to unseen tasks. In this paper we explore instruction finetuning with a particular focus on (1) scaling the number of tasks, (2) scaling the model size, and (3) finetuning on chain-of-thought data. We find that instruction finetuning with the above aspects dramatically improves performance on a variety of model classes (PaLM, T5, U-PaLM), prompting setups (zero-shot, few-shot, CoT), and evaluation benchmarks (MMLU, BBH, TyDiQA, MGSM, open-ended generation). For instance, Flan-PaLM 540B instruction-finetuned on 1.8K tasks outperforms PALM 540B by a large margin (+9.4% on average). Flan-PaLM 540B achieves state-of-the-art performance on several benchmarks, such as 75.2% on five-shot MMLU. We also publicly release Flan-T5 checkpoints, which achieve strong few-shot performance even compared to much larger models, such as PaLM 62B. Overall, instruction finetuning is a general method for improving the performance and usability of pretrained language models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, the latest generation of language models is already able to perform above the human level in the majority of tasks from standard benchmark datasets (11, 12), making purely performance-based evaluation less meaningful as time progresses.”
From Using cognitive psychology to understand GPT-3 (2023) · cites this paper as [12]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Classical and instruction-following summarizers such as BART (Lewis et al., 2019), FLAN-T5 (Chung et al., 2022), and compression-oriented methods like LLMLingua (Jiang et al., 2023) generate concise summaries but often remove structural dependencies required for multi-step reasoning.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Chung et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, by drawing on medical texts present within their training datasets, general-purpose models such as Flan-PaLM or ChatGPT can accurately answer medical questions, achieving passing scores on the United States Medical Licensing Exam 10,52,53 .”
From Foundation models for generalist medical artificial intelligence (2023) · cites this paper as [52]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Instruction fine-tuning (IFT) (Chung et al., 2022; Wang et al., 2022) is another well-known strategy to make language models truthful.”
From Inference-Time Intervention: Eliciting Truthful Answers from a Language Model (2023) · cites this paper as Chung et al., 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Furthermore, recent studies [60, 129] have confirmed the effectiveness of supervised fine-tuning to achieve exceptional performance on unseen tasks, showcasing their remarkable generalization abilities.”
From A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions (2025) · cites this paper as [60]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 78
- Shourya Aggarwal, Divyanshu Mandowara, Vishwajeet Agrawal, Dinesh Khandelwal, Parag Singla, and Dinesh Garg. Explanations for CommonsenseQA: New Dataset and Models. In ACL , 2021. URL https: //aclanthology.org/2021.acl-long.238 .
- Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, Xilun Chen, Luke Zettlemoyer, and Sonal Gupta. Muppet: Massive multi-task representations with pre-finetuning. In EMNLP , 2021. URL https:// aclanthology.org/2021.emnlp-main.468 .
- Raviteja Anantha, Svitlana Vakulenko, Zhucheng Tu, Shayne Longpre, Stephen Pulman, and Srinivas Chappidi. Open-domain question answering goes conversational via question rewriting. In NAACL , 2021. URL https://aclanthology.org/2021.naacl-main.44/ .
- Ankur Bapna, Isaac Caswell, Julia Kreutzer, Orhan Firat, Daan van Esch, Aditya Siddhant, Mengmeng Niu, Pallavi Baljekar, Xavier Garcia, Wolfgang Macherey, Theresa Breiner, Vera Axelrod, Jason Riesa, Yuan Cao, Mia Xu Chen, Klaus Macherey, Maxim Krikun, Pidong Wang, Alexander Gutkin, Apurva Shah, Yanping Huang, Zhifeng Chen, Yonghui Wu, and Macduff Hughes. Building machine translation systems for the next thousand languages, 2022. URL https://arxiv.org/abs/2205.03983 . · arXiv
- Shaily Bhatt, Sunipa Dev, Partha Talukdar, Shachi Dave, and Vinodkumar Prabhakaran. Re-contextualizing fairness in nlp: The case of india, 2022. URL https://arxiv.org/abs/2209.12226 . · arXiv
- Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 , 2021. · arXiv
- Daniel Borkan, Lucas Dixon, Jeffrey Sorensen, Nithum Thain, and Lucy Vasserman. Nuanced metrics for measuring unintended bias with real data for text classification, 2019a. URL https://arxiv.org/abs/ 1903.04561 .
- Daniel Borkan, Lucas Dixon, Jeffrey Sorensen, Nithum Thain, and Lucy Vasserman. Nuanced metrics for measuring unintended bias with real data for text classification, 2019b. URL https://arxiv.org/abs/ 1903.04561 .
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D. Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. Language models are few-shot learners. NeurIPS , 2020. URL https://proceedings.neurips.cc/paper/2020/file/ 1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf .
- Oana-Maria Camburu, Tim Rocktäschel, Thomas Lukasiewicz, and Phil Blunsom. e-SNLI: Natural language inference with natural language explanations. NeurIPS , 2018. URL https://arxiv.org/pdf/1812.01193. pdf . · arXiv
- Oana-Maria Camburu, Brendan Shillingford, Pasquale Minervini, Thomas Lukasiewicz, and Phil Blunsom. Make up your mind! Adversarial generation of inconsistent natural language explanations. In ACL , 2020. URL https://aclanthology.org/2020.acl-main.382 .
- Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 , 2021. URL https://arxiv.org/abs/2107.03374 . · arXiv
- Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, et al. PaLM: Scaling language modeling with Pathways. arXiv preprint arXiv:2204.02311 , 2022. URL https://arxiv.org/abs/2204.02311 . · arXiv
- Jonathan H. Clark, Eunsol Choi, Michael Collins, Dan Garrette, Tom Kwiatkowski, Vitaly Nikolaev, and Jennimaria Palomaki. TyDiQA: A benchmark for information-seeking question answering in typologically diverse languages. TACL , 2020. URL https://aclanthology.org/2020.tacl-1.30 .
- Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168 , 2021. URL https://arxiv.org/abs/2110.14168 . · arXiv
- Zhuyun Dai, Arun Tejasvi Chaganty, Vincent Y Zhao, Aida Amini, Qazi Mamunur Rashid, Mike Green, and Kelvin Guu. Dialog inpainting: Turning documents into dialogs. In ICML , 2022. URL https: //proceedings.mlr.press/v162/dai22a.html .
- Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Akihiro Nishi, Nanyun Peng, and Kai-Wei Chang. On measures of biases and harms in nlp, 2021b. URL https://arxiv.org/abs/2108.03362 . · arXiv
- Nan Du, Yanping Huang, Andrew M. Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, Barret Zoph, Liam Fedus, Maarten Bosma, Zongwei Zhou, Tao Wang, Yu Emma Wang, Kellie Webster, Marie Pellat, Kevin Robinson, Kathleen Meier-Hellstern, Toju Duke, Lucas Dixon, Kun Zhang, Quoc V Le, Yonghui Wu, Zhifeng Chen, and Claire Cui. GLaM: Efficient Scaling of Language Models with Mixture-of-Experts. ICML , 2022. URL https://arxiv.org/abs/2112.06905 . · arXiv
- Tanmay Garg, Sarah Masud, Tharun Suresh, and Tanmoy Chakraborty. Handling bias in toxic speech detection: A survey, 2022. URL https://arxiv.org/abs/2202.00126 . · arXiv
- Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot, Dan Roth, and Jonathan Berant. Did aristotle use a laptop? A question answering benchmark with implicit reasoning strategies. TACL , 2021. doi: 10.1162/ tacl\_a\_00370. URL https://aclanthology.org/2021.tacl-1.21 .
- Nitesh Goyal, Ian Kivlichan, Rachel Rosen, and Lucy Vasserman. Is your toxicity my toxicity? exploring the impact of rater identity on toxicity annotation, 2022. URL https://arxiv.org/abs/2205.00501 . · arXiv
- Saga Hansson, Konstantinos Mavromatakis, Yvonne Adesam, Gerlof Bouma, and Dana Dannélls. The Swedish Winogender dataset. In Proceedings of the 23rd Nordic Conference on Computational Linguistics (NoDaLiDa) , pages 452-459, Reykjavik, Iceland (Online), May 31-2 June 2021. Linköping University Electronic Press, Sweden. URL https://aclanthology.org/2021.nodalida-main.52 .
- Ali Hasan, Shea Brown, Jovana Davidovic, Benjamin Lange, and Mitt Regan. Algorithmic bias and risk assessments: Lessons from practice. Digital Society , 1(1):1-15, 2022.
- Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. Measuring massive multitask language understanding. ICLR , 2020. URL https://openreview.net/ forum?id=d7KBjmI3GmQ .
- Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, et al. Training compute-optimal large language models. arXiv preprint arXiv:2203.15556 , 2022. · arXiv
- Jiaxin Huang, Shixiang Shane Gu, Le Hou, Yuexin Wu, Xuezhi Wang, Hongkun Yu, and Jiawei Han. Large language models can self-improve. In arxiv , 2022. URL https://openreview.net/forum?id=NiEtU7blzN .
- Norman P Jouppi, Doe Hyun Yoon, George Kurian, Sheng Li, Nishant Patil, James Laudon, Cliff Young, and David Patterson. A domain-specific supercomputer for training deep neural networks. Communications of the ACM , 63(7):67-78, 2020.
- Daniel Khashabi, Sewon Min, Tushar Khot, Ashish Sabharwal, Oyvind Tafjord, Peter Clark, and Hannaneh Hajishirzi. UnifiedQA: Crossing format boundaries with a single QA system. In Findings of the Association for Computational Linguistics: EMNLP 2020 , 2020. URL https://aclanthology.org/2020.findings-emnlp. 171 .
- Tushar Khot, Peter Clark, Michal Guerquin, Peter Jansen, and Ashish Sabharwal. QASC: A dataset for question answering via sentence composition. In AAAI , 2020. URL https://arxiv.org/abs/1910.11473 . · arXiv
- Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. Large language models are zero-shot reasoners. NeurIPS , 2022. URL https://arxiv.org/abs/2205.11916 . · arXiv
- Matthew Lamm, Jennimaria Palomaki, Chris Alberti, Daniel Andor, Eunsol Choi, Livio Baldini Soares, and Michael Collins. QED: A framework and dataset for explanations in question answering. TACL , 9:790-806, 2021. URL https://arxiv.org/abs/2009.06354 . · arXiv
- Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461 , 2019. URL https://arxiv. org/abs/1910.13461 . · arXiv
- Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, et al. Solving quantitative reasoning problems with language models. arXiv preprint arXiv:2206.14858 , 2022. URL https://arxiv.org/abs/ 2206.14858 . · arXiv
- Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, et al. Competition-level code generation with alphacode. arXiv preprint arXiv:2203.07814 , 2022. URL http://go/arxiv/2203.07814 . · arXiv
- Wang Ling, Dani Yogatama, Chris Dyer, and Phil Blunsom. Program induction by rationale generation: Learning to solve and explain algebraic word problems. ACL , 2017. URL https://aclanthology.org/ P17-1015 .
- Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 , 2019. URL https://arxiv.org/abs/1907.11692 . · arXiv
- Sewon Min, Mike Lewis, Luke Zettlemoyer, and Hannaneh Hajishirzi. MetaICL: Learning to learn in context. In NAACL , 2022. URL https://aclanthology.org/2022.naacl-main.201 .
- Swaroop Mishra, Daniel Khashabi, Chitta Baral, and Hannaneh Hajishirzi. Cross-task generalization via natural language crowdsourcing instructions. ACL , 2021. URL https://arxiv.org/abs/2104.08773 . · arXiv
- Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. Model cards for model reporting. In Proceedings of the conference on fairness, accountability, and transparency , pages 220-229, 2019.
- Maxwell Nye, Anders Johan Andreassen, Guy Gur-Ari, Henryk Michalewski, Jacob Austin, David Bieber, David Dohan, Aitor Lewkowycz, Maarten Bosma, David Luan, et al. Show your work: Scratchpads for intermediate computation with language models. arXiv preprint arXiv:2112.00114 , 2021. URL http: //arxiv.org/abs/2112.00114 . · arXiv
- Yasumasa Onoe, Michael JQ Zhang, Eunsol Choi, and Greg Durrett. CREAK: A dataset for commonsense reasoning over entity knowledge. In NeurIPS Datasets and Benchmarks Track (Round 2) , 2021. URL https: //arxiv.org/abs/2109.01653 .
- Vishakh Padmakumar, Leonard Lausen, Miguel Ballesteros, Sheng Zha, He He, and George Karypis. Exploring the role of task transferability in large-scale multi-task learning. arXiv preprint arXiv:2204.11117 , 2022. URL https://aclanthology.org/2022.naacl-main.183/ . · arXiv
- Ravsehaj Singh Puri, Swaroop Mishra, Mihir Parmar, and Chitta Baral. How many data samples is an additional instruction worth? arXiv preprint arXiv:2203.09161 , 2022. URL https://arxiv.org/abs/2203. 09161 . · arXiv
- Mahima Pushkarna, Andrew Zaldivar, and Oddur Kjartansson. Data cards: Purposeful and transparent dataset documentation for responsible ai. In Data-centric AI Workshop at NeurIPS , 2021. URL https: //arxiv.org/abs/2204.01075 .
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language models are unsupervised multitask learners. OpenAI blog , 1(8):9, 2019. URL https://d4mucfpksywv.cloudfront. net/better-language-models/language\_models\_are\_unsupervised\_multitask\_learners.pdf .
- Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, et al. Scaling language models: Methods, analysis & insights from training Gopher. arXiv preprint arXiv:2112.11446 , 2021a. URL https://arxiv.org/abs/2112. 11446 . · arXiv
- Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William S. Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, and Geoffrey Irving. Scaling language models: Methods, analysis & insights from training gopher. CoRR , abs/2112.11446, 2021b. URL https://arxiv.org/abs/2112.11446 . · arXiv
- Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research , 21:1-67, 2020. URL https://arxiv.org/abs/1910.10683 . · arXiv
- AdamRoberts, Hyung Won Chung, Anselm Levskaya, Gaurav Mishra, James Bradbury, Daniel Andor, Sharan Narang, Brian Lester, Colin Gaffney, Afroz Mohiuddin, Curtis Hawthorne, Aitor Lewkowycz, Alex Salcianu, Marc van Zee, Jacob Austin, Sebastian Goodman, Livio Baldini Soares, Haitang Hu, Sasha Tsvyashchenko, Aakanksha Chowdhery, Jasmijn Bastings, Jannis Bulian, Xavier Garcia, Jianmo Ni, Andrew Chen, Kathleen Kenealy, Jonathan H. Clark, Stephan Lee, Dan Garrette, James Lee-Thorp, Colin Raffel, Noam Shazeer, Marvin Ritter, Maarten Bosma, Alexandre Passos, Jeremy Maitin-Shepard, Noah Fiedel, Mark Omernick, Brennan Saeta, Ryan Sepassi, Alexander Spiridonov, Joshua Newlan, and Andrea Gesmundo. Scaling up models and data with t5x and seqio . arXiv preprint arXiv:2203.17189 , 2022. URL https://arxiv.org/ abs/2203.17189 . · arXiv
- Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, et al. Multitask prompted training enables zero-shot task generalization. ICLR 2022 , 2021. URL https://arxiv.org/abs/2110.08207 . · arXiv
- Maarten Sap, Swabha Swayamdipta, Laura Vianna, Xuhui Zhou, Yejin Choi, and Noah A. Smith. Annotators with attitudes: How annotator beliefs and identities bias toxic language detection, 2021. URL https: //arxiv.org/abs/2111.07997 .
- Timo Schick, Sahana Udupa, and Hinrich Schütze. Self-diagnosis and self-debiasing: A proposal for reducing corpus-based bias in NLP. CoRR , abs/2103.00453, 2021. URL https://arxiv.org/abs/2103.00453 . · arXiv
- Thomas Scialom, Tuhin Chakrabarty, and Smaranda Muresan. Continual-T0: Progressively instructing 50+ tasks to language models without forgetting. arXiv preprint arXiv:2205.12393 , 2022. URL https: //arxiv.org/abs/2205.12393 . · arXiv
- Nikil Roashan Selvam, Sunipa Dev, Daniel Khashabi, Tushar Khot, and Kai-Wei Chang. The tail wagging the dog: Dataset construction biases of social bias benchmarks, 2022. URL https://arxiv.org/abs/2210. 10040 .
- Noam Shazeer and Mitchell Stern. Adafactor: Adaptive learning rates with sublinear memory cost. In ICML , 2018. URL https://arxiv.org/abs/1804.04235 . · arXiv
- Renee Shelby, Shalaleh Rismani, Kathryn Henne, AJung Moon, Negar Rostamzadeh, Paul Nicholas, N'Mah Yilla, Jess Gallegos, Andrew Smart, Emilio Garcia, and Gurleen Virk. Sociotechnical harms: Scoping a taxonomy for harm reduction, 2022. URL https://arxiv.org/abs/2210.05791 . · arXiv
- Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, and Jason Wei. Language models are multilingual chain-of-thought reasoners. arXiv preprint arXiv:2210.03057 , 2022. URL https://arxiv.org/abs/2210. 03057 . · arXiv
- Eric Michael Smith, Melissa Hall, Melanie Kambadur, Eleonora Presani, and Adina Williams. "i'm sorry to hear that": Finding new biases in language models with a holistic descriptor dataset, 2022. URL https://arxiv.org/abs/2205.09209 . · arXiv
- David So, Wojciech Mańke, Hanxiao Liu, Zihang Dai, Noam Shazeer, and Quoc V. Le. Searching for efficient transformers for language modeling. Advances in Neural Information Processing Systems , 2021. URL https://arxiv.org/abs/2109.08668 . · arXiv
- Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, et al. Beyond the imitation game: Quantifying and extrapolating the capabilities of language models. arXiv preprint arXiv:2206.04615 , 2022. URL https://arxiv.org/abs/2206.04615 . · arXiv
- Mirac Suzgun, Nathan Scales, Nathaneal Scharli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny ZHou, and Jason Wei. Challenging BIG-Bench tasks and whether chain-of-thought can solve them. arXiv preprint arXiv:2210.09261 , 2022. URL https://arxiv.org/abs/ 2210.09261 . · arXiv
- Alon Talmor, Oyvind Tafjord, Peter Clark, Yoav Goldberg, and Jonathan Berant. Leap-of-thought: Teaching pre-trained models to systematically reason over implicit knowledge. NeurIPS , 2020. URL https://arxiv. org/abs/2006.06609 .
- Yi Tay, Mostafa Dehghani, Vinh Q Tran, Xavier Garcia, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Neil Houlsby, and Donald Metzler. Unifying language learning paradigms. arXiv preprint arXiv:2205.05131 , 2022a. URL https://arxiv.org/abs/2205.05131 . · arXiv
- Yi Tay, Jason Wei, Hyung Won Chung, David R. So, Siamak Shakeri, Xavier Garcia, Vinh Q. Tran, Hauixiu Steven Zheng, Jinfeng Rao, Denny Zhou, Donald Metzler, Neil Houlsby, Quoc V. Le, and Mostafa Dehghani. Transcending scaling laws with 0.1% extra compute. In arxiv , 2022b.
- Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. SuperGlue: A stickier benchmark for general-purpose language understanding systems. NeurIPS , 2019a. URL http://go/arxiv/1905.00537 .
- Cunxiang Wang, Shuailong Liang, Yue Zhang, Xiaonan Li, and Tian Gao. Does it make sense? And why? A pilot study for sense making and explanation. In ACL , 2019b. URL https://arxiv.org/abs/1906.00363 . · arXiv
- Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, and Colin Raffel. What language model architecture and pretraining objective work best for zero-shot generalization? ICML , 2022a. URL https://arxiv.org/abs/2204.05832 . · arXiv
- Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, and Denny Zhou. Self-consistency improves chain of thought reasoning in language models. arXiv preprint arXiv:2203.11171 , 2022b. URL https: //arxiv.org/abs/2203.11171 . · arXiv
- Yizhong Wang, Swaroop Mishra, Pegah Alipoormolabashi, Yeganeh Kordi, Amirreza Mirzaei, Anjana Arunkumar, Arjun Ashok, Arut Selvan Dhanasekaran, Atharva Naik, David Stap, et al. Benchmarking generalization via in-context instructions on 1,600+ language tasks. arXiv preprint arXiv:2204.07705 , 2022c. URL https://arxiv.org/abs/2204.07705 . · arXiv
- Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, and Quoc V. Le. Finetuned language models are zero-shot learners. ICLR 2022 , 2021. URL https: //openreview.net/forum?id=gEZrGCozdqR .
- Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et al. Emergent abilities of large language models. TMLR , 2022a. URL https://openreview.net/forum?id=yzkSU5zdwD .
- Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou. Chain of thought prompting elicits reasoning in large language models. NeurIPS , 2022b. URL https://arxiv.org/abs/2201.11903 . · arXiv
- Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, and Dan Klein. Detoxifying language models risks marginalizing minority voices, 2021. URL https://arxiv.org/abs/2104.06390 . · arXiv
- Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, and Colin Raffel. ByT5: Towards a token-free future with pre-trained byte-to-byte models. TACL , 2022. URL https://aclanthology.org/2022.tacl-1.17 .
- Michihiro Yasunaga and Percy Liang. Graph-based, self-supervised program repair from diagnostic feedback. In ICML , 2020. URL http://go/arxiv/2005.10636 .
- Qinyuan Ye, Bill Yuchen Lin, and Xiang Ren. Crossfit: A few-shot learning challenge for cross-task generalization in NLP. In EMNLP , 2021. URL https://arxiv.org/abs/2104.08835 . · arXiv
- Ann Yuan, Daphne Ippolito, Vitaly Nikolaev, Chris Callison-Burch, Andy Coenen, and Sebastian Gehrmann. Synthbio: A case study in human-ai collaborative curation of text datasets, 2021. URL https://arxiv. org/abs/2111.06467 .
- Ruiqi Zhong, Kristy Lee, Zheng Zhang, and Dan Klein. Adapting language models for zero-shot learning by meta-tuning on dataset and prompt collections. EMNLP Findings , 2021. URL https://aclanthology. org/2021.findings-emnlp.244/ .
Cited by
Sorted by citations
Items 801–900 of 1,083
Automated Text Scoring in the Age of Generative AI for the GPU-poor
Ormerod, C. M., & Kwako, A. (2024) · Chinese/English Journal of Educational Measurement and Evaluation · doi:10.59863/okuu1904 · Cited by 20
ptt5-v2: A Closer Look at Continued Pretraining of T5 Models for the Portuguese Language
Piau, M., Lotufo, R., & Nogueira, R. F. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-79032-4_23 · Cited by 14
Kumar, A., Sthanusubramoniani, G., Gupta, D., Nair, A. R., Alotaibi, Y. A., & Zakariah, M. (2025) · Egyptian Informatics Journal · doi:10.1016/j.eij.2025.100683 · Cited by 16
Holtzman, A., West, P., & Zettlemoyer, L. (2025) · Journal of Social Computing · doi:10.23919/jsc.2025.0009 · Cited by 32
A systematic survey of natural language processing for the Greek language
Bakagianni, J., Pouli, K., Gavriilidou, M., & Pavlopoulos, J. (2025) · Patterns · doi:10.1016/j.patter.2025.101313 · Cited by 20
EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning
Chen, Y., Ge, Y., Ge, Y., Ding, M., Li, B., Wang, R., Xu, R., Shan, Y., & Liu, X. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02676-0 · Cited by 91
SIGHT: A Large Annotated Dataset on Student Insights Gathered from Higher Education Transcripts
Wang, R., Wirawarn, P., Goodman, N. D., & Demszky, D. (2023) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/2023.bea-1.27 · Cited by 16
ALERT: Adapt Language Models to Reasoning Tasks
Yu, P., Wang, T., Golovneva, O., AlKhamissi, B., Verma, S. S., Jin, Z., Ghosh, G., Diab, M., & Çelikyılmaz, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.60 · Cited by 25
IDAS: Intent Discovery with Abstractive Summarization
Raedt, M. D., Godin, F., Demeester, T., & Develder, C. (2023) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/2023.nlp4convai-1.7 · Cited by 21
Are Language Models Worse than Humans at Following Prompts? It’s Complicated
Webson, A., Loo, A. M., Yu, Q., & Pavlick, E. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.514 · Cited by 19
Self-citationCan Large Language Models Capture Dissenting Human Voices?
Lee, N., An, N., & Thorne, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.278 · Cited by 23
Instruction Position Matters in Sequence Generation with Large Language Models
Liu, Y., Zeng, X., Shao, C., Meng, F., & Zhou, J. N. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.693 · Cited by 23
He, L., Omranian, S., McRoy, S., & Zheng, K. (2024) · medRxiv · doi:10.1101/2024.03.19.24304544 · Cited by 15
Modeling Legal Reasoning: LM Annotation at the Edge of Human Agreement
Thalken, R., Stiglitz, E., Mimno, D., & Wilkens, M. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.575 · Cited by 13
COSMO: A Large-Scale E-commerce Common Sense Knowledge Generation and Serving System at Amazon
Yu, C., Liu, X., Maia, J., Li, Y., Cao, T., Gao, Y., Song, Y., Goutam, R., Zhang, H., Yin, B., et al. (2024) · Companion of the 2024 International Conference on Management of Data · doi:10.1145/3626246.3653398 · Cited by 13
Self-citationLarge language model agent as a mechanical designer
Jadhav, Y., & Farimani, A. B. (2026) · Journal of Engineering Design · doi:10.1080/09544828.2026.2624356 · Cited by 18
Munthuli, A., Socatiyanurak, V., Sangchocanonta, S., Kovudhikulrungsri, L., Saksakulkunakorn, N., Chairuangsri, P., & Tantibundhit, C. (2023) · IEEE Access · doi:10.1109/access.2023.3296261 · Cited by 13
Lifting the Curse of Capacity Gap in Distilling Language Models
Zhang, C., Yang, Y., Liu, J., Wang, J., Xian, Y., Wang, B., & Song, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.249 · Cited by 23
Yang, H., & Li, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.907 · Cited by 18
Semantic Decomposition of Question and SQL for Text-to-SQL Parsing
Eyal, B., Mahabi, M., Haroche, O., Bachar, A., & Elhadad, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.910 · Cited by 22
A Multimodal Analysis of Influencer Content on Twitter
Villegas, D. S., Goanță, C., & Αλέτρας, Ν. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-main.15 · Cited by 13
MedSumm: A Multimodal Approach to Summarizing Code-Mixed Hindi-English Clinical Queries
Ghosh, A., Acharya, A., Jha, P., Saha, S., Gaudgaul, A., Majumdar, R., Chadha, A. R., Jain, R., Sinha, S., & Agarwal, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56069-9_8 · Cited by 13
LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models
Diao, S., Pan, R. N., Dong, H., Shum, K., Zhang, J., Xiong, W., & Zhang, T. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-demo.12 · Cited by 18
Pokamestov, I. E., & Nikitin, N. A. (2024) · Finance: Theory and Practice · doi:10.26794/2587-5671-2024-28-4-122-135 · Cited by 13
BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks
Xue, J., Nguyen, P., Matheny, B., & Nguyen, L.-M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72344-5_19 · Cited by 13
MotionChain: Conversational Motion Controllers via Multimodal Prompts
Jiang, B., Chen, X., Zhang, C., Yin, F., Li, Z., Yu, G., & Fan, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73347-5_4 · Cited by 20
Self-citationCLIP-DPO: Vision-Language Models as a Source of Preference for Fixing Hallucinations in LVLMs
Ouali, Y., Bulat, A., Martínez, B., & Tzimiropoulos, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73116-7_23 · Cited by 23
Chen, J., Lu, Y., Zhang, S., Yao, B., Dong, Y., Xu, Y., Li, Y., Wang, Q., Wang, D., & Sun, Y. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.961 · Cited by 19
Self-citationMirroring Privacy Risks with Digital Twins: When Pieces of Personal Data Suddenly Fit Together
Bäumer, F. S., Schultenkämper, S., Geierhos, M., & Lee, Y. S. (2024) · SN Computer Science · doi:10.1007/s42979-024-03413-z · Cited by 13
Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation
Bhattacharjee, A., Moraffah, R., Garland, J., & Liu, H. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825537 · Cited by 25
InRanker: Distilled Rankers for Zero-Shot Information Retrieval
Laitz, T., Papakostas, K., Lotufo, R., & Nogueira, R. F. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-79032-4_10 · Cited by 18
Föhr, T. L., Schreyer, M., Moffitt, K. C., & Marten, K.-U. (2026) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2025.100758 · Cited by 14
Classification of Russian textbooks by grade level and topic using ReaderBench
Paraschiv, A., Dascălu, M., & Solnyshkina, M. I. (2023) · RESEARCH RESULT Theoretical and Applied Linguistics · doi:10.18413/2313-8912-2023-9-1-0-4 · Cited by 13
Few-shot Event Detection: An Empirical Study and a Unified View
Ma, Y., Wang, Z., Cao, Y., & Sun, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.628 · Cited by 17
ThinkSum: Probabilistic reasoning over sets using large language models
Ozturkler, B., Malkin, N., Wang, Z., & Jojić, N. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.68 · Cited by 28
Khan, Z., Kumar, B., Schulter, S., Yu, X., Fu, Y., & Chandraker, M. K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01441 · Cited by 16
Empirical evaluation of language modeling to ascertain cancer outcomes from clinical text reports
Elmarakeby, H., Trukhanov, P., Arroyo, V. M., Riaz, I. B., Schrag, D., Allen, E. M. V., & Kehl, K. L. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05439-1 · Cited by 13
PaRaDe: Passage Ranking using Demonstrations with LLMs
Drozdov, A., Zhuang, H., Dai, Z., Qin, Z., Rahimi, R., Wang, X., Alon, D., Iyyer, M., McCallum, A., Metzler, D., et al. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.950 · Cited by 15
Self-citationInterroLang: Exploring NLP Models and Datasets through Dialogue-based Explanations
Feldhus, N., Wang, Q., Anikina, T., Chopra, S., Oguz, C., & Möller, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.359 · Cited by 15
Lu, X., Pan, L., Liu, Q., Nakov, P., & Kan, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.483 · Cited by 32
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding
Zhang, Y., Cheng, H., Shen, Z., Liu, X., Wang, Y., & Gao, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.820 · Cited by 16
Evidence, my Dear Watson: Abstractive dialogue summarization on learnable relevant utterances
Italiani, P., Frisoni, G., Moro, G., Carbonaro, A., & Sartori, C. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127132 · Cited by 13
Zhou, Y., Zhu, C., & Zhu, W. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103705 · Cited by 14
Just-in-Time Detection of Silent Security Patches
Tang, X., Kim, K., Ezzini, S., Song, Y., Tian, H., Klein, J., & Bissyandé, T. F. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3749370 · Cited by 24
ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow DataPreprint
Shen, J.-H., Jain, A., Xiao, Z., Amlekar, I., Hadji, M., Podolny, A., & Talwalkar, A. (2024) · Qeios · doi:10.32388/8vog0o · Cited by 47
ProCyon: A multimodal foundation model for protein phenotypesPreprint
Queen, O., Huang, Y., Calef, R., Giunchiglia, V., Chen, T., Dasoulas, G., Tai, L., Abbadessa, G., Howell, O., Li, M. M., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.12.10.627665 · Cited by 14
Self-citationMiceli Barone, A. V., Barez, F., Cohen, S. B., & Konstas, I. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.19 · Cited by 12
Nguyen, T. B., Dang, V.-H., & Pham, T.-T. (2024) · Frontiers of Structural and Civil Engineering · doi:10.1007/s11709-024-1118-7 · Cited by 12
Text-to-structure interpretation of user requests in BIM interaction
Wei, Y., Li, X., & Petzold, F. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106119 · Cited by 17
La-LoRA: Parameter-efficient fine-tuning with layer-wise adaptive low-rank adaptation
Gu, J., Yuan, J., Cai, J., Zhou, X., & Fan, L. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108095 · Cited by 13
CITB: A Benchmark for Continual Instruction Tuning
Zhang, Z., Fang, M., Chen, L., & Namazi‐Rad, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.633 · Cited by 26
BRAINTEASER: Lateral Thinking Puzzles for Large Language Models
Jiang, Y., Ilievski, F., Ma, K., & Sourati, Z. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.885 · Cited by 29
Robust Prompt Optimization for Large Language Models Against Distribution Shifts
Li, M., Wang, W., Feng, F., Cao, Y., Zhang, J., & Chua, T. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.95 · Cited by 19
Regulation and NLP (RegNLP): Taming Large Language Models
Goanță, C., Αλέτρας, Ν., Chalkidis, I., Ranchordás, S., & Spanakis, G. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.539 · Cited by 17
The Evolution of Large Language Models in Natural Language Understanding
Kulkarni, C. S. (2023) · Journal of Artificial Intelligence Machine Learning and Data Science · doi:10.51219/jaimld/chinmay-shripad-kulkarni/28 · Cited by 12
Enhancing Chinese abbreviation prediction with LLM generation and contrastive evaluation
Liu, J., Tian, X., Tong, H., Xie, C., Ruan, T., Lin, C., Wu, B., & Wang, H. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103768 · Cited by 12
Enhancing Relation Extraction from Biomedical Texts by Large Language Models
Asada, M., & Fukuda, K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60615-1_1 · Cited by 13
Self-supervised Text Style Transfer Using Cycle-Consistent Adversarial Networks
Quatra, M. L., Gallipoli, G., & Cagliero, L. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3678179 · Cited by 13
Luo, M. F., Zhang, H., Wu, S., Li, B., Han, H. W., & Fei, H. (2024) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2024.semeval-1.226 · Cited by 12
OSCaR: Object State Captioning and State Change Representation
Nguyen, N., Bi, J., Vosoughi, A., Tian, Y., Fazli, P., & Xu, C. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.226 · Cited by 18
Zeyad, A. M. A., & Biradar, A. (2024) · International Conference on Advancements in Power, Communication and Intelligent Systems (APCI) · doi:10.1109/apci61480.2024.10616418 · Cited by 13
Medical Information Extraction With NLP-Powered QABots: A Real-World Scenario
Crema, C., Verde, F., Tiraboschi, P., Marra, C., Arighi, A., Fostinelli, S., Giuffrè, G. M., Maschio, V. P. D., L’Abbate, F., Solca, F., et al. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3450118 · Cited by 14
Mitigating Biases for Instruction-following Language Models via Bias Neurons Elimination
Yang, N., Kang, T., Choi, S. J., Lee, H., & Jung, K. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.490 · Cited by 24
Carve3D: Improving Multi-view Reconstruction Consistency for Diffusion Models with RL Finetuning
Xie, D., Li, J., Tan, H. X., Sun, X., Shu, Z., Zhou, Y., Bi, S., Pirk, S., & Kaufman, A. E. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00609 · Cited by 15
ControlCap: Controllable Region-Level Captioning
Zhao, Y., Liu, Y., Guo, Z., Wu, W., Gong, C., Ye, Q., & Wan, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72920-1_2 · Cited by 15
Yu, T., Fu, K., Wang, S., Huang, Q., & Yu, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3475510 · Cited by 13
SZTU-CMU at MER2024: Improving Emotion-LLaMA with Conv-Attention for Multimodal Emotion Recognition
Cheng, Z., Tu, S., Huang, D., Li, M., Peng, X., Cheng, Z.-Q., & Hauptmann, A. G. (2024) · International Workshop on Multimodal and Responsible Affective Computing (MRAC) · doi:10.1145/3689092.3689404 · Cited by 13
Wang, H., Lai, C., Sun, Y., & Ge, W. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680826 · Cited by 15
AgentBank: Towards Generalized LLM Agents via Fine-Tuning on 50000+ Interaction Trajectories
Song, Y., Xiong, W., Zhao, X., Zhu, D., Wu, W., Wang, K., Li, C., Peng, W., & Li, S. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.116 · Cited by 39
LawLLM: Intelligent Legal System with Legal Reasoning and Verifiable Retrieval
Yue, S., Liu, S., Zhou, Y., Shen, C., Wang, S., Xiao, Y., Li, B., Song, Y. S., Shen, X., Chen, W., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5569-1_19 · Cited by 13
Multimodal Fake News Detection Based on Chain-of-Thought Prompting Large Language Models
Xu, Y., Ge, J., Lyu, G., Li, G., & Li, H. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831252 · Cited by 14
Liu, D., Ling, F., Zhou, X., & Li, Y. (2025) · Architectural Science Review · doi:10.1080/00038628.2025.2488522 · Cited by 13
Self-citationChain-of-Factors Paper-Reviewer Matching
Zhang, Y., Shen, Y., Kang, S., Chen, X., Jin, B., & Han, J. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714708 · Cited by 12
Self-citationDistributed training of large language models: A survey
Zeng, F., Gan, W., Wang, Y., & Yu, P. S. (2025) · Natural Language Processing Journal · doi:10.1016/j.nlp.2025.100174 · Cited by 15
Saleela, D., Oyegoke, A. S., Dauda, J. A., & Ajayi, S. O. (2025) · Journal of Aging and Environment · doi:10.1080/26892618.2025.2534956 · Cited by 13
Incorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models
He, X., Wei, L., Xie, L., & Tian, Q. (2025) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2025/123 · Cited by 26
Learning to Taste: A Multimodal Wine Dataset
Bender, T., Sørensen, S., Kashani, A., Hjörleifsson, K. E., Hyldig, G., Hauberg, S., Belongie, S., & Warburg, F. (2023) · neural information processing systems · doi:10.52202/075280-0321 · Cited by 13
Giulianelli, M., Luden, I., Fernández, R., & Kutuzov, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.176 · Cited by 12
Critic-Guided Decoding for Controlled Text Generation
Kim, M., Lee, H., Yoo, K. M., Park, J., Lee, H., & Jung, K. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.281 · Cited by 33
TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World
Lin, H., Ruan, L., Xia, W., Liu, P., Wen, J., Xu, Y., Hu, D., Song, R., Zhao, W. X., Jin, Q., et al. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612425 · Cited by 12
Text Augmented Spatial Aware Zero-shot Referring Image Segmentation
Suo, Y., Zhu, L., & Yang, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.73 · Cited by 22
Personalized LoRA for Human-Centered Text Understanding
Zhang, Y., Wang, J., Yu, L., Xu, D., & Zhang, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29931 · Cited by 16
Chen, S., Wang, W., Chen, X., Lu, P., Yang, Z., & Du, Y. (2024) · Data Intelligence · doi:10.1162/dint_a_00251 · Cited by 14
Self-citationWhich LLM to Play? Convergence-Aware Online Model Selection with Time-Increasing Bandits
Xia, Y., Kong, F., Yu, T., Guo, L., Rossi, R. A., Kim, S., & Li, S. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645420 · Cited by 12
Short Interest Trend Prediction with Large Language Models
Xiao, Z., Mai, Z., Cui, Y., Xu, Z., & Li, J. (2024) · International Conference on Innovation in Artificial Intelligence (ICIAI) · doi:10.1145/3655497.3655500 · Cited by 15
Foundation Model-Based Spectral–Spatial Transformer for Hyperspectral Image Classification
Huang, L., Chen, Y., & He, X. Z. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3456129 · Cited by 14
Overview of the CLEF 2024 SimpleText Track
Магдановна, Е. Л., SanJuan, É., Huet, S., Azarbonyad, H., Nunzio, G. M. D., Vezzani, F., D’Souza, J., & Kamps, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71908-0_13 · Cited by 15
Xu, J., Zhou, X., Shen, Y., Gu, X., Arnab, A., Sun, C., Wang, X., & Schmid, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01238 · Cited by 23
Self-citationLanguage Model Self-improvement by Reinforcement Learning Contemplation without External Supervision
Pang, J.-C., Li, K., Wang, P., Chen, X.-H., Xu, J., Zhang, Z., & Yu, Y. (2026) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.20097 · Cited by 38
Self-citationSparks of Large Audio Models: A Survey and Outlook
Latif, S., Shoukat, M., Shamshad, F., Usama, M., Ren, Y., Cuayáhuitl, H., Wang, W., Zhang, X., Togneri, R., Cambria, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.12792 · Cited by 17
“Similarly, Ghosal et al. [218] introduced TANGO, an innovative approach designed for generating music from text inputs by leveraging the capabilities of FLAN-T5 [219].”
MethodAre Emergent Abilities in Large Language Models just In-Context Learning?
Lu, S., Bigoulaeva, I., Sachdeva, R., Madabushi, H. T., & Gurevych, I. (2023) · arXiv · doi:10.48550/arxiv.2309.01809 · Cited by 12
Towards versatile multimedia quality assessment for visual communications
Zhang, Z., Jia, Z., Li, C., Zhou, Y., Liu, X., Min, X., & Zhai, G. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4631-2 · Cited by 13
Is ChatGPT a Good Multi-Party Conversation Solver?
Tan, C.-H., Gu, J.-C., & Ling, Z.-H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.326 · Cited by 16
Unnatural Error Correction: GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text
Cao, Q., Kojima, T., Matsuo, Y., & Iwasawa, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.550 · Cited by 15
Prompting with Pseudo-Code Instructions
Mishra, M., Kumar, P., Bhat, R. A., Murthy, R., Contractor, D., & Tamilselvam, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.939 · Cited by 18
Data Augmentation and Large Language Model for Legal Case Retrieval and Entailment
Bui, M.-Q., Do, D.-T., Le, N.-K., Nguyen, D.-H., Nguyen, K.-V.-H., Anh, T. P. N., & Nguyen, L.-M. (2024) · The Review of Socionetwork Strategies · doi:10.1007/s12626-024-00158-2 · Cited by 11
Zhao, Z., Xie, Z., Zhou, G., & Huang, J. X. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657824 · Cited by 11
Park, C., Lee, H., & Jeong, O. (2024) · Future Internet · doi:10.3390/fi16080260 · Cited by 12
CCSum: A Large-Scale and High-Quality Dataset for Abstractive News Summarization
Jiang, X., & Dreyer, M. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.406 · Cited by 11
MemeGuard: An LLM and VLM-based Framework for Advancing Content Moderation via Meme Intervention
Jha, P., Jain, R., Mandal, K., Chadha, A. R., Saha, S., & Bhattacharyya, P. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.439 · Cited by 11
Metadata
- Authors
- Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., Webson, A., Gu, S. S., Dai, Z., Suzgun, M., Chen, X., Chowdhery, A., Castro-Ros, A., Pellat, M., Robinson, K., Valter, D., Narang, S., Mishra, G., Yu, A., Zhao, V., Huang, Y., Dai, A., Yu, H., Petrov, S., Chi, E. H., Dean, J., Devlin, J., Roberts, A., Zhou, D., Le, Q. V., & Wei, J.
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2210.11416
- OpenAlex
- W4307079201
- Cited by
- 1,441
- References
- 0
- Citations by year
- 2026: 29 · 2025: 395 · 2024: 489 · 2023: 524 · 2022: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- instruction tuning, task scaling, model size scaling, Flan-T5, zero-shot prompting, few-shot prompting, open-ended generation, MMLU, TyDiQA
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
