CoChat
Sign Up
PreprintCited by 2Topic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

Distilling Reasoning Ability from Large Language Models with Adaptive Thinking

Open access
Chen, Xiaoshu, Zhou, Sihang, Liang, Ke, Liu, Xinwang·2024·arXiv
DOI 10.48550/arxiv.2404.09170arXiv 2404.09170
Open this paper in CoChat — free accountOpen PDF

Abstract

Chain of thought finetuning (cot-finetuning) aims to endow small language models (SLM) with reasoning ability to improve their performance towards specific tasks by allowing them to imitate the reasoning procedure of large language models (LLM) beyond simply predicting the answers. Most existing cot-finetuning methods adopt a pre-thinking mechanism, allowing the SLM to generate a rationale before providing an answer. This mechanism enables SLM to analyze and think about complex questions, but it also makes answer correctness highly sensitive to minor errors in rationale. Therefore, we propose a robust post-thinking mechanism to generate answers before rationale. Thanks to this answer-first setting, 1) the answer can escape from the adverse effects caused by minor errors in the rationale; 2) the rationale serves as an error amplifier to the answer, which makes the SLM focus on learning hard samples; 3) the inferring efficiency can also benefit from the setting since users can stop the generation right after answers are outputted when inference is conducted. However, although the post-thinking mechanism brings many advantages and improves the overall performance of SLM on specific tasks, it may lose the ability to think about the questions and decompose complex questions into simple sub-questions compared to pre-thinking mechanism. Therefore, a plug-and-play adaptive-thinking mechanism is proposed with the aid of the soft prompt tuning to integrate the merits of the pre-thinking mechanism and post-thinking mechanism, in which a perception module is introduced to adaptively prompt SLM answer or think first based on perceiving the complexity of the questions. Extensive experiments are conducted across 12 reasoning tasks and 2 representative language models to demonstrate the effectiveness of the proposed mechanism.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2404.09170

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • Solving General Arithmetic Word Problems

    Roy, S., & Roth, D. (2016) · arXiv · doi:10.48550/arxiv.1608.01413 · Cited by 275 · cited 1×

    “…complex reasoning datasets divided into four classes are used to evaluate the proposed method: arithmetic (SingleEq [63], AddSub [64], MultiArith [65], GSM8K [31], Aqua [66], Svamp [67]), symbolic [68] (Last Letter Concatenation, Coin Flip), common sense (Common-SenseQA [69], StrategyQA [70]),…”

Show all 1 references

Research works printed but not linked: 75

  1. Z. Chu, J. Chen, Q. Chen, W. Yu, T. He, H. Wang, W. Peng, M. Liu, B. Qin, and T. Liu, "A survey of chain of thought reasoning: Advances, frontiers and future," arXiv preprint arXiv:2309.15402, 2023. · arXiv
  2. T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al., "Language mod- els are few-shot learners," Advances in neural information processing systems, vol. 33, pp. 1877-1901, 2020.
  3. H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar et al., "Llama: Open and efficient foundation language models," arXiv preprint arXiv:2302.13971, 2023. · arXiv
  4. H. Touvron, L. Martin, K. Stone, P. Albert, A. Almahairi, Y. Babaei, N. Bashlykov, S. Batra, P. Bhargava, S. Bhosale et al., "Llama 2: Open foundation and fine-tuned chat models," arXiv preprint arXiv:2307.09288, 2023. · arXiv
  5. J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou et al., "Chain-of-thought prompting elicits reasoning in large language models," Advances in Neural Information Processing Systems, vol. 35, pp. 24 824-24 837, 2022.
  6. N. Ho, L. Schmid, and S.-Y. Yun, "Large language models are reasoning teachers," in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), A. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, Jul. 2023, pp. 14 852-14 882. [Online]. Available: https://aclanthology.org/2023.acl-long.830
  7. C.-Y. Hsieh, C.-L. Li, C.-k. Yeh, H. Nakhost, Y. Fujii, A. Ratner, R. Krishna, C.-Y. Lee, and T. Pfister, "Distilling step-by-step! outperforming larger language models with less training data and smaller model sizes," in Findings of the Association for Computational Linguistics: ACL 2023, A. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, Jul. 2023, pp. 8003-8017. [Online]. Available: https: //aclanthology.org/2023.findings-acl.507
  8. Y. Li, P. Yuan, S. Feng, B. Pan, B. Sun, X. Wang, H. Wang, and K. Li, "Turning dust into gold: Distilling complex reasoning capabilities from llms by leveraging negative data," arXiv preprint arXiv:2312.12832, 2023. · arXiv
  9. S. Ren and K. Zhu, "Specializing pre-trained language models for better relational reasoning via network pruning," in Findings of the Association for Computational Linguistics: NAACL 2022, M. Carpuat, M.-C. de Marneffe, and I. V. Meza Ruiz, Eds. Seattle, United States: Association for Computational Linguistics, Jul. 2022, pp. 2195-2207. [Online]. Available: https://aclanthology.org/2022.findings-naacl.169
  10. X. Zhu, B. Qi, K. Zhang, X. Long, and B. Zhou, "Pad: Program- aided distillation specializes large models in reasoning," arXiv preprint arXiv:2305.13888, 2023. · arXiv
  11. Q. Liu, X. Geng, Y. Wang, E. Cambria, and D. Jiang, "Disentangled retrieval and reasoning for implicit question answering," IEEE Transac- tions on Neural Networks and Learning Systems, 2022.
  12. Z. Zhao, W. Fan, J. Li, Y. Liu, X. Mei, Y. Wang, Z. Wen, F. Wang, X. Zhao, J. Tang, and Q. Li, "Recommender systems in the era of large language models (llms)," IEEE Transactions on Knowledge and Data Engineering, pp. 1-20, 2024.
  13. K. Liang, L. Meng, M. Liu, Y. Liu, W. Tu, S. Wang, S. Zhou, X. Liu, and F. Sun, "Reasoning over different types of knowledge graphs: Static, temporal and multi-modal," arXiv preprint arXiv:2212.05767, 2022. · arXiv
  14. S. Ji, S. Pan, E. Cambria, P. Marttinen, and P. S. Yu, "A survey on knowledge graphs: Representation, acquisition, and applications," IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 2, pp. 494-514, 2022.
  15. Z. Xi, W. Chen, X. Guo, W. He, Y. Ding, B. Hong, M. Zhang, J. Wang, S. Jin, E. Zhou et al., "The rise and potential of large language model based agents: A survey," arXiv preprint arXiv:2309.07864, 2023. · arXiv
  16. L. C. Magister, J. Mallinson, J. Adamek, E. Malmi, and A. Sev- eryn, "Teaching small language models to reason," arXiv preprint arXiv:2212.08410, 2022. · arXiv
  17. R. Khalil and M. Brüne, "Adaptive decision-making "fast" and "slow": A model of creative thinking," European Journal of Neuroscience, vol. 61, no. 5, p. e70024, 2025.
  18. L. Gao, A. Madaan, S. Zhou, U. Alon, P. Liu, Y. Yang, J. Callan, and G. Neubig, "Pal: Program-aided language models," in International Conference on Machine Learning. PMLR, 2023, pp. 10 764-10 799.
  19. W. Chen, X. Ma, X. Wang, and W. W. Cohen, "Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks," Transactions on Machine Learning Research, 2023.
  20. S. Imani, L. Du, and H. Shrivastava, "MathPrompter: Mathematical reasoning using large language models," in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 5: Industry Track), S. Sitaram, B. Beigman Klebanov, and J. D. Williams, Eds. Toronto, Canada: Association for Computational Linguistics, Jul. 2023, pp. 37-42. [Online]. Available: https://aclanthology.org/2023.acl-industry.4
  21. P. Lu, L. Qiu, K.-W. Chang, Y. N. Wu, S.-C. Zhu, T. Rajpurohit, P. Clark, and A. Kalyan, "Dynamic prompt learning via policy gradient for semi-structured mathematical reasoning," in International Conference on Learning Representations (ICLR), 2023.
  22. Z. Zhang, A. Zhang, M. Li, and A. Smola, "Automatic chain of thought prompting in large language models," in The Eleventh International Conference on Learning Representations (ICLR 2023), 2023.
  23. J. Long, "Large language model guided tree-of-thought," arXiv preprint arXiv:2305.08291, 2023. · arXiv
  24. B. Lei, C. Liao, C. Ding et al., "Boosting logical reasoning in large language models through a new framework: The graph of thought," arXiv preprint arXiv:2308.08614, 2023. · arXiv
  25. M. Besta, N. Blach, A. Kubicek, R. Gerstenberger, L. Gianinazzi, J. Gajda, T. Lehmann, M. Podstawski, H. Niewiadomski, P. Nyczyk et al., "Graph of thoughts: Solving elaborate problems with large language models," arXiv preprint arXiv:2308.09687, 2023. · arXiv
  26. H. Lu, H. Huang, D. Zhang, H. Yang, W. Lam, and F. Wei, "Chain-of- dictionary prompting elicits translation in large language models," arXiv preprint arXiv:2305.06575, 2023. · arXiv
  27. K. Wang, F. Duan, S. Wang, P. Li, Y. Xian, C. Yin, W. Rong, and Z. Xiong, "Knowledge-driven cot: Exploring faithful reasoning in llms for knowledge-intensive question answering," arXiv preprint arXiv:2308.13259, 2023. · arXiv
  28. K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano, C. Hesse, and J. Schulman, "Training verifiers to solve math word problems," CoRR, vol. abs/2110.14168, 2021. [Online]. Available: https://arxiv.org/abs/ 2110.14168 · arXiv
  29. O. V. G. Hinton and J. Dean, "Distilling the knowledge in a neural network," CoRR, vol. abs/1503.02531, 2015. [Online]. Available: http://arxiv.org/abs/1503.02531 · arXiv
  30. P. Liu, X. Wang, L. Wang, W. Ye, X. Xi, and S. Zhang, "Distilling knowledge from bert into simple fully connected neural networks for efficient vertical retrieval," in Proceedings of the 30th ACM International Conference on Information & Knowledge Management, ser. CIKM '21. New York, NY, USA: Association for Computing Machinery, 2021, p. 3965-3975. [Online]. Available: https://doi.org/10.1145/3459637.3481909 · DOI
  31. W. Wang, F. Wei, L. Dong, H. Bao, N. Yang, and M. Zhou, "Minilm: deep self-attention distillation for task-agnostic compression of pre- trained transformers," in Proceedings of the 34th International Con- ference on Neural Information Processing Systems, ser. NIPS'20. Red Hook, NY, USA: Curran Associates Inc., 2020.
  32. S. Sun, Y. Cheng, Z. Gan, and J. Liu, "Patient knowledge distillation for BERT model compression," in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), K. Inui, J. Jiang, V. Ng, and X. Wan, Eds. Hong Kong, China: Association for Computational Linguistics, Nov. 2019, pp. 4323-4332. [Online]. Available: https://aclanthology.org/D19-1441
  33. W. Liu, G. Li, K. Zhang, B. Du, Q. Chen, X. Hu, H. Xu, J. Chen, and J. Wu, "Mind's mirror: Distilling self-evaluation capability and comprehensive thinking from large language models," in Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), K. Duh, H. Gomez, and S. Bethard, Eds. Mexico City, Mexico: Association for Computational Linguistics, Jun. 2024, pp. 6748-6763. [Online]. Available: https://aclanthology.org/2024.naacl-long.376/
  34. Z. Liang, D. Yu, X. Pan, W. Yao, Q. Zeng, X. Zhang, and D. Yu, "MinT: Boosting generalization in mathematical reasoning via multi-view fine-tuning," in Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), N. Calzolari, M.-Y. Kan, V. Hoste, A. Lenci, S. Sakti, and N. Xue, Eds. Torino, Italia: ELRA and ICCL, May 2024, pp. 11 307-11 318. [Online]. Available: https://aclanthology.org/2024.lrec-main.988
  35. X. Chen, H. Huang, Y. Gao, Y. Wang, J. Zhao, and K. Ding, "Learning to maximize mutual information for chain-of-thought distillation," in Findings of the Association for Computational Linguistics: ACL 2024, L.-W. Ku, A. Martins, and V. Srikumar, Eds. Bangkok, Thailand: Association for Computational Linguistics, Aug. 2024, pp. 6857-6868. [Online]. Available: https://aclanthology.org/2024.findings-acl.409/
  36. Y. Fu, H. Peng, L. Ou, A. Sabharwal, and T. Khot, "Specializing smaller language models towards multi-step reasoning," in Proceedings of the 40th International Conference on Machine Learning, ser. ICML'23. JMLR.org, 2023.
  37. L. Chenglin, Q. Chen, L. Li, C. Wang, F. Tao, Y. Li, Z. Chen, and Y. Zhang, "Mixed distillation helps smaller language models reason better," in Findings of the Association for Computational Linguistics: EMNLP 2024, Y. Al-Onaizan, M. Bansal, and Y.-N. Chen, Eds. Miami, Florida, USA: Association for Computational Linguistics, Nov. 2024, pp. 1673-1690. [Online]. Available: https: //aclanthology.org/2024.findings-emnlp.91/
  38. X. Zhuang, Z. Zhu, Z. Wang, X. Cheng, and Y. Zou, "UnicoTT: A unified framework for structural chain-of-thought distillation," in The Thirteenth International Conference on Learning Representations, 2025. [Online]. Available: https://openreview.net/forum?id=3baOKeI2EU
  39. Z. Chen, Q. Gao, A. Bosselut, A. Sabharwal, and K. Richardson, "DISCO: Distilling counterfactuals with large language models," in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), A.
  40. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, Jul. 2023, pp. 5514-5528. [Online]. Available: https://aclanthology.org/2023.acl-long.302
  41. P. Wang, Z. Wang, Z. Li, Y. Gao, B. Yin, and X. Ren, "SCOTT: Self-consistent chain-of-thought distillation," in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), A. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, Jul. 2023, pp. 5546-5558. [Online]. Available: https: //aclanthology.org/2023.acl-long.304
  42. T. Feng, Y. Li, L. Chenglin, H. Chen, F. Yu, and Y. Zhang, "Teaching small language models reasoning through counterfactual distillation," in Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Y. Al-Onaizan, M. Bansal, and Y.-N. Chen, Eds. Miami, Florida, USA: Association for Computational Linguistics, Nov. 2024, pp. 5831-5842. [Online]. Available: https://aclanthology.org/2024.emnlp-main.333/
  43. J. Bi, Y. Wu, W. Xing, and Z. Wei, "Enhancing the reasoning capabilities of small language models via solution guidance fine-tuning," in Proceedings of the 31st International Conference on Computational Linguistics, O.
  44. Rambow, L. Wanner, M. Apidianaki, H. Al-Khalifa, B. D. Eugenio, and S. Schockaert, Eds. Abu Dhabi, UAE: Association for Computational Linguistics, Jan. 2025, pp. 9074-9084. [Online]. Available: https://aclanthology.org/2025.coling-main.609/
  45. K. Feng, C. Li, X. Zhang, J. ZHOU, Y. Yuan, and G. Wang, "Keypoint-based progressive chain-of-thought distillation for LLMs," in Forty-first International Conference on Machine Learning, 2024. [Online]. Available: https://openreview.net/forum?id=tgsSKziIEa
  46. K. Shridhar, A. Stolfo, and M. Sachan, "Distilling reasoning capabilities into smaller language models," in Findings of the Association for Computational Linguistics: ACL 2023, A. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, Jul. 2023, pp. 7059-7073. [Online]. Available: https://aclanthology.org/2023.findings-acl.441
  47. B. Yu, H. Yuan, Y. Wei, B. Wang, W. Qi, and K. Chen, "Long- short chain-of-thought mixture supervised fine-tuning eliciting efficient reasoning in large language models," arXiv preprint arXiv:2505.03469, 2025. · arXiv
  48. Y. Kang, X. Sun, L. Chen, and W. Zou, "C3ot: Generating shorter chain- of-thought without compromising effectiveness," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, no. 23, 2025, pp. 24 312-24 320.
  49. G. Liang, L. Zhong, Z. Yang, and X. Quan, "Thinkswitcher: When to think hard, when to think fast," arXiv preprint arXiv:2505.14183, 2025. · arXiv
  50. W. Yao, H. Mi, and D. Yu, "Hdflow: Enhancing llm complex problem- solving with hybrid thinking and dynamic workflows," arXiv preprint arXiv:2409.17433, 2024. · arXiv
  51. D. Su, S. Sukhbaatar, M. Rabbat, Y. Tian, and Q. Zheng, "Dualformer: Controllable fast and slow thinking by learning with randomized rea- soning traces," arXiv preprint arXiv:2410.09918, 2024. · arXiv
  52. A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al., "Language models are unsupervised multitask learners," OpenAI blog, vol. 1, no. 8, p. 9, 2019.
  53. X. L. Li and P. Liang, "Prefix-tuning: Optimizing continuous prompts for generation," in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), C. Zong, F. Xia, W. Li, and R. Navigli, Eds. Online: Association for Computational Linguistics, Aug. 2021, pp. 4582-4597. [Online]. Available: https://aclanthology.org/2021.acl-long.353
  54. B. Lester, R. Al-Rfou, and N. Constant, "The power of scale for parameter-efficient prompt tuning," in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, M.-F. Moens, X. Huang, L. Specia, and S. W.-t. Yih, Eds. Online and Punta Cana, Dominican Republic: Association for Computational Linguistics, Nov. 2021, pp. 3045-3059. [Online]. Available: https://aclanthology.org/2021.emnlp-main.243
  55. T. Vu, B. Lester, N. Constant, R. Al-Rfou', and D. Cer, "SPoT: Better frozen model adaptation through soft prompt transfer," in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), S. Muresan, P. Nakov, and A. Villavicencio, Eds. Dublin, Ireland: Association for Computational Linguistics, May 2022, pp. 5039-5059. [Online]. Available: https://aclanthology.org/2022.acl-long.346
  56. Y. Su, X. Wang, Y. Qin, C.-M. Chan, Y. Lin, H. Wang, K. Wen, Z. Liu, P. Li, J. Li, L. Hou, M. Sun, and J. Zhou, "On transferability of prompt tuning for natural language processing," in Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, M. Carpuat, M.-C. de Marneffe, and I. V. Meza Ruiz, Eds. Seattle, United States: Association for Computational Linguistics, Jul. 2022, pp. 3949-3969. [Online]. Available: https://aclanthology.org/2022.naacl-main.290
  57. K. Hambardzumyan, H. Khachatrian, and J. May, "Warp: Word-level adversarial reprogramming," arXiv preprint arXiv:2101.00121, 2021. · arXiv
  58. C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu, "Exploring the limits of transfer learning with a unified text-to-text transformer," J. Mach. Learn. Res., vol. 21, no. 1, jan 2020.
  59. F. Wan, X. Huang, D. Cai, X. Quan, W. Bi, and S. Shi, "Knowledge fusion of large language models," in The Twelfth International Conference on Learning Representations, 2024. [Online]. Available: https://openreview.net/forum?id=jiDsk12qcz
  60. Anonymous, "When less is more: Investigating data pruning for pretraining LLMs at scale," in NeurIPS Workshop on Attributing Model Behavior at Scale, 2023. [Online]. Available: https://openreview.net/ forum?id=XUIYn3jo5T
  61. R. Koncel-Kedziorski, H. Hajishirzi, A. Sabharwal, O. Etzioni, and S. D. Ang, "Parsing algebraic word problems into equations," Transactions of the Association for Computational Linguistics, vol. 3, pp. 585-597, 2015. [Online]. Available: https://aclanthology.org/Q15-1042
  62. M. J. Hosseini, H. Hajishirzi, O. Etzioni, and N. Kushman, "Learning to solve arithmetic word problems with verb categorization," in Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), A. Moschitti, B. Pang, and W. Daelemans, Eds. Doha, Qatar: Association for Computational Linguistics, Oct. 2014, pp. 523-533. [Online]. Available: https: //aclanthology.org/D14-1058
  63. W. Ling, D. Yogatama, C. Dyer, and P. Blunsom, "Program induction by rationale generation: Learning to solve and explain algebraic word problems," in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), R. Barzilay and M.-Y. Kan, Eds. Vancouver, Canada: Association for Computational Linguistics, Jul. 2017, pp. 158-167. [Online]. Available: https://aclanthology.org/P17-1015
  64. A. Patel, S. Bhattamishra, and N. Goyal, "Are NLP models really able to solve simple math word problems?" in Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, K. Toutanova, A. Rumshisky, L. Zettlemoyer, D. Hakkani- Tur, I. Beltagy, S. Bethard, R. Cotterell, T. Chakraborty, and Y. Zhou, Eds. Online: Association for Computational Linguistics, Jun. 2021, pp. 2080-2094. [Online]. Available: https://aclanthology.org/2021. naacl-main.168
  65. T. Kojima, S. S. Gu, M. Reid, Y. Matsuo, and Y. Iwasawa, "Large language models are zero-shot reasoners," in Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, Eds., vol. 35. Curran Associates, Inc., 2022, pp. 22 199-22 213. [Online]. Available: https://proceedings.neurips.cc/paper files/paper/ 2022/file/8bb0d291acd4acf06ef112099c16f326-Paper-Conference.pdf
  66. A. Talmor, J. Herzig, N. Lourie, and J. Berant, "CommonsenseQA: A question answering challenge targeting commonsense knowledge," in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), J. Burstein, C. Doran, and T. Solorio, Eds. Minneapolis, Minnesota: Association for Computational Linguistics, Jun. 2019, pp. 4149-4158. [Online]. Available: https://aclanthology.org/N19-1421
  67. M. Geva, D. Khashabi, E. Segal, T. Khot, D. Roth, and J. Berant, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies," Transactions of the Association for Computational Linguistics (TACL), 2021.
  68. L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray, J. Schulman, J. Hilton, F. Kelton, L. Miller, M. Simens, A. Askell, P. Welinder, P. F. Christiano, J. Leike, and R. Lowe, "Training language models to follow instructions with human feedback," in Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, Eds., vol. 35. Curran Associates, Inc., 2022, pp. 27 730-27 744. [Online]. Available: https://proceedings.neurips.cc/paper files/paper/ 2022/file/b1efde53be364a73914f58805a001731-Paper-Conference.pdf
  69. A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer, "Automatic differentiation in pytorch," in NIPS-W, 2017.
  70. A. Yang, B. Yang, B. Hui, B. Zheng, B. Yu, C. Zhou, C. Li, C. Li, D. Liu, F. Huang, G. Dong, H. Wei, H. Lin, J. Tang, J. Wang, J. Yang, J. Tu, J. Zhang, J. Ma, J. Xu, J. Zhou, J. Bai, J. He, J. Lin, K. Dang, K. Lu, K. Chen, K. Yang, M. Li, M. Xue, N. Ni, P. Zhang, P. Wang, R. Peng, R. Men, R. Gao, R. Lin, S. Wang, S. Bai, S. Tan, T. Zhu, T. Li, T. Liu, W. Ge, X. Deng, X. Zhou, X. Ren, X. Zhang, X. Wei, X. Ren, Y. Fan, Y. Yao, Y. Zhang, Y. Wan, Y. Chu, Y. Liu, Z. Cui, Z. Zhang, and Z. Fan, "Qwen2 technical report," arXiv preprint arXiv:2407.10671, 2024. · arXiv
  71. A. Grattafiori, A. Dubey, A. Jauhri, A. Pandey, A. Kadian, A. Al-Dahle, A. Letman, A. Mathur, A. Schelten, A. Vaughan et al., "The llama 3 herd of models," arXiv preprint arXiv:2407.21783, 2024. · arXiv
  72. S. Xu, W. Xie, L. Zhao, and P. He, "Chain of draft: Thinking faster by writing less," arXiv preprint arXiv:2502.18600, 2025. · arXiv
  73. A. Madaan, N. Tandon, P. Gupta, S. Hallinan, L. Gao, S. Wiegreffe, U. Alon, N. Dziri, S. Prabhumoye, Y. Yang, S. Gupta, B. P. Majumder, K. Hermann, S. Welleck, A. Yazdanbakhsh, and P. Clark, "Self-refine: Iterative refinement with self-feedback," in Thirty-seventh Conference on Neural Information Processing Systems, 2023. [Online]. Available: https://openreview.net/forum?id=S37hOerQLB
  74. T. Liang, Z. He, W. Jiao, X. Wang, Y. Wang, R. Wang, Y. Yang, S. Shi, and Z. Tu, "Encouraging divergent thinking in large language models through multi-agent debate," in Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Y. Al-Onaizan, M. Bansal, and Y.-N. Chen, Eds. Miami, Florida, USA: Association for Computational Linguistics, Nov. 2024, pp. 17 889-17 904. [Online]. Available: https://aclanthology.org/2024.emnlp-main.992/
  75. T. Wei, J. Luan, W. Liu, S. Dong, and B. Wang, "Cmath: Can your language model pass chinese elementary school math test?" arXiv preprint arXiv:2306.16636, 2023. · arXiv

Cited by

Sorted by citations

See all 2

Metadata

Authors
Chen, X., Zhou, S., Liang, K., & Liu, X.
Affiliations
National University of Defense Technology (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
36
Issue
11
Pages
19820-19833
ISSN
2162-237X (ISSN-L)
DOI
10.48550/arxiv.2404.09170
arXiv
2404.09170
OpenAlex
W4413277726
Cited by
2
References
1
Citations by year
2026: 1 · 2025: 1
FWCI
0.81
Type
journal article
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (62421002, 62276271, 62325604)
  • National Science Fund for Distinguished Young Scholars
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Keywords
chain-of-thought distillation, large language models, small language models, reasoning skills, adaptive thinking, soft prompt tuning, question complexity, inference efficiency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Distilling Reasoning Ability from Large Language Models with Adaptive Thinking. https://app.cochat.ai/papers/10.48550/arxiv.2404.09170
The paper
Chen, X., Zhou, S., Liang, K., & Liu, X. (2024). Distilling Reasoning Ability from Large Language Models with Adaptive Thinking. arXiv. https://doi.org/10.48550/arxiv.2404.09170