Igniting Language Intelligence: The Hitchhiker’s Guide from Chain-of-Thought Reasoning to Language Agents
Open accessThe DOI matches its Crossref record; 241 of the 241 references it cites were found in a registry or an index.
Abstract
Large language models (LLMs) have dramatically enhanced the field of language intelligence, as demonstrably evidenced by their formidable empirical performance across a spectrum of complex reasoning tasks. Additionally, theoretical proofs have illuminated their emergent reasoning capabilities, providing a compelling showcase of their advanced cognitive abilities in linguistic contexts. Critical to their remarkable efficacy in handling complex reasoning tasks, LLMs leverage the intriguing chain-of-thought (CoT) reasoning techniques, obliging them to formulate intermediate steps en route to deriving an answer. The CoT reasoning approach has not only exhibited proficiency in amplifying reasoning performance but also in enhancing interpretability, controllability, and flexibility. In light of these merits, recent research endeavors have extended CoT reasoning methodologies to nurture the development of autonomous language agents, which adeptly adhere to language instructions and execute actions within varied environments. This survey article orchestrates a thorough discourse, penetrating vital research dimensions, encompassing (i) the foundational mechanics of CoT techniques, with a focus on elucidating the circumstances and justification behind its efficacy; (ii) the paradigm shift in CoT; and (iii) the burgeoning of language agents fortified by CoT approaches. Prospective research avenues envelop explorations into generalization, efficiency, customization, scaling, and safety. A repository for the related papers is available at https://github.com/Zoeyyao27/CoT-Igniting-Agent .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Furthermore, while recent agent frameworks adopt reasoning heuristics like Chain-of-Thought (CoT) [163,193] and ReAct [136] to simulate deliberative processes, these approaches remain shallow in semantic comprehension.”
From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [193]
In the citing paper
“these approaches remain shallow in semantic comprehension.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [196]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–241 of 241
Pan, L., Saxon, M., Xu, W., Nathani, D., Wang, X., & Wang, W. Y. (2023) · arXiv · doi:10.48550/arxiv.2308.03188 · Cited by 25
Mao, S., Zhang, N.-Y., Wang, X.-H., Wang, M.-R., Yao, Y., Jiang, Y., Xie, P.-J., Huang, F., & Chen, H.-J. (2023) · arXiv.org · doi:10.48550/arxiv.2310.02168 · Cited by 25
Self-citationAgents: An Open-source Framework for Autonomous Language Agents
Zhou, W., Jiang, Y. E., Li, L., Wu, J., Wang, T., Qiu, S., Zhang, J., Chen, J., Wu, R., Wang, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.07870 · Cited by 21 · cited 3×
“Tools coming into play include knowledge bases, search engines, code interpreters, online models, applications, databases, and even bespoke tools specially created for specific tasks, overcoming the constraints of generic APIs [13, 60, 119, 138, 197].”
Self-citationMAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning
Yue, X., Qu, X., Zhang, G., Fu, Y., Huang, W., Sun, H., Su, Y., & Chen, W. (2023) · arXiv · doi:10.48550/arxiv.2309.05653 · Cited by 21
(2023) · doi:10.52202/075280-3107 · Cited by 20
Identifying the Risks of LM Agents with an LM-Emulated Sandbox
Ruan, Y., Dong, H., Wang, A., Pitis, S., Zhou, Y., Ba, J., Dubois, Y., Maddison, C. J., & Hashimoto, T. (2023) · arXiv · doi:10.48550/arxiv.2309.15817 · Cited by 19
SafetyBench: Evaluating the Safety of Large Language Models
Zhang, Z., Lei, L., Wu, L., Sun, R., Huang, Y., Long, C., Liu, X., Lei, X., Tang, J., & Huang, M. (2023) · arXiv · doi:10.48550/arxiv.2309.07045 · Cited by 19
Self-citationLanguage Agent Tree Search Unifies Reasoning Acting and Planning in Language Models
Zhou, A., Yan, K., Shlapentokh-Rothman, M., Wang, H., & Wang, Y.-X. (2023) · arXiv · doi:10.48550/arxiv.2310.04406 · Cited by 18 · cited 1×
“Effectively integrating this feedback necessitates the implementation of a crucial method: self-correction with environment feedback [169, 175, 192, 195].”
Self-citationReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models
Xu, B., Peng, Z., Lei, B., Mukherjee, S., Liu, Y., & Xu, D. (2023) · arXiv · doi:10.48550/arxiv.2305.18323 · Cited by 17
A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis
Gur, I., Furuta, H., Huang, A., Safdari, M., Matsuo, Y., Eck, D., & Faust, A. (2023) · arXiv · doi:10.48550/arxiv.2307.12856 · Cited by 17
Evaluating Language-Model Agents on Realistic Autonomous Tasks
Kinniment, M., Sato, L. J. K., Du, H., Goodrich, B., Hasin, M., Chan, L., Miles, L. H., Lin, T. R., Wijk, H., Burget, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.11671 · Cited by 15
The role of verbal and performance intelligence in children's strategy selection and execution
Luwel, K., Foustana, A., Onghena, P., & Verschaffel, L. (2013) · Learning and Individual Differences · doi:10.1016/j.lindif.2013.01.010 · Cited by 14
AgentSims: An Open-Source Sandbox for Large Language Model Evaluation
Lin, J., Zhao, H., Zhang, A., Wu, Y., Ping, H., & Chen, Q. (2023) · arXiv · doi:10.48550/arxiv.2308.04026 · Cited by 14
Self-citationTransformer-Patcher: One Mistake worth One Neuron
Huang, Z., Shen, Y., Zhang, X., Zhou, J., Rong, W., & Xiong, Z. (2023) · arXiv · doi:10.48550/arxiv.2301.09785 · Cited by 14
Why think step by step? Reasoning emerges from the locality of experiencePreprint
Prystawski, B., Li, M. Y., & Goodman, N. D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.03843 · Cited by 13
ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory
Hu, C., Fu, J., Du, C., Luo, S., Zhao, J., & Zhao, H. (2023) · arXiv · doi:10.48550/arxiv.2306.03901 · Cited by 13 · cited 1×
“The other way to store memory is via vector storage [43, 198].”
Self-citationIs Self-Repair a Silver Bullet for Code Generation?
Olausson, T. X., Inala, J. P., Wang, C., Gao, J., & Solar-Lezama, A. (2023) · arXiv · doi:10.48550/arxiv.2306.09896 · Cited by 13 · cited 2×
“This iterative process aims to minimize mistakes and maximize accurate The Hitchhiker’s Guide from CoT Reasoning to Language Agents 206:19”
ViperGPT: Visual Inference via Python Execution for ReasoningPreprint
Surís, D., Menon, S., & Vondrick, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.08128 · Cited by 12
TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usage
Ruan, J., Chen, Y., Zhang, B., Xu, Z., Bao, T., Du, G., Shi, S., Mao, H., Li, Z., Zeng, X., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.03427 · Cited by 11
CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets
Yuan, L., Chen, Y., Wang, X., Fung, Y. R., Peng, H., & Ji, H. (2023) · arXiv · doi:10.48550/arxiv.2309.17428 · Cited by 11
GPT-4 Doesn't Know It's Wrong: An Analysis of Iterative Prompting for Reasoning Problems
Stechly, K., Marquez, M., & Kambhampati, S. (2023) · arXiv · doi:10.48550/arxiv.2310.12397 · Cited by 11
ChatMOF: An Autonomous AI System for Predicting and Generating Metal-Organic Frameworks
Kang, Y., & Kim, J. (2023) · arXiv · doi:10.48550/arxiv.2308.01423 · Cited by 10
Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization
Yao, W., Heinecke, S., Niebles, J. C., Liu, Z., Feng, Y., Xue, L., Murthy, R., Chen, Z., Zhang, J., Arpit, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.02151 · Cited by 10
Walking Down the Memory Maze: Beyond Context Limit through Interactive Reading
Chen, H., Pasunuru, R., Weston, J., & Celikyilmaz, A. (2023) · arXiv · doi:10.48550/arxiv.2310.05029 · Cited by 9
Recursion of Thought: A Divide-and-Conquer Approach to Multi-Context Reasoning with Language Models
Lee, S., & Kim, G. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.40 · Cited by 9
FireAct: Toward Language Agent Fine-tuning
Chen, B., Shu, C., Shareghi, E., Collier, N., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2310.05915 · Cited by 9
Effective Long-Context Scaling of Foundation Models
Xiong, W., Liu, J., Molybog, I., Zhang, H., Bhargava, P., Hou, R., Martin, L., Rungta, R., Sankararaman, K. A., Oguz, B., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.16039 · Cited by 9
Are More LLM Calls All You Need? Towards the Scaling Properties of Compound AI Systems
Chen, L., Davis, J. Q., Hanin, B., Bailis, P. D., Stoica, I. G., Zaharia, M., & Zou, J. (2024) · neural information processing systems · doi:10.52202/079017-1455 · Cited by 8
Teaching Small Language Models to Reason
Magister, L. C., Mallinson, J., Adamek, J., Malmi, E., & Severyn, A. (2022) · arXiv · doi:10.48550/arxiv.2212.08410 · Cited by 7
AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model
Moon, S., Madotto, A., Lin, Z., Nagarajan, T., Smith, M., Jain, S., Yeh, C.-F., Murugesan, P., Heidari, P., Liu, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.16058 · Cited by 7
Mehta, N., Teruel, M., Sanz, P. F., Deng, X., Awadallah, A. H., & Kiseleva, J. (2023) · arXiv · doi:10.48550/arxiv.2304.10750 · Cited by 7
User Behavior Simulation with Large Language Model based Agents
Wang, L., Zhang, J., Yang, H., Chen, Z., Tang, J., Zhang, Z., Chen, X., Lin, Y., Song, R., Zhao, W. X., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.02552 · Cited by 6
Self-citationControlLLM: Augment Language Models with Tools by Searching on GraphsPreprint
Liu, Z., Lai, Z., Gao, Z., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.17796 · Cited by 5
Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data
Shum, K., Diao, S., & Zhang, T. (2023) · arXiv · doi:10.48550/arxiv.2302.12822 · Cited by 3 · cited 2×
“Shum et al. [127] proposed a strategy called Automate-CoT (Automatic Prompt Augmentation and Selection with Chain-of-Thought) that automates the process of augmenting and selecting rational chains for CoT prompting.”
User Behavior Simulation with Large Language Model-based Agents
Wang, L., Zhang, J., Yang, H., Chen, Z.-Y., Tang, J., Zhang, Z., Chen, X., Lin, Y., Sun, H., Song, R., et al. (2025) · UCL Discovery (University College London) · Cited by 3
Self-citationPrompting Large Language Models for Zero-Shot Domain Adaptation in Speech RecognitionPreprint
Li, Y., Wu, Y., Li, J., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.16007 · Cited by 2
Nature Language Reasoning, A SurveyPreprint
Yu, F., Zhang, H.-B., & Wang, B.-Y. (2023) · arXiv.org · doi:10.48550/arxiv.2303.14725 · Cited by 2
Active Prompting with Chain-of-Thought for Large Language Models
Diao, S., Wang, P., Lin, Y., Pan, R., Liu, X., & Zhang, T. (2023) · arXiv · doi:10.48550/arxiv.2302.12246
Addendum: Verbal and non-verbal intelligence changes in the teenage brain
Ramsden, S., Richardson, F. M., Josse, G., Thomas, M. S. C., Ellis, C., Shakeshaft, C., Seghier, M. L., & Price, C. J. (2012) · Nature · doi:10.1038/nature11113
Exploring Human-Like Translation Strategy with Large Language Models
He, Z., Liang, T., Jiao, W., Zhang, Z., Yang, Y., Wang, R., Tu, Z., Shi, S., & Wang, X. (2023) · arXiv · doi:10.48550/arxiv.2305.04118
Self-citation
Research works printed but not linked: 32
- 10.5555/3618408.3618425 · doi:10.5555/3618408.3618425
- Zhen Bi, Ningyu Zhang, Yinuo Jiang, Shumin Deng, Guozhou Zheng, and Huajun Chen. 2024. When do program-of-thought works for reasoning? In Proceedings of the 38th AAAI Conference on Artificial Intelligence, the 36th Conference on Innovative Applications of Artificial Intelligence, and the 14th Symposium on Educational Advances in Artificial Intelligence (AAAI’24/IAAI’24/EAAI’24). 17691–17699.
- 10.5555/3692070.3692537 · doi:10.5555/3692070.3692537
- Zhibin Gou, Zhihong Shao, Yeyun Gong, yelong shen, Yujiu Yang, Minlie Huang, Nan Duan, and Weizhu Chen. 2024. ToRA: A tool-integrated reasoning agent for mathematical problem solving. In Proceedings of the 12th International Conference on Learning Representations (ICLR’24).
- Wes Gurnee and Max Tegmark. 2024. Language models represent space and time. In Proceedings of the 12th International Conference on Learning Representations (ICLR’24).
- Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021. Measuring massive multitask language understanding. In Proceedings of the 9th International Conference on Learning Representations (ICLR’21).
- Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021. Measuring mathematical problem solving with the MATH dataset. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks.
- Sirui Hong, Mingchen Zhuge, Jiaqi Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, et al. 2024. MetaGPT: Meta programming for a multi-agent collaborative framework. In Proceedings of the 12th International Conference on Learning Representations (ICLR’24).
- Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, and Denny Zhou. 2024. Large language models cannot self-correct reasoning yet. In Proceedings of the 12th International Conference on Learning Representations (ICLR’24).
- Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. 2023. BLIP-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In Proceedings of the 40th International Conference on Machine Learning (ICML’23).
- Ansong Ni, Srini Iyer, Dragomir Radev, Ves Stoyanov, Wen-Tau Yih, Sida I. Wang, and Xi Victoria Lin. 2023. LEVER: Learning to verify language-to-code generation with execution. In Proceedings of the 40th International Conference on Machine Learning (ICML’23).
- Xuefei Ning, Zinan Lin, Zixuan Zhou, Zifu Wang, Huazhong Yang, and Yu Wang. 2023. Skeleton-of-thought: Large language models can do parallel decoding. In Proceedings of the Efficient Natural Language and Speech Processing Workshop (ENLSP-III).
- Maxwell Nye, Anders Johan Andreassen, Guy Gur-Ari, Henryk Michalewski, Jacob Austin, David Bieber, David Dohan, Aitor Lewkowycz, Maarten Bosma, David Luan, et al. 2022. Show your work: Scratchpads for intermediate computation with language models. In Proceedings of the Deep Learning for Code Workshop.
- 10.5555/3692070.3693649 · doi:10.5555/3692070.3693649
- Shuofei Qiao, Ningyu Zhang, Runnan Fang, Yujie Luo, Wangchunshu Zhou, Yuchen Eleanor Jiang, Huajun Chen, et al. 2024. AutoAct: Automatic agent learning from scratch for QA via self-planning. In Proceedings of the ICLR 2024 Workshop on Large Language Model (LLM) Agents.
- Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, et al. 2024. ToolLLM: Facilitating large language models to master 16000+ real-world APIs. In Proceedings of the 12th International Conference on Learning Representations (ICLR’24).
- Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning (ICML’21). 8748–8763.
- Phillip Rust, Jonas F. Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam de Lhoneux, and Desmond Elliott. 2023. Language modelling with pixels. In Proceedings of the 11th International Conference on Learning Representations (ICLR’23).
- Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, et al. 2023. Language models are multilingual chain-of-thought reasoners. In Proceedings of the 11th International Conference on Learning Representations (ICLR’23).
- Srinivas Sunkara, Maria Wang, Lijuan Liu, Gilles Baechler, Yu-Chung Hsiao, Jindong Chen, Abhanshu Sharma, and James W. W. Stout. 2022. Towards better semantic understanding of mobile interfaces. In Proceedings of the 29th International Conference on Computational Linguistics (COLING’22). 5636–5650.
- Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Steven Zheng, et al. 2022. UL2: Unifying language learning paradigms. In Proceedings of the 10th International Conference on Learning Representations (ICLR’22).
- XAgent Team. 2023. XAgent: An autonomous agent for complex task solving. XAgent Blog.
- Karthik Valmeekam, Matthew Marquez, and Subbarao Kambhampati. 2023. Investigating the effectiveness of self-critiquing in LLMs solving planning tasks. In Proceedings of the NeurIPS 2023 Foundation Models for Decision Making Workshop.
- Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2023. Self-consistency improves chain of thought reasoning in language models. In Proceedings of the 11th International Conference on Learning Representations (ICLR’23).
- David E. Wilkins. 2014. Practical Planning: Extending the Classical AI Planning Paradigm. Elsevier.
- Hongqiu Wu, Zekai Xu, Tianyang Xu, Jiale Hong, Weiqi Wu, Hai Zhao, Min Zhang, and Zhezhi He. 2024. Scaling virtual world with delta-engine. arXiv preprint arXiv:2408.05842 (2024). · arXiv
- Sang Michael Xie, Aditi Raghunathan, Percy Liang, and Tengyu Ma. 2022. An explanation of in-context learning as implicit Bayesian inference. In Proceedings of the 10th International Conference on Learning Representations (ICLR’22).
- Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik R. Narasimhan, and Yuan Cao. 2022. ReAct: Synergizing reasoning and acting in language models. In Proceedings of the 10th International Conference on Learning Representations (ICLR’22).
- Da Yin, Faeze Brahman, Abhilasha Ravichander, Khyathi Chandu, Kai-Wei Chang, Yejin Choi, and Bill Yuchen Lin. 2024. Lumos: Learning agents with unified data, modular design, and open-source LLMs. In Proceedings of the ICLR 2024 Workshop on Large Language Model (LLM) Agents.
- 10.5555/3692070.3694642 · doi:10.5555/3692070.3694642
- Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba. 2023. Large language models are human-level prompt engineers. In Proceedings of the 11th International Conference on Learning Representations (ICLR’23).
- Anni Zou, Zhuosheng Zhang, and Hai Zhao. 2024. AuRoRA: A one-for-all platform for augmented reasoning and refining with task-adaptive chain-of-thought prompting. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources, and Evaluation (LREC-COLING’24). 1801–1807.
Cited by
MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
Hong, S., Zhuge, M., Chen, J., Zheng, X., Cheng, Y., Zhang, C., Wang, J., Wang, Z., Yau, S. K. S., Lin, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.00352 · Cited by 2,825
AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103599 · Cited by 671
“Furthermore, while recent agent frameworks adopt reasoning heuristics like Chain-of-Thought (CoT) [163,193] and ReAct [136] to simulate deliberative processes, these approaches remain shallow in semantic comprehension.”
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Kalyan, K. S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100048 · Cited by 335
Empowering biomedical discovery with AI agents
Gao, S., Fang, A., Huang, Y., Giunchiglia, V., Noori, A., Schwarz, J. R., Ektefaie, Y., Kondic, J., & Zitnik, M. (2024) · Cell · doi:10.1016/j.cell.2024.09.022 · Cited by 315
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · arXiv · doi:10.48550/arxiv.2505.10468 · Cited by 295
Metadata
- Authors
- Zhang, Z., Yao, Y., Zhang, A., Tang, X., Ma, X., He, Z., Wang, Y., Gerstein, M., Wang, R., Liu, G., & Zhao, H.
- Affiliations
- Shanghai Jiao Tong University (CN)
- Amazon (United States) (US)
- Yale University (US)
- ORCID
- Venue
- ACM Computing Surveys
- Published
- 2025-03-22
- Volume
- 57
- Issue
- 8
- Pages
- 1-39
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4407922851
- Cited by
- 51
- References
- 118
- Citations by year
- 2026: 24 · 2025: 22
- FWCI
- 18.45
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (62406188)
- Joint Funds of the National Natural Science Foundation of China (U21B2020)
- Natural Science Foundation of Shanghai (24ZR1440300)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- chain-of-thought reasoning, large language models, language agents, autonomous agents, emergent reasoning, interpretability, controllability, generalization, agent safety, scaling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.