The rise and potential of large language model based agents: a survey
Open accessThe DOI matches its Crossref record; 704 of the 704 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“LLM-based agents couple large language models with planning, memory retrieval, tool invocation and execution, enabling temporally extended, partially autonomous collaboration [1-3].”
From Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaboration (2026) · cites this paper as [3]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“NoD adds a related lesson: operator assumptions about reachability, path selection, and service access must also be checked, since mismatches can expose policy gaps and security risks [52].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [52]
Experimental — accuracy not yet measuredIn the citing paper
“LLM-based autonomous agents can achieve greater flexibility and robustness by dividing labor among sub-agents [1,3].”
From A Review of Multi-Agent AI Systems for Biological and Clinical Data Analysis (2026) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 2×
“Deep neural networks have garnered significant attention for their remarkable performance across various tasks [69,183,538].”
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 4×
“Deep neural networks have garnered significant attention for their remarkable performance across various tasks [69,183,538].”
InfluentialArtificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 4×
“While agents have already excelled in pure competitive environments like chess [335], Go [50], and poker [391], LLM-based agents go further by devising unified cooperative strategies through effective negotiation and collaboration in more complex scenarios [392–395].”
InfluentialReceptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
The NIST definition of cloud computing
Mell, P. M., & Grance, T. (2011) · doi:10.6028/nist.sp.800-145 · Cited by 11,795
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 1×
“Deep neural networks have garnered significant attention for their remarkable performance across various tasks [69,183,538].”
Self-citationA New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle
Hamilton, J. D. (1989) · Econometrica · doi:10.2307/1912559 · Cited by 9,646 · cited 1×
“Unlike traditional empirical approaches that rely on time-series data and holistic modeling [451, 452], agent-based simulation provides researchers with a more interpretable and endogenous perspective.”
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084 · cited 1×
“AlphaGo Zero [336], for instance, is an agent for Go that achieved significant breakthroughs through a process of self-play.”
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972 · cited 2×
“…capabilities and data availability, along with a growing interest in simulating interactions between intelligent agents and their environments, researchers have begun to utilize reinforcement learning methods to train agents for tackling more challenging and complex tasks [11,12,44,45].”
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143 · cited 1×
“Adversarial robustness has consistently been a crucial topic in the development of deep neural networks [498–502].”
A robust layered control system for a mobile robot
Brooks, R. (1986) · IEEE Journal on Robotics and Automation · doi:10.1109/jra.1986.1087032 · Cited by 7,799 · cited 1×
“Instead, they primarily focus on the interaction between the agent and its environment, emphasizing quick and real-time responses [9,10,14,42,43].”
Intelligent agents: theory and practice
Wooldridge, M., & Jennings, N. R. (1995) · The Knowledge Engineering Review · doi:10.1017/s0269888900008122 · Cited by 6,810
Towards Deep Learning Models Resistant to Adversarial Attacks
Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2017) · arXiv · doi:10.48550/arxiv.1706.06083 · Cited by 6,602 · cited 2×
“It has been extensively explored in fields such as computer vision [500,503–505], natural language processing [506–509], and reinforcement learning [510–512], and has remained a pivotal factor in determining the applicability of deep learning systems [513–515].”
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,990
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 1×
“In addition, techniques like curriculum learning [240] can enhance the agent’s understanding of relationships between simple and complex tools, such as how complex tools are built on simpler ones and allow agents to effectively discern nuances across various application scenarios and transfer…”
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025 · cited 1×
“Additionally, language models are plagued by severe hallucination issues [544,545], making them prone to producing text that deviates from actual facts, thereby undermining the credibility of LLM-based agents.”
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving
Fikes, R. E., & Nilsson, N. J. (1971) · Artificial Intelligence · doi:10.1016/0004-3702(71)90010-5 · Cited by 4,882
Intelligence without representation
Brooks, R. A. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90053-m · Cited by 4,853
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602 · cited 1×
“LLMs show remarkable reasoning and decision-making abilities in complex interactive environments [78] and significant potential in intent understanding and other aspects [19,232–234].”
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Self-citationTime series forecasting using a hybrid ARIMA and neural network model
Zhang, G. P. (2003) · Neurocomputing · doi:10.1016/s0925-2312(01)00702-0 · Cited by 4,428 · cited 1×
“Unlike traditional empirical approaches that rely on time-series data and holistic modeling [451, 452], agent-based simulation provides researchers with a more interpretable and endogenous perspective.”
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263 · cited 7×
“This category encompasses activities such as planning [109], reasoning [76], reflection [72], and knowledge precipitation [89,332].”
InfluentialSelf-citationTraining language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208 · cited 6×
“Besides configurations and demonstrations, agents can also learn from feedback received from both the environment and humans [18, 237, 238].”
InfluentialLi, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202
Large language models in medicine
Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023) · Nature Medicine · doi:10.1038/s41591-023-02448-8 · Cited by 3,944 · cited 1×
“Professional domain knowledge refers to the knowledge associated with a specific domain like programming [124, 126, 127], mathematics [128], medicine [129], etc.”
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117 · cited 6×
“Besides configurations and demonstrations, agents can also learn from feedback received from both the environment and humans [18, 237, 238].”
InfluentialHuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Hsu, W.-N., Bolte, B., Tsai, Y.-H. H., Lakhotia, K., Salakhutdinov, R., & Mohamed, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3122291 · Cited by 2,983
Davidson, D. (1963) · The Journal of Philosophy · doi:10.2307/2023177 · Cited by 2,938
Explainable AI: a review of machine learning interpretability methods
Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020) · Entropy · doi:10.3390/e23010018 · Cited by 2,922 · cited 1×
“LLM-based agents have limitations because of hallucination [228], the lack of training data and tuning for specific fields [229], untransparent decision-making process [230] and susceptibility to adversarial attacks [231].”
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887 · cited 1×
“For instance, biased language models might generate discourse involving racial or gender discrimination, which could be amplified in LLM-based agent applications, resulting in adverse societal impacts [542, 543].”
MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
Hong, S., Zhuge, M., Chen, J., Zheng, X., Cheng, Y., Zhang, C., Wang, J., Wang, Z., Yau, S. K. S., Lin, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.00352 · Cited by 2,825 · cited 10×
“Without setting corresponding rules, frequent interactions among multiple agents can amplify minor hallucinations indefinitely [332].”
InfluentialSelf-citationOn the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationStanford Encyclopedia of Philosophy 2009: Building an Endowment with Community Support
Loy, M. (2015) · doi:10.18665/sr.22353 · Cited by 2,465
Computer science as empirical inquiry: symbols and search
Newell, A., & Simon, H. A. (1976) · Communications of the ACM · doi:10.1145/360018.360022 · Cited by 2,350 · cited 1×
“In the early stages of AI research, the predominant approach utilized is symbolic AI, characterized by its reliance on symbolic logic [36,37].”
Self-Refine: Iterative Refinement with Self-Feedback
Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., Alon, U., Dziri, N., Prabhumoye, S., Yang, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.17651 · Cited by 2,314
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187 · cited 10×
“However, these efforts have predominantly focused on enhancing specific skills (such as symbolic reasoning or quick responsiveness) or mastering particular tasks (such as Go or Chess) [13–15].”
InfluentialGenerative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.03442 · Cited by 2,173 · cited 10×
“However, these efforts have predominantly focused on enhancing specific skills (such as symbolic reasoning or quick responsiveness) or mastering particular tasks (such as Go or Chess) [13–15].”
InfluentialDon’t Stop Pretraining: Adapt Language Models to Domains and Tasks
Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.740 · Cited by 2,103
Large language models are zero-shot reasoners
Kojima, T., Gu, S. (., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1613 · Cited by 2,013 · cited 3×
“In contrast, other studies like the CoT-series employ an adaptive strategy, where they plan and address sub-tasks one at a time, allowing for more fluidity in handling intricate tasks in their entirety [76, 77, 166].”
Large Language Models are Zero-Shot Reasoners
Kojima, T., Gu, S. S., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · arXiv · doi:10.48550/arxiv.2205.11916 · Cited by 2,013 · cited 3×
“In contrast, other studies like the CoT-series employ an adaptive strategy, where they plan and address sub-tasks one at a time, allowing for more fluidity in handling intricate tasks in their entirety [76, 77, 166].”
Levine, S., Pastor, P., Krizhevsky, A., Ibarz, J., & Quillen, D. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364917710318 · Cited by 1,971 · cited 1×
“Besides configurations and demonstrations, agents can also learn from feedback received from both the environment and humans [18, 237, 238].”
Robust Speech Recognition via Large-Scale Weak Supervision
Radford, A., Kim, J. W., Xu, T., Brockman, G., McLeavey, C., & Sutskever, I. (2022) · arXiv · doi:10.48550/arxiv.2212.04356 · Cited by 1,953 · cited 1×
“Apart from the cascading paradigm [218, 219, 269], audio information encoding can also enhance the seamless integration of audio with other modalities of inputs [222].”
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941 · cited 2×
“Effectively and objectively evaluating LLMs agents presents significant challenges, despite their excellent performance in areas such as standalone operation, collective cooperation, and human interaction [70,484].”
A Survey on Large Language Model based Autonomous Agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.11432 · Cited by 1,925 · cited 2×
“Effectively and objectively evaluating LLMs agents presents significant challenges, despite their excellent performance in areas such as standalone operation, collective cooperation, and human interaction [70,484].”
Proceedings for the 5th International Conference on Learning Representations
Srivastava, A., & Sutton, C. A. (2017) · Cited by 1,837
Psychology of Reasoning: Structure and Content
Wason, P. C., & Johnson-Laird, P. N. (1972) · Medical Entomology and Zoology · Cited by 1,784
Steps toward Artificial Intelligence
Minsky, M. (1961) · Proceedings of the IRE · doi:10.1109/jrproc.1961.287775 · Cited by 1,675
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 1×
“For instance, biased language models might generate discourse involving racial or gender discrimination, which could be amplified in LLM-based agent applications, resulting in adverse societal impacts [542, 543].”
Theoretically principled trade-off between robustness and accuracy
Zhang, H., Yu, Y., Jiao, J., Xing, E. P., Ghaoui, L. E., & Jordan, M. I. (2019) · arXiv · doi:10.48550/arxiv.1901.08573 · Cited by 1,560 · cited 1×
“However, devising a strategy to holistically address the robustness of all modules within agents while maintaining their utility without compromising on effectiveness presents a more formidable challenge [533, 534].”
Brooks, R. A. (2018) · The Artificial Life Route to Artificial Intelligence · doi:10.4324/9781351001885-2 · Cited by 1,548
Sparks of Artificial General Intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.12712 · Cited by 1,526
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Wason, P. C. (1968) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640746808400161 · Cited by 1,476 · cited 1×
“Reasoning, crucial in human intellectual activities for problem-solving, decision-making, and critical analysis, is underpinned by evidence and logic [145–147].”
Expel: LLM agents are experiential learners
Zhao, A., Huang, D., Xu, Q., Lin, M., Liu, Y.-J., & Huang, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29936 · Cited by 1,451
Scaling Instruction-Finetuned Language Models
Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.11416 · Cited by 1,441
Self-citationEvaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436 · cited 1×
“Previous studies showed that LLM-based agents not only have the ability to generalize the use of existing tools, but can also make new tools they need by generating executable programs, or integrating existing tools into more powerful ones [75,241,242].”
Vinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400
Unifying Large Language Models and Knowledge Graphs: A Roadmap
Pan, S., Luo, L., Wang, Y., Chen, C., Wang, J., & Wu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3352100 · Cited by 1,376 · cited 1×
“For example, search-based tools can improve the scope and quality of the knowledge accessible to the agents with the aid of external databases, knowledge graphs, and web pages, while domain-specific tools can enhance an agent’s expertise in the corresponding field [243,244].”
Self-citationComputing Machinery and Intelligence
Turing, A. M. (2009) · Parsing the Turing Test · doi:10.1007/978-1-4020-6710-5_3 · Cited by 1,367
Logothetis, N. K., & Sheinberg, D. L. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.003045 · Cited by 1,351 · cited 1×
“These perceptual inputs are converted into neural signals and sent to the brain for processing [195, 196], allowing humans to perceive and interact with the world.”
Squire, L. R. (1986) · Science · doi:10.1126/science.3086978 · Cited by 1,278
Emergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264 · cited 4×
“For LLMs, the reasoning ability is considered an emergent ability, i.e., such an ability emerges once the language model reaches a certain scale in size [20,149].”
InfluentialMeshed-Memory Transformer for Image Captioning
Cornia, M., Stefanini, M., Baraldi, L., & Cucchiara, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01059 · Cited by 1,259
Self-Instruct: Aligning Language Models with Self-Generated Instructions
Wang, Y., Kordi, Y., Mishra, S., Liu, A., Smith, N. A., Khashabi, D., & Hajishirzi, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.754 · Cited by 1,243
Habitat: A Platform for Embodied AI Research
Savva, M., Kadian, A., Maksymets, O., Zhao, Y., Wijmans, E., Jain, B., Straub, J., Liu, J., Koltun, V., Malik, J., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00943 · Cited by 1,237 · cited 1×
“Different from the majority of RL algorithms [82,257–259], fine-tuned by tasks in diverse forms and types, LLMs have showcased remarkable cross-task generalization capabilities [260,261].”
Campbell, M., Hoane, A. J., & Hsu, F.-H. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(01)00129-1 · Cited by 1,226
Improving Factuality and Reasoning in Language Models through Multiagent Debate
Du, Y., Li, S., Torralba, A., Tenenbaum, J. B., & Mordatch, I. (2023) · arXiv · doi:10.48550/arxiv.2305.14325 · Cited by 1,202 · cited 5×
“For example, Du et al. [92] introduced the concept of debate, endowing agents with responses from fellow peers.”
InfluentialOn Faithfulness and Factuality in Abstractive Summarization
Maynez, J., Narayan, S., Bohnet, B., & McDonald, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.173 · Cited by 1,185
On Faithfulness and Factuality in Abstractive Summarization
Maynez, J., Narayan, S., Bohnet, B., & McDonald, R. (2020) · arXiv · doi:10.48550/arxiv.2005.00661 · Cited by 1,185
The role of emotion in believable agents
Bates, J. (1994) · Communications of the ACM · doi:10.1145/176789.176803 · Cited by 1,177 · cited 1×
“Bates et al. [424] explored the role of emotion modeling in creating more believable agents.”
Personalizing Dialogue Agents: I have a dog, do you have pets too?
Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., & Weston, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1205 · Cited by 1,177
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingPreprint
Zhang, H., Li, X. S., & Bing, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.02858 · Cited by 1,172
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023) · arXiv · doi:10.48550/arxiv.2305.10601 · Cited by 1,158 · cited 1×
“The latter approach argues that agents should assess all possible paths before finalizing a plan [78, 169–171].”
Planning in a hierarchy of abstraction spaces
Sacerdoti, E. D. (1974) · Artificial Intelligence · doi:10.1016/0004-3702(74)90026-5 · Cited by 1,155 · cited 1×
“They possess explicit and interpretable reasoning frameworks, and due to their symbolic nature, they exhibit a high degree of expressive capability [7,8,40].”
Toolformer: Language Models Can Teach Themselves to Use Tools
Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Zettlemoyer, L., Cancedda, N., & Scialom, T. (2023) · arXiv · doi:10.48550/arxiv.2302.04761 · Cited by 1,150
Plans and resource‐bounded practical reasoning
Bratman, M. E., Israel, D. J., & Pollack, M. E. (1988) · Computational Intelligence · doi:10.1111/j.1467-8640.1988.tb00284.x · Cited by 1,136 · cited 1×
“Similar to humans, the ability to plan is crucial for agents, and central to this planning module is the capacity for reasoning [158–160].”
Finetuned Language Models Are Zero-Shot Learners
Wei, J., Bosma, M., Zhao, V. Y., Guu, K., Yu, A. W., Lester, B., Du, N., Dai, A. M., & Le, Q. V. (2021) · arXiv · doi:10.48550/arxiv.2109.01652 · Cited by 1,101
Genesereth, M. R., & Ketchpel, S. P. (1994) · Communications of the ACM · doi:10.1145/176789.176794 · Cited by 1,092
Attention on Attention for Image Captioning
Huang, L., Wang, W., Chen, J., & Wei, X.-Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00473 · Cited by 1,092 · cited 1×
“To help the agent understand the information contained within images, a straightforward approach is to generate corresponding text descriptions for image inputs, known as image captioning [203–207].”
Self-citationLee, L.-H., Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2021) · arXiv · doi:10.48550/arxiv.2110.05352 · Cited by 1,088 · cited 1×
“Behind each individual can be a piece of program, a real human, or an LLM-based agent as described in the previous sections [16, 400, 401].”
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087
Grounded Language-Image Pre-training
Li, L. H., Zhang, P., Zhang, H., Yang, J., Li, C., Zhong, Y., Wang, L., Yuan, L., Zhang, L., Hwang, J.-N., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01069 · Cited by 1,086 · cited 1×
“A memory mechanism is needed to record historical information [277], which is also adopted in Smallville and Voyager [16, 177,278, 279].”
Lee, L.-H., Braud, T., Zhou, P. Y., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2024) · Foundations and Trends® in Human-Computer Interaction · doi:10.1561/1100000095 · Cited by 1,082
Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate
Liang, T., He, Z., Jiao, W., Wang, X., Wang, Y., Wang, R., Yang, Y., Shi, S., & Tu, Z. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.992 · Cited by 1,062
Self-citationBadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain
Gu, T., Dolan-Gavitt, B., & Garg, S. (2017) · arXiv · doi:10.48550/arxiv.1708.06733 · Cited by 1,061 · cited 1×
“There are also some relevant attack methods such as dataset poisoning [520], backdoor attacks [521,522], and prompt-specific attacks [523,524], with the potential to induce LLMs to generate toxic content [525–527].”
Becoming Modern: Individual Change in Six Developing Countries
Inkeles, A., & Smith, D. H. (1974) · Harvard University Press eBooks · doi:10.4159/harvard.9780674499348 · Cited by 1,059
Deep reinforcement learning from human preferences
Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv · doi:10.48550/arxiv.1706.03741 · Cited by 1,058 · cited 1×
“For example, some studies [113, 198–200] employed reinforcement learning to perceive implied meanings and models feedback to derive rewards.”
Language (Technology) is Power: A Critical Survey of “Bias” in NLP
Blodgett, S. L., Barocas, S., Daumé III, H., & Wallach, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.485 · Cited by 1,050 · cited 1×
“Moreover, biases inherent in training data can infiltrate neural networks [540, 541].”
Autonomous chemical research with large language models
Boiko, D. A., MacKnight, R., Kline, B., & Gomes, G. (2023) · Nature · doi:10.1038/s41586-023-06792-0 · Cited by 1,050
Dorri, A., Kanhere, S. S., & Jurdak, R. (2018) · IEEE Access · doi:10.1109/access.2018.2831228 · Cited by 1,043
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsPreprint
Yu, L., Jiang, W., Shi, H., Yu, J., Liu, Z., Zhang, Y., Kwok, J. T.-Y., Li, Z., Weller, A., & Liu, W. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.12284 · Cited by 1,028 · cited 1×
“To further improve the reasoning ability of LLMs or LLM-based agents, current research primarily explores supervised fine-tuning (SFT) methods [152] and interactive training approaches [153,154].”
How Can We Know What Language Models Know?
Jiang, Z., Xu, F. F., Araki, J., & Neubig, G. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00324 · Cited by 1,002
Flamingo: a visual language model for few-shot learning
Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1723 · Cited by 966
Theory of Games and Economic Behavior
Leonard, R. J. (2006) · History of Political Economy · doi:10.1215/00182702-38-1-189 · Cited by 940 · cited 1×
“However, researchers increasingly recognize that introducing concepts from game theory [333, 334] into systems can lead to more robust and efficient behaviors.”
Jin, D., Jin, Z., Zhou, J. T., & Szolovits, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6311 · Cited by 918 · cited 1×
“Researchers have found that pre-trained language models (PLMs) are particularly susceptible to adversarial attacks, leading to erroneous answers [507,516,517].”
(2022) · doi:10.15607/rss.2023.xix.025 · Cited by 916
Li, J., Li, D., Savarese, S., & Hoi, S. (2023) · arXiv · doi:10.48550/arxiv.2301.12597 · Cited by 908 · cited 2×
“For example, BLIP-2 [211] and InstructBLIP [212] use the querying transformer (Q-Former) module as an intermediate layer between the visual encoder and the LLM [212].”
Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
(2024) · doi:10.1145/3613904 · Cited by 896
A survey on multimodal large language models
Yin, S., Fu, C., Zhao, S., Li, K., Sun, X., Xu, T., & Chen, E. (2024) · National Science Review · doi:10.1093/nsr/nwae403 · Cited by 893
Transfer Learning in Deep Reinforcement Learning: A Survey
Zhu, Z., Lin, K., Jain, A. K., & Zhou, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3292075 · Cited by 861 · cited 1×
“Consequently, researchers introduce transfer learning to expedite an agent’s learning on new tasks [57–59].”
The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation
Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., Filar, B., et al. (2018) · Apollo - University of Cambridge Repository · doi:10.17863/cam.22520 · Cited by 849
The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation
Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., Filar, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1802.07228 · Cited by 849
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2023) · arXiv · doi:10.48550/arxiv.2305.03514 · Cited by 839
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2203.11171 · Cited by 829
Self-citationTeaching Large Language Models to Self-Debug
Chen, X., Lin, M., Schärli, N., & Zhou, D. (2023) · arXiv · doi:10.48550/arxiv.2304.05128 · Cited by 812
Maes, P. (1990) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(05)80024-7 · Cited by 799 · cited 1×
“Instead, they primarily focus on the interaction between the agent and its environment, emphasizing quick and real-time responses [9,10,14,42,43].”
Cognitive Architectures for Language Agents
Sumers, T. R., Yao, S., Narasimhan, K., & Griffiths, T. L. (2023) · arXiv · doi:10.48550/arxiv.2309.02427 · Cited by 798
Augmenting large language models with chemistry tools
M. Bran, A., Cox, S., Schilter, O., Baldassari, C., White, A. D., & Schwaller, P. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00832-8 · Cited by 794
DeepStack: Expert-level artificial intelligence in heads-up no-limit poker
Moravčík, M., Schmid, M., Burch, N., Lisý, V., Morrill, D., Bard, N., Davis, T., Waugh, K., Johanson, M., & Bowling, M. (2017) · Science · doi:10.1126/science.aam6960 · Cited by 786
Recipes for Building an Open-Domain Chatbot
Roller, S., Dinan, E., Goyal, N., Ju, D., Williamson, M., Liu, Y., Xu, J., Ott, M., Smith, E. M., Boureau, Y.-L., et al. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.24 · Cited by 784
Recipes for building an open-domain chatbot
Roller, S., Dinan, E., Goyal, N., Ju, D., Williamson, M., Liu, Y., Xu, J., Ott, M., Shuster, K., Smith, E. M., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.13637 · Cited by 784 · cited 1×
“LLM-based agents have limitations because of hallucination [228], the lack of training data and tuning for specific fields [229], untransparent decision-making process [230] and susceptibility to adversarial attacks [231].”
Cellular automata models for the simulation of real-world urban processes: A review and analysis
Santé, I., García, A. M., Miranda, D., & Crecente, R. (2010) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2010.03.001 · Cited by 779 · cited 1×
“While micro-level simulation, also known as agent-based simulation or MAS, indirectly simulates society by modeling individuals [446, 447].”
Code as Policies: Language Model Programs for Embodied Control
Liang, J., Huang, W., Xia, F., Xu, P., Hausman, K., Ichter, B., Florence, P., & Zeng, A. (2022) · arXiv · doi:10.48550/arxiv.2209.07753 · Cited by 767 · cited 1×
“Further, natural language serves both as a means to interact with the environment and as a medium for transferring foundational skills to new tasks [262].”
Code as Policies: Language Model Programs for Embodied Control
Liang, J., Huang, W., Xia, F., Xu, P., Hausman, K., Ichter, B., Florence, P., & Zeng, A. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10160591 · Cited by 767 · cited 1×
“Further, natural language serves both as a means to interact with the environment and as a medium for transferring foundational skills to new tasks [262].”
Temporal Difference Learning and TD-Gammon
Tesauro, G. (1995) · ICGA Journal · doi:10.3233/icg-1995-18207 · Cited by 764
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Evaluating large language models trained on code
Chen, M. (2024) · TIB Data Manager · doi:10.57702/wbv3e61b · Cited by 737
RT-1: Robotics Transformer for Real-World Control at Scale
Brohan, A., Brown, N., Carbajal, J., Chebotar, Y., Dabis, J., Finn, C., Gopalakrishnan, K., Hausman, K., Herzog, A., Hsu, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.06817 · Cited by 727 · cited 1×
“…on particular embodied datasets typically generate high-level policy commands to control low-level policies [163] like a robotic transformer [101, 281, 282], which takes images and instructions as inputs and produces control commands for the end effector and robotic arms as well as virtual…”
Wang, Z., Cai, S., Chen, G., Liu, A., Ma, X. (., & Liang, Y. (2023) · neural information processing systems · doi:10.52202/075280-1480 · Cited by 726
ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate
Chan, C.-M., Chen, W., Su, Y., Yu, J., Xue, W., Zhang, S., Fu, J., & Liu, Z. (2023) · arXiv · doi:10.48550/arxiv.2308.07201 · Cited by 725 · cited 4×
“An example is cooperation, which is achieved through volunteer behaviors [330], brainstorming discussions [327, 340], and project management [332].”
InfluentialSelf-citationX-Linear Attention Networks for Image Captioning
Pan, Y., Yao, T., Li, Y., & Mei, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01098 · Cited by 720
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
Kalashnikov, D., Irpan, A., Pastor, P., Ibarz, J., Herzog, A., Jang, E., Quillen, D., Holly, E., Kalakrishnan, M., Vanhoucke, V., et al. (2018) · arXiv · doi:10.48550/arxiv.1806.10293 · Cited by 697 · cited 1×
“Despite the extensive success of RL-based embodiment [50, 51, 251], it does have certain limitations in some aspects.”
Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., Lovenia, H., Ji, Z., Yu, T., Chung, W., et al. (2023) · Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.ijcnlp-main.45 · Cited by 682 · cited 2×
“Recently, the rise and development of Transformer-based generative LLMs have endowed LLM-based agents with inherent language generation capabilities [19,224].”
Liu, H., Li, C., Wu, Q., & Lee, Y. J. (2023) · arXiv · doi:10.48550/arxiv.2304.08485 · Cited by 682
Do the Right Thing: Studies in Limited Rationality
Russell, S., Wefald, E. H., Bobrow, D. G., Brady, M., & Davis, R. (1991) · The MIT Press eBooks · doi:10.7551/mitpress/2474.001.0001 · Cited by 655 · cited 1×
“Additionally, due to the intricacies of symbolic reasoning algorithms, it is challenging to find an efficient algorithm capable of producing meaningful results within a finite timeframe [14,41].”
Challenges of real-world reinforcement learning: definitions, benchmarks and analysis
Dulac-Arnold, G., Levine, N., Mankowitz, D. J., Li, J., Paduraru, C., Gowal, S., & Hester, T. (2021) · Machine Learning · doi:10.1007/s10994-021-05961-4 · Cited by 645
Rapp, A., Curti, L., & Boldi, A. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102630 · Cited by 643
StereoSet: Measuring stereotypical bias in pretrained language models
Nadeem, M., Bethke, A., & Reddy, S. (2020) · arXiv · doi:10.48550/arxiv.2004.09456 · Cited by 643 · cited 1×
“A large part of the reason lies in the training corpora obtained from the Internet [463,464], which reflect, and sometimes even amplify real-world social biases such as gender, religion, and culture [465].”
How Much Knowledge Can You Pack into the Parameters of a Language Model?
Roberts, A., Raffel, C., & Shazeer, N. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.437 · Cited by 638
Generating Natural Language Adversarial Examples through Probability Weighted Word Saliency
Ren, S., Deng, Y., He, K., & Che, W. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1103 · Cited by 635 · cited 1×
“Researchers have found that pre-trained language models (PLMs) are particularly susceptible to adversarial attacks, leading to erroneous answers [507,516,517].”
LeanDojo: Theorem Proving with Retrieval-Augmented Language ModelsPreprint
Yang, K., Swope, A. M., Gu, A., et al. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2306.15626 · Cited by 635 · cited 1×
“Currently, numerous efforts in various specialized domains aim to overcome this challenge [308–310].”
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Ahn, M., Brohan, A., Brown, N., Chebotar, Y., Cortes, O., David, B., Finn, C., Fu, C., Gopalakrishnan, K., Hausman, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.01691 · Cited by 624 · cited 5×
“SayCan [163] decomposes task instructions presented in prompts using LLMs into corresponding skill commands, but in partially observable environments, limited prior skills often do not achieve satisfactory performance [82].”
InfluentialFantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Lu, Y., Bartolo, M., Moore, A., Riedel, S., & Stenetorp, P. (2021) · arXiv · doi:10.48550/arxiv.2104.08786 · Cited by 615 · cited 1×
“Besides, since the prompts are written in natural language, the interaction is interpretable and changeable, making it easier to incorporate human knowledge [76, 188].”
Towards a Human-like Open-Domain Chatbot
Adiwardana, D., Luong, M.-T., So, D. R., Hall, J., Fiedel, N., Thoppilan, R., Yang, Z., Kulshreshtha, A., Nemade, G., Lu, Y., et al. (2020) · arXiv · doi:10.48550/arxiv.2001.09977 · Cited by 614
Multitask Prompted Training Enables Zero-Shot Task Generalization
Sanh, V., Webson, A., Raffel, C., Bach, S. H., Sutawika, L., Alyafeai, Z., Chaffin, A., Stiegler, A., Scao, T. L., Raja, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2110.08207 · Cited by 612 · cited 3×
“One of the implementations is multi-task learning, for example, FLAN [86] finetunes language models on a collection of tasks described via instructions, and T0 [87] introduces a unified framework that converts every language problem into a text-to-text format.”
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Lu, Y., Bartolo, M., Moore, A., Riedel, S., & Stenetorp, P. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.556 · Cited by 610 · cited 1×
“Besides, since the prompts are written in natural language, the interaction is interpretable and changeable, making it easier to incorporate human knowledge [76, 188].”
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608 · cited 3×
“This category encompasses activities such as planning [109], reasoning [76], reflection [72], and knowledge precipitation [89,332].”
(2019) · doi:10.18653/v1/n19-1419 · Cited by 601
The Development of Embodied Cognition: Six Lessons from Babies
Smith, L., & Gasser, M. (2005) · Artificial Life · doi:10.1162/1064546053278973 · Cited by 597
PaLM-E: An Embodied Multimodal Language Model
Driess, D., Xia, F., Sajjadi, M. S. M., Lynch, C., Chowdhery, A., Ichter, B., Wahid, A., Tompson, J., Vuong, Q., Yu, T., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.03378 · Cited by 591 · cited 10×
“This includes perceiving sensory stimuli [101] and storing them as memories [138].”
InfluentialVideo-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Zhang, H., Li, X., & Bing, L. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2023.emnlp-demo.49 · Cited by 586
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024) · Computational Linguistics · doi:10.1162/coli_a_00502 · Cited by 585
MedAgents: Large Language Models as Collaborators for Zero-shot Medical ReasoningPreprint
Tang, X., Zou, A.-N., Zhang, Z., Li, Z.-M., Zhao, Y., Zhang, X., Cohan, A., & Gerstein, M. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2311.10537 · Cited by 585 · cited 1×
“In MedAgents [550], the authors enhance the reasoning ability of LLMs in the medical field through role-playing and multi-turn interactions, generating more reliable responses.”
Training Verifiers to Solve Math Word Problems
Cobbe, K., Kosaraju, V., Bavarian, M., Chen, M., Jun, H., Kaiser, L., Plappert, M., Tworek, J., Hilton, J., Nakano, R., et al. (2021) · arXiv · doi:10.48550/arxiv.2110.14168 · Cited by 575
Learning Distributed Representations of Sentences from Unlabelled Data
Hill, F., Cho, K., & Korhonen, A. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1162 · Cited by 566 · cited 1×
“LLMs are typically imbued with large-scale data through semi-supervised learning during the pre-training phase [118,119].”
CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
Gou, Z., Shao, Z., Gong, Y., Shen, Y., Yang, Y., Duan, N., & Chen, W. (2023) · arXiv · doi:10.48550/arxiv.2305.11738 · Cited by 561
Self-citationFastSpeech: Fast, Robust and Controllable Text to Speech
Ren, Y., Ruan, Y., Tan, X., Qin, T., Zhao, S., Zhao, Z. L., & Liu, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09263 · Cited by 559
Using cognitive psychology to understand GPT-3
Binz, M., & Schulz, E. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2218523120 · Cited by 559 · cited 2×
“They conducted psychology experiments about judgment and decision-making to test agent systems [413, 414, 416, 417].”
TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP
Morris, J., Lifland, E., Yoo, J. Y., Grigsby, J., Jin, D., & Qi, Y. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.16 · Cited by 556 · cited 1×
“To address these issues, researchers can employ traditional techniques such as adversarial training [500, 508], adversarial data augmentation [529,530], and adversarial sample detection [531,532] to enhance the robustness of LLM-based agents.”
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
Zhang, Y., Li, Y., Cui, L., Cai, D., Liu, L., Fu, T., Huang, X., Zhao, E., Zhang, Y., Xu, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.01219 · Cited by 544
Self-citationA systematic evaluation of large language models of code
Xu, F. F., Alon, U., Neubig, G., & Hellendoorn, V. J. (2022) · Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming · doi:10.1145/3520312.3534862 · Cited by 540
Developing Intelligent Agent Systems: A Practical Guide
Padgham, L., & Winikoff, M. (2004) · RMIT Research Repository (RMIT University Library) · Cited by 538
Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsPreprint
Lu, P., Peng, B., Cheng, H., Galley, M., Chang, K.-W., Wu, Y., Zhu, S.-C., & Gao, J.-F. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2304.09842 · Cited by 537
Huang, X., Kroening, D., Ruan, W., Sharp, J., Sun, Y., Thamo, E., Wu, M., & Yi, X. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100270 · Cited by 532
Self-citationSituated agents can have goals
Maes, P. (1990) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(05)80028-4 · Cited by 525
Practical Planning: Extending the Classical AI Planning Paradigm
Wilkins, D. E. (1988) · CERN Document Server (European Organization for Nuclear Research) · Cited by 518
Robust adversarial reinforcement learning
Pinto, L., Davidson, J., Sukthankar, R., & Gupta, A. (2017) · arXiv · doi:10.48550/arxiv.1703.02702 · Cited by 507 · cited 1×
“It has been extensively explored in fields such as computer vision [500,503–505], natural language processing [506–509], and reinforcement learning [510–512], and has remained a pivotal factor in determining the applicability of deep learning systems [513–515].”
RL$^2$: Fast Reinforcement Learning via Slow Reinforcement Learning
Duan, Y., Schulman, J., Chen, X., Bartlett, P. L., Sutskever, I., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1611.02779 · Cited by 503 · cited 1×
“Furthermore, meta learning has also been introduced to develop agents [60–64].”
Defining Agency: Individuality, Normativity, Asymmetry, and Spatio-temporality in Action
Barandiaran, X. E., Di Paolo, E., & Rohde, M. (2009) · Adaptive Behavior · doi:10.1177/1059712309343819 · Cited by 497 · cited 1×
“These years, plenty of research indicates that pre-trained models can learn universal language representations [181–183], and with only a small amount of data for fine-tuning, it can demonstrate excellent performance in downstream tasks [184].”
Wu, T., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517582 · Cited by 483 · cited 2×
“Of course, the collaborative nature of human-agent interaction also allows humans to directly improve the agents’ output by modifying intermediate links [176, 362] or adjusting the conversation content [363].”
Holistic Evaluation of Language Models
Bommasani, R., Liang, P., & Lee, T. (2023) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.15007 · Cited by 480 · cited 1×
“There are also some relevant attack methods such as dataset poisoning [520], backdoor attacks [521,522], and prompt-specific attacks [523,524], with the potential to induce LLMs to generate toxic content [525–527].”
Ethical and social risks of harm from Language Models
Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04359 · Cited by 477
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Shen, Y., Song, K., Tan, X., Li, D., Lu, W., & Zhuang, Y. (2023) · arXiv · doi:10.48550/arxiv.2303.17580 · Cited by 477
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
Zhu, D., Chen, J., Shen, X., Li, X., & Elhoseiny, M. (2023) · arXiv · doi:10.48550/arxiv.2304.10592 · Cited by 469 · cited 2×
“At the same time, some researchers adopt a computationally efficient method using a single projection layer to achieve visual-text alignment, reducing the need for training additional parameters [99,210,213].”
Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)
O'Grady, J., Gürhan, A. I., Chee, F. T., & Ramlan, E. I. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.23236017 · Cited by 462
Should Machines Express Sympathy and Empathy? Experiments with a Health Advice Chatbot
Liu, B., & Sundar, S. S. (2018) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2018.0110 · Cited by 447
Innateness and culture in the evolution of language
Kirby, S., Dowman, M., & Griffiths, T. L. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0608222104 · Cited by 442
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Bai, Y., Jones, A., Ndousse, K., Askell, A., Chen, A., DasSarma, N., Drain, D., Fort, S., Ganguli, D., Henighan, T., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.05862 · Cited by 442
Liu-Thompkins, Y., Okazaki, S., & Li, H. (2022) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-022-00892-5 · Cited by 441 · cited 1×
“These studies, viewing agents as empathetic communicators, not only enhance user satisfaction but also make significant progress in fields like healthcare [373, 374, 387] and business marketing [388].”
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models
Song, C. H., Sadler, B. M., Wu, J., Chao, W.-L., Washington, C., & Su, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00280 · Cited by 435
Towards Reasoning in Large Language Models: A Survey
Huang, J., & Chang, K. C.-C. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.67 · Cited by 428
Towards Reasoning in Large Language Models: A Survey
Huang, J., & Chang, K. C.-C. (2022) · arXiv · doi:10.48550/arxiv.2212.10403 · Cited by 428
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models
Maaz, M., Rasheed, H., Khan, S., & Khan, F. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.679 · Cited by 424
A Survey of Embodied AI: From Simulators to Research Tasks
Duan, J., Yu, S., Tan, H. L., Zhu, H., & Tan, C. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3141105 · Cited by 420
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
Dai, W., Li, J., Li, D., Tiong, A. M. H., Zhao, J., Wang, W., Li, B., Fung, P., & Hoi, S. C. H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.06500 · Cited by 407 · cited 1×
“For example, BLIP-2 [211] and InstructBLIP [212] use the querying transformer (Q-Former) module as an intermediate layer between the visual encoder and the LLM [212].”
Self-citationEmergent analogical reasoning in large language models
Webb, T., Holyoak, K. J., & Lu, H. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01659-w · Cited by 404
Artificial life meets entertainment: lifelike autonomous agents
Maes, P. (1995) · Communications of the ACM · doi:10.1145/219717.219808 · Cited by 400
Précis of The Intentional Stance
Dennett, D. C. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00058611 · Cited by 398
Visual Prompting Via Image Inpainting
Bar, A., Gandelsman, Y., Darrell, T., Globerson, A., & Efros, A. A. (2022) · neural information processing systems · doi:10.52202/068431-1813 · Cited by 394
Zuckerman, M. (1991) · International Clinical Psychopharmacology · doi:10.1097/00004850-199100640-00009 · Cited by 388
Speech Analysis Synthesis and Perception
Flanagan, J. L. (1965) · Springer eBooks · doi:10.1007/978-3-662-00849-2 · Cited by 387 · cited 1×
“Furthermore, an audio spectrogram can serve as a medium to endow LLM-based agents with auditory capabilities, as it offers a clear representation of how the frequency spectrum of an audio signal evolves over time [221].”
Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
Zhou, D., Schärli, N., Hou, L., Wei, J., Scales, N., Wang, X., Schuurmans, D., Cui, C., Bousquet, O., Le, Q., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.10625 · Cited by 380
Self-citationVirtualHome: Simulating Household Activities Via Programs
Puig, X., Ra, K., Boben, M., Li, J., Wang, T., Fidler, S., & Torralba, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00886 · Cited by 378
OpenAGI: When LLM Meets Domain ExpertsPreprint
Ge, Y.-Q., Hua, W.-Y., Mei, K., et al. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2304.04370 · Cited by 378 · cited 1×
“For example, search-based tools can improve the scope and quality of the knowledge accessible to the agents with the aid of external databases, knowledge graphs, and web pages, while domain-specific tools can enhance an agent’s expertise in the corresponding field [243,244].”
Research works printed but not linked: 44
- Russell S. Artificial Intelligence: A Modern Approach. Upper Saddle River: Pearson Education, Inc., 2020
- Schlosser M. Agency. In: The Stanford Encyclopedia of Philosophy. Stanford: The Metaphysics Research Lab, 2019
- Hutter M. Universal Artificial Intelligence: Sequential Decisions Based on Algorithmic Probability. Berlin: Springer, 2004
- Anscombe G E M. Intention. Cambridge: Harvard University Press, 2000
- Nilsson N J. Toward Agent Programs With Circuit Semantics. Technical Report, No. STAN-CS-92-1412, 1992
- Shardlow N. Action and agency in cognitive science. Dissertation for Master’s Degree. Oxford: University of Manchester, 1990
- Sacerdoti E D. The nonlinear nature of plans. In: Proceedings of Advance Papers of the Fourth International Joint Conference on Artificial Intelligence, Tbilisi, 1975. 206–214
- Taylor M E, Stone P. Transfer learning for reinforcement learning domains: a survey. J Mach Learn Res, 2009, 10: 1633–1685
- Liu H, Sferrazza C, Abbeel P. Languages are rewards: hindsight finetuning using human feedback. 2023. ArXiv:2302.02676 · arXiv
- Darwin C. On the Origin of Species: Facsimile of the First Edition. London: John Murray, 1859. 24: 1
- Nuxoll A M, Laird J E. Extending cognitive architecture with episodic memory. In: Proceedings of AAAI, 2007. 1560–1564
- Shinn N, Labash B, Gopinath A. Reflexion: an autonomous agent with dynamic memory and self-reflection. 2023. ArXiv:2303.11366 · arXiv
- Sebastia L, Onaindia E, Marzal E. Decomposition of planning problems. AI Commun, 2006, 19: 49–81
- Solaiman I, Dennison C. Process for adapting language models to society (PALMS) with values-targeted datasets. In: Proceedings of Advances in Neural Information Processing Systems, 2021. 34: 5861–5873
- Gong Y, Chung Y, Glass J R. AST: audio spectrogram transformer. In: Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Brno, 2021. 571–575
- Almazrouei E, Alobeidli H, Alshamsi A, et al. Falcon-40B: an open large language model with state-of-the-art performance. 2023. https://falconllm.tii.ae
- Radford A, Wu J, Child R, et al. Language models are unsupervised multitask learners. OpenAI blog, 2019, 1: 9
- Nguyen H, La H M. Review of deep reinforcement learning for robot manipulation. In: Proceedings of the 3rd IEEE International Conference on Robotic Computing, Naples, 2019. 590–595
- Finin T W, Fritzson R, McKay D P, et al. KQML as an agent communication language. In: Proceedings of the 3rd International Conference on Information and Knowledge Management (CIKM’94), Gaithersburg, 1994. 456–463
- Weston J. Dialog-based language learning. In: Proceedings of Advances in Neural Information Processing Systems, 2016. 829–837
- Kreutzer J, Khadivi S, Matusov E, et al. Can neural machine translation be improved with user feedback? In: Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018. 92–105
- Mehta N, Goldwasser D. Improving natural language interaction with robots using advice. In: Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, 2019. 1962–1967
- Hancock B, Bordes A, Mazare P, et al. Learning from dialogue after deployment: feed yourself, chatbot! In: Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019. 3667–3684
- Gvirsman O, Koren Y, Norman T, et al. Patricc: a platform for triadic interaction with changeable characters. In: Proceedings of ACM/IEEE International Conference on Human-Robot Interaction, Cambridge, 2020. 399–407
- Gao W, Gao X, Tang Y. Multi-turn dialogue agent as sales’ assistant in telemarketing. In: Proceedings of International Joint Conference on Neural Networks, Gold Coast, 2023. 1–9
- Adamopoulou E, Moussiades L. Chatbots: history, technology, and applications. Machine Learn Appl, 2020, 2: 100006
- Zhou X, Wang W Y. MojiTalk: generating emotional responses at scale. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, 2018. 1128–1137
- Sabour S, Zheng C, Huang M. CEM: commonsense-aware empathetic response generation. In: Proceedings of the 36th AAAI Conference on Artificial Intelligence, the 34th Conference on Innovative Applications of Artificial Intelligence, the 12th Symposium on Educational Advances in Artificial Intelligence, 2022. 11229–11237
- Curry A, Curry A C. Computer says “no”: the case against empathetic conversational AI. In: Proceedings of Findings of the Association for Computational Linguistics, Toronto, 2023. 8123–8130
- Hollan J D, Hutchins E L, Weitzman L. STEAMER: an interactive inspectable simulation-based training system. AI Mag, 1984, 5: 15–27
- Tambe M, Johnson W L, Jones R M, et al. Intelligent agents for interactive simulation environments. AI Mag, 1995, 16: 15–39
- Hendrickx J M, Martin S. Open multi-agent systems: gossiping with random arrivals and departures. In: Proceedings of the 56th IEEE Annual Conference on Decision and Control, Melbourne, 2017. 763–768
- Aher G V, Arriaga R I, Kalai A T. Using large language models to simulate multiple humans and replicate human subject studies. In: Proceedings of International Conference on Machine Learning, Honolulu, 2023. 337–371
- Goodfellow I J, Shlens J, Szegedy C. Explaining and harnessing adversarial examples. In: Proceedings of the 3rd International Conference on Learning Representations, San Diego, 2015
- Hendrycks D, Dietterich T G. Benchmarking neural network robustness to common corruptions and perturbations. In: Proceedings of the 7th International Conference on Learning Representations, 2019
- Rigter M, Lacerda B, Hawes N. RAMBO-RL: robust adversarial model-based offline reinforcement learning. In: Proceedings of Conference on Neural Information Processing Systems, 2022
- Lab T K S. Experimental security research of Tesla autopilot. Tencent Keen Security Lab, 2019. https://keenlab.tencent.com/en/whitepapers/Experimental_Security_Research_of_Tesla_Autopilot.pdf
- Sharif M, Bhagavatula S, Bauer L, et al. Accessorize to a crime: real and stealthy attacks on state-of-the-art face recognition. In: Proceedings of the ACM SIGSAC Conference on Computer and Communications Security, Vienna, 2016. 1528–1540
- Carlini N, Wagner D A. Audio adversarial examples: targeted attacks on speech-to-text. In: Proceedings of IEEE Security and Privacy Workshops, San Francisco, 2018. 1–7
- Guo Y, Yang Y, Abbasi A. Auto-Debias: debiasing masked language models with automated biased prompts. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, Dublin, 2022. 1012–1023
- Elhage N, Nanda N, Olsson C, et al. A mathematical framework for transformer circuits. Transformer Circ Thread, 2021, 1: 12
- Chowdhury J R, Caragea C. Monotonic location attention for length generalization. In: Proceedings of International Conference on Machine Learning, Honolulu, 2023. 28792–28808
- Bhardwaj S, Jain L, Jain S. Cloud computing: a study of infrastructure as a service (IAAS). Int J Engin Inform Technol, 2010, 2: 60–63
- Dubey A, Wagle D. Delivering software as a service. The McKinsey Quart, 2007, 6: 2007
Cited by
A Comprehensive Overview of Large Language Models
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3744746 · Cited by 1,257
Unleashing the potential of prompt engineering for large language models
Chen, B., Zhang, Z., Langrené, N., & Zhu, S. (2025) · Patterns · doi:10.1016/j.patter.2025.101260 · Cited by 490
Demystifying LLM-Based Software Engineering Agents
Xia, C. S., Deng, Y., Dunn, S., & Zhang, L. (2025) · Proceedings of the ACM on Software Engineering · doi:10.1145/3715754 · Cited by 849
AI Alignment: A Contemporary Survey
Ji, J., Qiu, T., Chen, B., Zhou, J., Zhang, B., Hong, D., Lou, H., Wang, K., Duan, Y., He, Z., et al. (2025) · ACM Computing Surveys · doi:10.1145/3770749 · Cited by 809
Multi-Agent Collaboration Mechanisms: A Survey of LLMs
Tran, K.-T., Dao, D., Nguyen, M.-D., Pham, Q.-V., O'Sullivan, B., & Nguyen, H. D. (2025) · arXiv · doi:10.48550/arxiv.2501.06322 · Cited by 680
Metadata
- Authors
- Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., Zheng, R., Fan, X., Wang, X., Xiong, L., Zhou, Y., Wang, W., Jiang, C., Zou, Y., Liu, X., Yin, Z., Dou, S., Weng, R., Qin, W., Zheng, Y., Qiu, X., Huang, X., Zhang, Q., & Gui, T.
- Affiliations
- Fudan University (CN)
- Meituan (China) (CN)
- Corresponding author
- Zhang, Qi
- Gui, Tao
- ORCID
- Venue
- Science China Information Sciences
- Published
- 2025-01-17
- Volume
- 68
- Issue
- 2
- ISSN
- 1869-1919 (ISSN-L)
- 1674-733X
- OpenAlex
- W4406800520
- Semantic Scholar
- 7fa2d1632262f30921aa0415f1b4c0f15f50e865
- Cited by
- 970
- References
- 485
- Citations by year
- 2026: 462 · 2025: 338
- FWCI
- 320.88
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- other-oa
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Science China Information Sciences (publishedVersion)
- arXiv (Cornell University) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- large language models, LLM agents, AI agents, artificial general intelligence, agent applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.