AI4Research: a survey of artificial intelligence for scientific research
Open accessAbstract
Recent advancements in artificial intelligence (AI), particularly in large language models (LLMs) such as OpenAI-o1 and DeepSeek-R1, have demonstrated remarkable capabilities in complex domains such as logical reasoning and experimental coding. Motivated by these advancements, numerous studies have explored the application of AI in the innovation process, particularly in the context of scientific research. These AI technologies primarily aim to develop systems that can autonomously conduct research processes across a wide range of scientific disciplines. Despite these significant strides, a comprehensive survey on AI for research (AI4Research) remains absent, which hampers our understanding and impedes further development in this field. To address this gap, we present a comprehensive survey and offer a unified perspective on AI4Research. Specifically, the main contributions of our work are as follows. (1) Systematic taxonomy: We first introduce a systematic taxonomy to classify five mainstream tasks in AI4Research. (2) New frontiers: Then, we identify key research gaps and highlight promising future directions, focusing on the rigor and scalability of automated experiments, as well as the societal impact. (3) Abundant applications and resources: Finally, we compile a wealth of resources, including relevant multidisciplinary applications, data corpora, and tools. We hope our work will provide the research community with quick access to these resources and stimulate innovative breakthroughs in AI4Research. All data and resources are publicly available at https://github.com/LightChen233/Awesome-AI4Research .
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The rapid advancement of AI4Research has fundamentally transformed scholarly communication, spawning interest in automating and enhancing peer review.
“The rapid advancement of AI4Research has fundamentally transformed the landscape of scholarly communication, spawning a surge of interest in automating and enhancing the peer review process (Chen et al., 2025).”
From Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Future (2026) · cites this paper as Chen et al., 2025
Sections 2.1.5 and 7 describe AI4Research as automating and enhancing peer review and report that researchers are exploring AI for that purpose. They do not establish that AI4Research has fundamentally transformed scholarly communication or that such a transformation caused a surge of interest; Section 7 instead points to delays, time demands, and growing workloads as motivations. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
AgentReview: Exploring Peer Review Dynamics with LLM Agents
Jin, Y., Zhao, Q., Wang, Y., Chen, H., Zhu, K., Xiao, Y., & Wang, J. (2024) · arXiv · doi:10.48550/arxiv.2406.12708 · Cited by 34
Self-citation
Flagged first, then by citations
Research works printed but not linked: 801
- Guo D, Yang D, Zhang H, et al. DeepSeek-R1: incentivizing reasoning capability in LLMs via reinforcement learning. 2025. ArXiv:2501.12948 · arXiv
- Sun J, Zheng C, Xie E, et al. A survey of reasoning with foundation models. 2023. ArXiv:2312.11562 · arXiv
- Team K, Du A, Gao B, et al. Kimi k1.5: scaling reinforcement learning with LLMs. 2025. ArXiv:2501.12599 · arXiv
- Qin L, Chen Q, Feng X, et al. Large language models meet NLP: a survey. 2024. ArXiv:2405.12819 · arXiv
- Zhong T, Liu Z, Pan Y, et al. Evaluation of OpenAI o1: opportunities and challenges of AGI. 2024. ArXiv:2409.18486 · arXiv
- Zhuang Z, Chen Q, Ma L, et al. Through the lens of core competency: survey on evaluation of large language models. 2023. ArXiv:2308.07902 · arXiv
- Chen Q, Qin L, Liu J, et al. Towards reasoning era: a survey of long chain-of-thought for reasoning large language models. 2025. ArXiv:2503.09567 · arXiv
- Jones C R, Bergen B K. Large language models pass the Turing test. 2025. ArXiv:2503.23674 · arXiv
- Yax N, Anlló H, Palminteri S. Studying and improving reasoning in humans and machines. Commun Psychol, 2024, 2: 51 · DOI · Paper page
- Zeng Y, Brown C, Raymond J, et al. Exploring the opportunities and challenges of using large language models to represent institutional agency in land system modelling. EGUsphere, 2024, 2024: 1-35 · DOI
- Yager K G. Towards a science exocortex. Digit Discov, 2024, 3: 1933-1957 · DOI · Paper page
- Zimmermann Y, Bazgir A, Al-Feghali A, et al. 34 examples of LLM applications in materials science and chemistry: towards automation, assistants, agents, and accelerated scientific discovery. 2025. ArXiv:2505.03049 · arXiv
- Lu C, Lu C, Lange R T, et al. The AI Scientist: towards fully automated open-ended scientific discovery. 2024. ArXiv:2408.06292 · arXiv
- Schmidgall S, Moor M. Agentrxiv: towards collaborative autonomous research. 2025. ArXiv:2503.18102 · arXiv
- Schmidgall S, Su Y, Wang Z, et al. Agent laboratory: using LLM agents as research assistants. 2025. ArXiv:2501.04227 · arXiv
- Liu B, Li X, Zhang J, et al. Advances and challenges in foundation agents: from brain-inspired intelligence to evolutionary, collaborative, and safe systems. 2025. ArXiv:2504.01990 · arXiv
- Yu F, Zhang H, Tiwari P, et al. Natural language reasoning, a survey. ACM Comput Surv, 2024, doi: 10.1145/3664194 · DOI
- Chen R, Su H, Tang S, et al. AI-driven automation can become the foundation of next-era science of science research. 2025. ArXiv:2505.12039 · arXiv
- Sætra H S. The rise of the research automaton: science as process or product in the era of generative AI? AI & Soc, 2026, 41: 1865-1879
- Chen Q G, et al. Sci China Inf Sci October 2026, Vol. 69, Iss. 10, 201101:35
- Beel J, Kan M Y, Baumgart M. Evaluating sakana's AI Scientist for autonomous research: wishful thinking or an emerging reality towards 'artificial research intelligence' (ARI)? 2025. ArXiv:2502.14297 · arXiv
- Swanson K, Wu W, Bulaong N L, et al. The virtual lab of AI agents designs new SARS-CoV-2 nanobodies. Nature, 2025, 646: 716-723 · DOI · Paper page
- Wei J, Yang Y, Zhang X, et al. From AI for science to agentic science: a survey on autonomous scientific discovery. 2025. ArXiv:2508.14111 · arXiv
- Qu C, Yang L, Chen C, et al. Open-retrieval conversational question answering. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2020. 539-548
- Bolotova V, Blinov V, Scholer F, et al. A non-factoid question-answering taxonomy. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022. 1196-1207
- Mansour N B, Rahimi H, Alrahabi M. How well do large language models extract keywords? A systematic evaluation on scientific corpora. In: Proceedings of the 1st Workshop on AI and Scientific Discovery: Directions and Opportunities, 2025. 13-21
- Chen X, Wang T, Guo T, et al. Scholarchemqa: unveiling the power of language models in chemical research question answering. 2024. ArXiv:2407.16931 · arXiv
- Hilgert L, Liu D, Niehues J. Evaluating and training long-context large language models for question answering on scientific papers. In: Proceedings of the 1st Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual (CustomNLP4U), 2024. 220-236
- Wen J, Yi L. Are plain language summaries more readable than scientific abstracts? Evidence from six biomedical and life sciences journals. Public Underst Sci, 2025, 34: 114-126 · DOI
- Kuhn L, Gal Y, Farquhar S. CLAM: selective clarification for ambiguous questions with generative language models. 2022. ArXiv:2212.07769 · arXiv
- Zhang M J, Choi E. Clarify when necessary: resolving ambiguity through interaction with LMs. 2023. ArXiv:2311.09469 · arXiv
- Li R, Li R, Wang B, et al. Iqa-eval: automatic evaluation of human-model interactive question answering. In: Proceedings of Advances in Neural Information Processing Systems, 2024. 109894-109921
- Yang Y, Chen M, Liu Q, et al. Truly assessing fluid intelligence of large language models through dynamic reasoning evaluation. 2025. ArXiv:2506.02648 · arXiv
- Qin L, Xu X, Che W, et al. Dynamic fusion network for multi-domain end-to-end task-oriented dialog. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020. 6344-6354
- Pang J C, Fan H B, Wang P, et al. Empowering language models with active inquiry for deeper understanding. 2024. ArXiv:2402.03719 · arXiv
- Yamada Y, Lange R T, Lu C, et al. The AI Scientist-v2: Workshop-level automated scientific discovery via agentic tree search. 2025. ArXiv:2504.08066 · arXiv
- Wright D, Augenstein I. Citeworth: cite-worthiness detection for improved scientific document understanding. In: Proceedings of Findings of the Association for Computational Linguistics, 2021. 1796-1807
- Kim S. Medbiolm: optimizing medical and biological qa with fine-tuned large language models and retrieval-augmented generation. 2025. ArXiv:2502.03004 · arXiv
- Saikh T, Ghosal T, Mittal A, et al. ScienceQA: a novel resource for question answering on scholarly articles. Int J Digit Libr, 2022, 23: 289-301 · DOI
- Lála J, O'Donoghue O, Shtedritski A, et al. Paperqa: retrieval-augmented generative agent for scientific research. 2023. ArXiv:2312.07559 · arXiv
- Yang R, Yang B, Feng A, et al. Graphusion: a RAG framework for knowledge graph construction with a global perspective. 2024. ArXiv:2410.17600 · arXiv
- Chu Z, Fan H, Chen J, et al. Self-critique guided iterative reasoning for multi-hop question answering. 2025. ArXiv:2505.19112 · arXiv
- Juneja P, Mitra T. Human and technological infrastructures of fact-checking. Proc ACM Hum Comput Interact, 2022, 6: 1-36 · DOI
- Hartley R. Efficacy analysis of online artificial intelligence fact-checking tools. Int Rev Inf Ethics, 2024, doi: 10.29173/irie502 · DOI
- Skarlinski M D, Cox S, Laurent J M, et al. Language agents achieve superhuman synthesis of scientific knowledge. 2024. ArXiv:2409.13740 · arXiv
- Gosmar D, Dahl D A. Hallucination mitigation using agentic AI natural language-based frameworks. 2025. ArXiv:2501.13946 · arXiv
- Zhang Y, Liu X, Zhou R, et al. Cchall: a novel benchmark for joint cross-lingual and cross-modal hallucinations detection in large language models. 2025. ArXiv:2505.19108 · arXiv
- Ma Y, Gou Z, Hao J, et al. SciAgent: tool-augmented language models for scientific reasoning. In: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024. 15701-15736
- Beltagy I, Lo K, Cohan A. SciBERT: a pretrained language model for scientific text. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019. 3615-3620
- Clark C, Lee K, Chang M W, et al. BoolQ: exploring the surprising difficulty of natural yes/no questions. 2019. ArXiv:1905.10044 · arXiv
- Ghoshal A, Iyer S, Paranjape B, et al. Quaser: question answering with scalable extractive rationalization. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022. 1208-1218
- Rostam Z R K, Kertész G. Fine-tuning large language models for scientific text classification: a comparative study. In: Proceedings of 2024 IEEE 6th International Symposium on Logistics and Industrial Informatics (LINDI), 2024. 000233-000238
- Bolton E, Venigalla A, Yasunaga M, et al. BiomedLM: a 2.7 B parameter language model trained on biomedical text. 2024. ArXiv:2403.18421 · arXiv
- Liu J, Zhu D, Bai Z, et al. A comprehensive survey on long context language modeling. 2025. ArXiv:2503.17407 · arXiv
- Tang Z, Zhou K, Li J, et al. L-citeeval: do long-context models truly leverage context for responding? 2024. ArXiv:2410.02115 · arXiv
- Garcia-Silva A, Berrio C, Gomez-Perez J M, et al. SpaceQA: answering questions about the design of space missions and space craft concepts. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022. 3306-3311
- Peretz G, Arraf M, Radinsky K. What if: generating code to answer simulation questions in chemistry texts. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2023. 1335-1344
- Raza S, Schwartz B, Rosella L C. Coquad: a COVID-19 question answering dataset system, facilitating research, benchmarking, and practice. BMC Bioinformatics, 2022, 23: 210 · DOI
- Singhal K, Tu T, Gottweis J, et al. Toward expert-level medical question answering with large language models. Nat Med, 2025, 31: 943-950 · DOI · Paper page
- Chen Z, Chen Q, Qin L, et al. What are the essential factors in crafting effective long context multi-hop instruction datasets? Insights and best practices. 2024. ArXiv:2409.01893 · arXiv
- Chen Q G, et al. Sci China Inf Sci October 2026, Vol. 69, Iss. 10, 201101:36
- Liu Y, Yu J, Xu Y, et al. A survey on transformer context extension: approaches and evaluation. 2025. ArXiv:2503.13299 · arXiv
- Li L, Wang Y, Xu R, et al. Multimodal ArXiv: a dataset for improving scientific comprehension of large vision-language models. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024. 14369-14387
- Li Z, Yang X, Choi K, et al. Mmsci: a dataset for graduate-level multi-discipline multimodal scientific understanding. 2024. ArXiv:2407.04903 · arXiv
- Roberts J, Han K, Houlsby N, et al. SciFiBench: benchmarking large multimodal models for scientific figure interpretation. 2024. ArXiv:2405.08807 · arXiv
- Kerwer M, Chasiotis A, Stricker J, et al. Straight from the scientist's mouth-plain language summaries promote laypeople's comprehen- sion and knowledge acquisition when reading about individual research findings in psychology. Collabra Psychol, 2021, 7: 18898 · DOI · Paper page
- Fonseca M, Cohen S. Can large language model summarizers adapt to diverse scientific communication goals? In: Proceedings of Findings of the Association for Computational Linguistics, 2024. 8599-8618
- Zhao C, Zhou X, Xie X, et al. Hierarchical attention graph for scientific document summarization in global and local level. 2024. ArXiv:2405.10202 · arXiv
- Ifargan T, Hafner L, Kern M, et al. Autonomous LLM-driven research-from data to human-verifiable research papers. NEJM AI, 2025, 2: AIoa2400555 70 · DOI · Paper page
- Huang J, Gu S S, Hou L, et al. Large language models can self-improve. 2022. ArXiv:2210.11610 · arXiv
- Wang Z, Hou L, Lu T, et al. Enabling language models to implicitly learn self-improvement. 2023. ArXiv:2310.00898 · arXiv
- Zhang D, Hu Z, Zhoubian S, et al. Sciglm: training scientific language models with self-reflective instruction annotation and tuning. 2024. ArXiv:2401.07950 · arXiv
- Yu C, Zhang Y, Liu Z, et al. Frame: feedback-refined agent methodology for enhancing medical research insights. 2025. ArXiv:2505.04649 · arXiv
- Luo S, Tang Y, Jiang M, et al. Generating multiple choice questions from scientific literature via large language models. In: Proceedings of 2024 IEEE International Conference on Knowledge Graph (ICKG), 2024. 219-226
- Wan Y, Liu Y, Ajith A, et al. Sciqag: a framework for auto-generated science question answering dataset with fine-grained evaluation. 2024. ArXiv:2405.09939 · arXiv
- Qu Y, Zhang T, Garg N, et al. Recursive introspection: teaching language model agents how to self-improve. In: Proceedings of Advances in Neural Information Processing Systems, 2024. 55249-55285
- Song Y, Zhang H, Eisenach C, et al. Mind the gap: examining the self-improvement capabilities of large language models. 2024. ArXiv:2412.02674 · arXiv
- Wu S, Bao H, Kunievsky N, et al. Introspective growth: automatically advancing LLM expertise in technology judgment. 2025. ArXiv:2505.12452 · arXiv
- Circi D, Khalighinejad G, Chen A, et al. How well do large language models understand tables in materials science? Integr Mater Manuf Innov, 2024, doi: 10.1007/s40192-024-00362-6 · DOI
- Newman B, Lee Y, Naik A, et al. ArxivDIGESTables: synthesizing scientific literature into tables using language models. In: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024. 9612-9631
- Guo Z, Zhang R, Chen H, et al. Sciverse: unveiling the knowledge comprehension and visual reasoning of LMMS on multi-modal scientific problems. 2025. ArXiv:2503.10627 · arXiv
- Sui Y, Zhou M, Zhou M, et al. Table meets LLM: can large language models understand structured table data? A benchmark and empirical study. In: Proceedings of the 17th ACM International Conference on Web Search and Data Mining, 2024. 645-654
- Wu X, Yang J, Chai L, et al. Tablebench: a comprehensive and complex benchmark for table question answering. In: Proceedings of the AAAI Conference on Artificial Intelligence, 2025. 25497-25506
- Ashury-Tahan S, Mai Y, Gera A, et al. The mighty torr: a benchmark for table reasoning and robustness. 2025. ArXiv:2502.19412 · arXiv
- Zheng M, Feng X, Si Q, et al. Multimodal table understanding. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024. 9102-9124
- Cao L, Liu H. Tablemaster: a recipe to advance table understanding with language models. 2025. ArXiv:2501.19378 · arXiv
- Zhang X, Wang D, Dou L, et al. A survey of table reasoning with large language models. Front Comput Sci, 2025, 19: 199348 · DOI
- Wang D, Dou L, Che W. A survey on table-and-text hybridqa: concepts, methods, challenges and future directions. 2022. ArXiv:2212.13465 · arXiv
- Wang D, Dou L, Zhang X, et al. Improving demonstration diversity by human-free fusing for text-to-SQL. 2024. ArXiv:2402.10663 · arXiv
- Wang Z, Zhang H, Li C L, et al. Chain-of-table: evolving tables in the reasoning chain for table understanding. In: Proceedings of the Twelfth International Conference on Learning Representations, 2024
- Ji D, Zhu L, Gao S, et al. Tree-of-table: unleashing the power of LLMs for enhanced large-scale table understanding. 2024. ArXiv:2411.08516 · arXiv
- Pramanick S, Chellappa R, Venugopalan S. Spiqa: a dataset for multimodal question answering on scientific papers. In: Proceedings of The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2024. 118807-118833
- Liang Z, Guo K, Liu G, et al. SceMQA: a scientific college entrance level multimodal question answering benchmark. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2024. 109-119
- Meng F, Shao W, Lu Q, et al. Chartassisstant: a universal chart multimodal language model via chart-to-table pre-training and multitask instruction tuning. 2024. ArXiv:2401.02384 · arXiv
- Huang M, Zhang L, Ma J, et al. Chartsketcher: reasoning with multimodal feedback and reflection for chart understanding. 2025. ArXiv:2505.19076 · arXiv
- Liu M, Li Q, Chen D, et al. Synchart: synthesizing charts from language models. 2024. ArXiv:2409.16517 · arXiv
- Hu L, Wang D, Pan Y, et al. Novachart: a large-scale dataset towards chart understanding and generation of multimodal large language models. In: Proceedings of the 32nd ACM International Conference on Multimedia, 2024. 3917-3925
- Masry A, Shahmohammadi M, Parvez M R, et al. ChartInstruct: instruction tuning for chart comprehension and reasoning. In: Proceedings of Findings of the Association for Computational Linguistics, 2024. 10387-10409
- Meng F, Shao W, Lu Q, et al. ChartAssistant: a universal chart multimodal language model via chart-to-table pre-training and multitask instruction tuning. In: Proceedings of Findings of the Association for Computational Linguistics, 2024. 7775-7803 100
- Masry A, Thakkar M, Bajaj A, et al. ChartGemma: visual instruction-tuning for chart reasoning in the wild. In: Proceedings of the 31st International Conference on Computational Linguistics: Industry Track, 2025. 625-643 101
- Chen Q G, et al. Sci China Inf Sci October 2026, Vol. 69, Iss. 10, 201101:37 2025. ArXiv:2506.02454 102 · arXiv
- Rohman D G. Pre-writing: the stage of discovery in the writing process. Coll Compos Commun, 1965, 16: 106-112 103 · DOI
- Beel J, Gipp B, Langer S, et al. Paper recommender systems: a literature survey. Int J Digit Libr, 2016, 17: 305-338 104 · DOI
- Li Z, Zou X. A review on personalized academic paper recommendation. Comput Inf Sci, 2019, 12: 33-43 105 · DOI
- Shahid A, Afzal M T, Abdar M, et al. Insights into relevant knowledge extraction techniques: a comprehensive review. J Supercomput, 2020, 76: 1695-1733 106 · DOI
- Fan W, Ding Y, Ning L, et al. A survey on RAG meeting LLMs: towards retrieval-augmented large language models. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2024. 6491-6501 107
- Bai X, Wang M, Lee I, et al. Scientific paper recommendation: a survey. IEEE Access, 2019, 7: 9324-9339 108 · DOI
- Kreutz C K, Schenkel R. Scientific paper recommendation systems: a literature review of recent publications. Int J Digit Libr, 2022, 23: 335-369 109 · DOI
- Li X, Ouyang J. Related work and citation text generation: a survey. In: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024. 13846-13864 110
- Luo J, Qian C, Glass L, et al. Clinical trial retrieval via multi-grained similarity learning. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2024. 2950-2954 111
- Formal T, Lassance C, Piwowarski B, et al. Splade v2: sparse lexical and expansion model for information retrieval. 2021. ArXiv:2109.10086 112 · arXiv
- Boylan J, Mangla S, Thorn D, et al. Kgvalidator: a framework for automatic validation of knowledge graph construction. 2024. ArXiv:2404.15923 113 · arXiv
- Sun Q, Luo Y, Zhang W, et al. Docs2kg: a human-LLM collaborative approach to unified knowledge graph construction from heteroge- neous documents. In: Proceedings of Companion Proceedings of the ACM Web Conference 2025, 2025. 801-804 114
- Stergiopoulos V, Vassilakopoulos M, Tousidou E, et al. An academic recommender system on large citation data based on clustering, graph modeling and deep learning. Knowl Inf Syst, 2024, 66: 4463-4496 115 · DOI
- Kang H B, Soliman N, Latzke M, et al. Comlittee: literature discovery with personal elected author committees. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023. 1-20 116
- Pinedo I, Larrañaga M, Arruarte A. Arzigo: a recommendation system for scientific articles. Inf Syst, 2024, 122: 102367 117 · DOI
- Kang H B, Kocielnik R, Head A, et al. From who you know to what you read: augmenting scientific recommendations with implicit social networks. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022. 1-23 118
- Luo Z, Xie Q, Ananiadou S. Citationsum: citation-aware graph contrastive learning for scientific paper summarization. In: Proceedings of the ACM Web Conference 2023, 2023. 1843-1852 119
- Li X, Ouyang J. Explaining relationships among research papers. 2024. ArXiv:2402.13426 120 · arXiv
- Ye Y, Ren J, Wang S, et al. Construction and application of materials knowledge graph in multidisciplinary materials science via large language model. In: Proceedings of Advances in Neural Information Processing Systems, 2024. 56878-56897 121
- Garikaparthi A, Patwardhan M, Kanade A S, et al. Mir: methodology inspiration retrieval for scientific research problems. 2025. ArXiv:2506.00249 122 · arXiv
- Lee Y, Kang H B, Latzke M, et al. Paperweaver: enriching topical paper alerts by contextualizing recommended papers with user-collected papers. In: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, 2024. 1-19 123
- Seabra A, Cavalcante C, Nepomuceno J, et al. Dynamic multi-agent orchestration and retrieval for multi-source question-answer systems using large language models. 2024. ArXiv:2412.17964 124 · arXiv
- Liu X, Song R, Wang X, et al. Select, read, and write: a multi-agent framework of full-text-based related work generation. 2025. ArXiv:2505.19647 125 · arXiv
- Singh A, Ehtesham A, Kumar S, et al. Agentic retrieval-augmented generation: a survey on agentic RAG. 2025. ArXiv:2501.09136 126 OpenAI. Introducing deep research. 2025. https://openai.com/index/introducing-deep-research/ 127 OpenAI. GPT-4o search preview. 2025. https://platform.openai.com/docs/models/gpt-4o-search-preview 128 · arXiv
- Du M, Xu B, Zhu C, et al. Deepresearch bench: a comprehensive benchmark for Deep Research agents. 2025. ArXiv:2506.11763 129 · arXiv
- Zhou J, Li W, Liao Y, et al. Academicbrowse: benchmarking academic browse ability of LLMs. 2025. ArXiv:2506.13784 130 · arXiv
- Wu J, Li B, Fang R, et al. Webdancer: towards autonomous information seeking agency. 2025. ArXiv:2505.22648 131 · arXiv
- He Y, Huang G, Feng P, et al. Pasa: an LLM agent for comprehensive academic paper search. 2025. ArXiv:2501.10120 132 · arXiv
- Shi Z, Yan L, Yin D, et al. Iterative self-incentivization empowers large language models as agentic searchers. 2025. ArXiv:2505.20128 133 · arXiv
- Yang Z, Zhu Z, Zhu J. CuriousLLM: elevating multi-document question answering with LLM-enhanced knowledge graph reasoning. In: Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 3: Industry Track), 2025. 274-286 134
- Hoang C D V, Kan M Y. Towards automated related work summarization. In: Proceedings of Coling 2010: Posters, 2010. 427-435 135
- Agarwal S, Sahu G, Puri A, et al. LLMs for literature review: are we there yet? 2024. ArXiv:2412.15249 136 · arXiv
- Yan X, Feng S, Yuan J, et al. Surveyforge: on the outline heuristics, memory-driven generation, and multi-dimensional evaluation for automated survey writing. 2025. ArXiv:2503.04629 137 · arXiv
- Singh A, Chang J C, Anastasiades C, et al. Ai2 scholar qa: organized literature synthesis with attribution. 2025. ArXiv:2504.10861 138 · arXiv
- Wang Y, Guo Q, Yao W, et al. Autosurvey: large language models can automatically write surveys. In: Proceedings of Advances in Neural Information Processing Systems, 2024. 115119-115145 139
- Bolanos F, Salatino A, Osborne F, et al. Artificial intelligence for literature reviews: opportunities and challenges. Artif Intell Rev, 2024, 57: 259 140 · DOI · Paper page
- Zhu K, Feng X, Feng X, et al. Hierarchical catalogue generation for literature review: a benchmark. 2023. ArXiv:2304.03512 141 · arXiv
- Shao Y, Jiang Y, Kanell T A, et al. Assisting in writing Wikipedia-like articles from scratch with large language models. 2024. ArXiv:2402.14207 142 · arXiv
- Hsu C C, Bransom E, Sparks J, et al. Chime: LLM-assisted hierarchical organization of scientific studies for literature review support. 2024. ArXiv:2407.16148 143 · arXiv
- Katz U, Levy M, Goldberg Y. Knowledge navigator: LLM-guided browsing framework for exploratory search in scientific literature. 2024. ArXiv:2408.15836 144 · arXiv
- Hu Y, Li Z, Zhang Z, et al. Taxonomy tree generation from citation graph. 2024. ArXiv:2410.03761 145 · arXiv
- Chen Q G, et al. Sci China Inf Sci October 2026, Vol. 69, Iss. 10, 201101:38 Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024), 2024. 58-69 146
- Chen X, Alamro H, Li M, et al. Capturing relations between scientific papers: an abstractive model for related work section generation. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021. 6068-6077 147
- Chen X, Alamro H, Li M, et al. Target-aware abstractive related work generation with contrastive learning. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022. 373-383 148
- Ovelman C, Kugley S, Gartlehner G, et al. The use of a large language model to create plain language summaries of evidence reviews in healthcare: a feasibility study. Cochrane Evid Synth Methods, 2024, 2: e12041 149 · DOI · Paper page
- Kaiser R E, Sadr F, Yuen T, et al. 376 using a large language model to create lay summaries of clinical study descriptions. J Clin Transl Sci, 2025, 9: 116-116 150
- Chen J, Zhuge H. Automatic generation of related work through summarizing citations. Concurr Comput Pract Exper, 2019, 31: e4261 151 · DOI
- Wang P, Li S, Zhou H, et al. Toc-rwg: explore the combination of topic model and citation information for automatic related work generation. IEEE Access, 2019, 8: 13043-13055 152 · DOI
- Hu Y, Wan X. Automatic generation of related work sections in scientific papers: an optimization approach. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014. 1624-1633 153
- Deng Z, Zeng Z, Gu W, et al. Automatic related work section generation by sentence extraction and reordering. In: Proceedings of AII@ iConference, 2021. 101-110 154
- Wang Y, Liu X, Gao Z. Neural related work summarization with a joint context-driven attention mechanism. 2019. ArXiv:1901.09492 155 · arXiv
- Robertson Z. Gpt4 is slightly helpful for peer-review assistance: a pilot study. 2023. ArXiv:2307.05492 157 · arXiv
- Liu A, Feng B, Xue B, et al. DeepSeek-v3 technical report. 2024. ArXiv:2412.19437 158 · arXiv
- Wang P, Li S, Pang K, et al. Multi-document scientific summarization from a knowledge graph-centric view. 2022. ArXiv:2209.04319 159 · arXiv
- Liu J, Zhang Q, Shi C, et al. Causal intervention for abstractive related work generation. 2023. ArXiv:2305.13685 160 · arXiv
- Li X, Ouyang J. Related work and citation text generation: a survey. 2024. ArXiv:2404.11588 161 · arXiv
- Martin-Boyle A, Tyagi A, Hearst M A, et al. Shallow synthesis of knowledge in GPT-generated texts: a case study in automatic related work composition. 2024. ArXiv:2402.12255 162 · arXiv
- Gu N, Hahnloser R H. Controllable citation sentence generation with language models. 2022. ArXiv:2211.07066 163 · arXiv
- Li X, Lee Y H, Ouyang J. Cited text spans for citation text generation. 2023. ArXiv:2309.06365 164 · arXiv
- Ge Y, Dinh L, Liu X, et al. Baco: a background knowledge-and content-based framework for citing sentence generation. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021. 1466-1478 165
- Yu L, Zhang Q, Shi C, et al. Reinforced subject-aware graph neural network for related work generation. In: Proceedings of International Conference on Knowledge Science, Engineering and Management, 2024. 201-213 166
- Shi Z, Gao S, Zhang Z, et al. Towards a unified framework for reference retrieval and related work generation. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2023, 2023. 5785-5799 167
- Wang P, Li S, Li D, et al. Disentangling instructive information from ranked multiple candidates for multi-document scientific summa- rization. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2024. 2028-2037 168
- Pratapa A, Mitamura T. Estimating optimal context length for hybrid retrieval-augmented multi-document summarization. 2025. ArXiv:2504.12972 169 · arXiv
- Guo Y, Qiu W, Wang Y, et al. Automated lay language summarization of biomedical scientific reviews. In: Proceedings of the AAAI Conference on Artificial Intelligence, 2021. 160-168 170
- Nishimura K, Saito K, Hirasawa T, et al. Toward related work generation with structure and novelty statement. In: Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024), 2024. 38-57 171
- Pu D, Demberg V. Rst-lora: a discourse-aware low-rank adaptation for long document abstractive summarization. In: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024. 2200-2220 172
- Achkar P, Gollub T, Potthast M. Ask, retrieve, summarize: a modular pipeline for scientific literature summarization. 2025. ArXiv:2505.16349 173 · arXiv
- Webster J, Watson R T. Analyzing the past to prepare for the future: writing a literature review. MIS Q, 2002, 26: xiii-xxiii 174 · DOI · Paper page
- Galli C, Moretti C, Calciolari E. Intelligent summaries: will artificial intelligence mark the finale for biomedical literature reviews? Learn Publ, 2024, doi: 10.1002/leap.1648 175 · DOI
- Wu J, Zhang J, Li D, et al. Lag: LLM agents for leaderboard auto generation on demanding. 2025. ArXiv:2502.18209 176 · arXiv
- Agarwal S, Sahu G, Puri A, et al. Litllm: a toolkit for scientific literature review. 2024. ArXiv:2402.01788 177 · arXiv
- Liang X, Yang J, Wang Y, et al. SurveyX: academic survey automation via large language models. 2025. ArXiv:2502.14776 178 · arXiv
- Robinson A, Thorne W, Wu B P, et al. Bio-sieve: exploring instruction tuning large language models for systematic review automation. 2023. ArXiv:2308.06610 179 · arXiv
- Susnjak T, Hwang P, Reyes N, et al. Automating research synthesis with domain-specific large language model fine-tuning. ACM Trans Knowl Discov Data, 2025, 19: 1-39 180
- Lai Y, Wu Y, Wang Y, et al. Instruct large language models to generate scientific literature survey step by step. In: Proceedings of CCF International Conference on Natural Language Processing and Chinese Computing, 2024. 484-496 181
- Asai A, He J, Shao R, et al. OpenScholar: synthesizing scientific literature with retrieval-augmented LMs. 2024. ArXiv:2411.14199 182 · arXiv
- Wang H, Fu T, Du Y, et al. Scientific discovery in the age of artificial intelligence. Nature, 2023, 620: 47-60 183 · DOI · Paper page
- Raeini M. On the rise of new mathematical spaces and towards AI-driven scientific discovery. Available at SSRN, 2025 185
- Butler K T, Davies D W, Cartwright H, et al. Machine learning for molecular and materials science. Nature, 2018, 559: 547-555 186 · DOI · Paper page
- Merchant A, Batzner S, Schoenholz S S, et al. Scaling deep learning for materials discovery. Nature, 2023, 624: 80-85 187 · DOI · Paper page
- Assael Y, Sommerschield T, Shillingford B, et al. Restoring and attributing ancient texts using deep neural networks. Nature, 2022, 603: · DOI
- Chen Q G, et al. Sci China Inf Sci October 2026, Vol. 69, Iss. 10, 201101:39 280-283 188
- Senior A W, Evans R, Jumper J, et al. Improved protein structure prediction using potentials from deep learning. Nature, 2020, 577: 706-710 189 · DOI · Paper page
- Lu C, Hu S, Clune J. Beyond benchmarking: automated capability discovery via model self-exploration. In: Proceedings of Language Gamification-NeurIPS 2024 Workshop, 2024 190
- Harris K D. Airus: a simple workflow for AI-assisted exploration of scientific data. bioRxiv, 2025, doi: 10.1101/2025.02.23.639768 191 · DOI
- He K, Chen Z. From reasoning to learning: a survey on hypothesis discovery and rule learning with large language models. 2025. ArXiv:2505.21935 192 · arXiv
- Angello N H, Friday D M, Hwang C, et al. Closed-loop transfer enables artificial intelligence to yield chemical knowledge. Nature, 2024, 633: 351-358 193 · DOI
- Dai T, Vijayakrishnan S, Szczypiński F T, et al. Autonomous mobile robots for exploratory synthetic chemistry. Nature, 2024, 635: 890-897 194 · DOI
- Ruan K, Wang X, Hong J, et al. Liveideabench: evaluating LLMs' scientific creativity and idea generation with minimal context. 2024. ArXiv:2412.17596 195 · arXiv
- Team G, Anil R, Borgeaud S, et al. Gemini: a family of highly capable multimodal models. 2023. ArXiv:2312.11805 196 · arXiv
- Team G, Georgiev P, Lei V I, et al. Gemini 1.5: unlocking multimodal understanding across millions of tokens of context. 2024. ArXiv:2403.05530 197 · arXiv
- Achiam J, Adler S, Agarwal S, et al. GPT-4 technical report. 2023. ArXiv:2303.08774 198 · arXiv
- Jaech A, Kalai A, Lerer A, et al. OpenAI o1 system card. 2024. ArXiv:2412.16720 199 · arXiv
- Grattafiori A, Dubey A, Jauhri A, et al. The LLaMA 3 herd of models. 2024. ArXiv:2407.21783 200 Team Q. QwQ-32B: embracing the power of reinforcement learning. 2025 201 · arXiv
- O'Neill C, Ghosal T, Rȃileanu R, et al. Sparks of science: hypothesis generation using structured paper data. 2025. ArXiv:2504.12976 203 · arXiv
- Azher I A, Mokarrama M J, Guo Z, et al. Futuregen: LLM-RAG approach to generate the future work of scientific article. 2025. ArXiv:2503.16561 204 · arXiv
- Cohrs K H, Diaz E, Sitokonstantinou V, et al. Large language models for causal hypothesis generation in science. Mach Learn Sci Technol, 2025, 6: 013001 205 · DOI
- Liu Y, Yang Z, Xie T, et al. Researchbench: benchmarking LLMs in scientific discovery via inspiration-based task decomposition. 2025. ArXiv:2503.21248 206 · arXiv
200 of 801 shown
Cited by
Sorted by citations
ReportBench: Evaluating Deep Research Agents via Academic Survey Tasks
Li, M., Zeng, Y., Cheng, Z., Ma, C., & Jia, K. (2025) · arXiv · doi:10.48550/arxiv.2508.15804 · Cited by 1 · see citing works
“…synthesis by enabling autonomous execution of extensive research tasks, including academic literature surveys, industry analyses, and market assessments Chen et al. (2025); Gottweis et al. (2025); Lu et al. (2024); Tang et al. (2025); Yamada et al. (2025); Zheng et al. (2025); Li et al. (2025).”
Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Future
Wu, S., Jiang, O., Zhao, Y., Hu, T., Ma, Y., Zhang, K., Patwardhan, M., & Cohan, A. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.1504 · Cited by 1 · see citing works
Liu, Z., Wu, J., Peng, R., Ji, Y., Li, D., Jiang, R., & Zhang, Y. (2026) · arXiv · doi:10.48550/arxiv.2608.03501
Self-citationRSIGym: A Flexible Environment for Recursive Self-Improvement
Meng, F., Du, L., Lu, H., Chen, Q., Zhao, Z., Wu, Z., Zhuo, J., Hu, M., & Shieh, M. Q. (2026) · arXiv · doi:10.48550/arxiv.2610.10310
“Automated scientific-research systems such as The AI Scientist generate ideas, run experiments, and analyze results [Lu et al., 2024, Chen et al., 2025].”
Self-citation
- Authors
- Chen, Q., Yang, M., Qin, L., Liu, J., Yan, Z., Guan, J., Peng, D., Ji, Y., Li, H., Hu, M., Zhang, Y., Liang, Y., Zhou, Y., Wang, J., Chen, Z., & Che, W.
- Affiliations
- Harbin Institute of Technology (CN)
- Central South University (CN)
- University of Hong Kong (HK)
- University of Illinois Urbana-Champaign (US)
- Princeton University (US)
- Fudan University (CN)
- Chinese University of Hong Kong (HK)
- ByteDance (China) (CN)
- Corresponding author
- Qin, Libo
- Che, Wanxiang
- ORCID
- Venue
- Science China Information Sciences
- Published
- 2026-09-28
- Volume
- 69
- Issue
- 10
- ISSN
- 1869-1919 (ISSN-L)
- 1674-733X
- OpenAlex
- W4417183323
- Cited by
- 4
- References
- 1
- Citations by year
- 2026: 4
- FWCI
- 13.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Science China Information Sciences (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (62236004, 62476073, 62306342)
- Young Scientists Fund
- Fundamental Research Funds for the Central Universities
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Social Sciences › Decision Sciences › Information Systems and Management › Research, Science, and Academia
- Keywords
- large language models, autonomous research, automated experimentation, scientific research automation, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review