Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 7

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems

Zhou, Zekun, Feng, Xiaocheng, Huang, Lei, Feng, Xiachong, Song, Ziyun, Chen, Ruihan, Zhao, Liang, Ma, Weitao, Gu, Yuxuan, Wang, Baoxin, Wu, Dayong, Hu, Guoping, Liu, Ting, Qin, Bing · 2025 · Findings of the Association for Computational Linguistics: EMNLP 2025

Abstract

Zekun Zhou, Xiaocheng Feng, Lei Huang, Xiachong Feng, Ziyun Song, Ruihan Chen, Liang Zhao, Weitao Ma, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Ting Liu, Bing Qin. Findings of the Association for Computational Linguistics: EMNLP 2025. 2025.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/2025.findings-emnlp.631

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Overview of AI for research. The framework consists of three stages: hypothesis formulation, hypothesis validation, and manuscript publication. In the hypothesis formulation stage, knowledge integration leads to the proposal of an initial hypothesis after a topic is identified. The hypothesis validation stage involves verifying the hypothesis from three perspectives to ensure its correctness and validity. Finally, the manuscript publication stage focuses on drafting and publishing the validated hypothesis.
Figure 1 Overview of AI for research. The framework consists of three stages: hypothesis formulation, hypothesis validation, and manuscript publication. In the hypothesis formulation stage, knowledge integration leads to the proposal of an initial hypothesis after a topic is identified. The hypothesis validation stage involves verifying the hypothesis from three perspectives to ensure its correctness and validity. Finally, the manuscript publication stage focuses on drafting and publishing the validated hypothesis.CC-BY · From the PDF
Figure 2 Taxonomy of Hypothesis Formulation, Hypothesis Validation and Manuscript Publication (This is a simplified version, full version in Figure 6).
Figure 2 Taxonomy of Hypothesis Formulation, Hypothesis Validation and Manuscript Publication (This is a simplified version, full version in Figure 6).CC-BY · From the PDF
Figure 3 This figure illustrates the hypothesis formulation process, consisting of two stages: knowledge synthesis and hypothesis generation, which together produce an initial hypothesis related to a specific topic.
Figure 3 This figure illustrates the hypothesis formulation process, consisting of two stages: knowledge synthesis and hypothesis generation, which together produce an initial hypothesis related to a specific topic.CC-BY · From the PDF
Figure 4 This figure illustrates the various perspectives for hypothesis validation during the hypothesis validation stage. A hypothesis is typically divided into scientific claims and theorems, with SCI-claim verification (scientific claim verification) and theorem proving ensuring theoretical correctness, while experiment validation assesses practical feasibility.
Figure 4 This figure illustrates the various perspectives for hypothesis validation during the hypothesis validation stage. A hypothesis is typically divided into scientific claims and theorems, with SCI-claim verification (scientific claim verification) and theorem proving ensuring theoretical correctness, while experiment validation assesses practical feasibility.CC-BY · From the PDF
Figure 5 This figure shows the transformation of a validated hypothesis into a publication, leveraging outputs from the hypothesis formulation and validation stages.
Figure 5 This figure shows the transformation of a validated hypothesis into a publication, leveraging outputs from the hypothesis formulation and validation stages.CC-BY · From the PDF
Figure 6 Taxonomy of Hypothesis Formulation, Hypothesis Validation and Manuscript Publication (Full Edition).
Figure 6 Taxonomy of Hypothesis Formulation, Hypothesis Validation and Manuscript Publication (Full Edition).CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 277

  1. Shubham Agarwal, Issam H. Laradji, Laurent Charlin, and Christopher Pal. 2024a. Litllm: A toolkit for scientific literature review. CoRR, abs/2402.01788. · DOI · Paper page
  2. Shubham Agarwal, Gaurav Sahu, Abhay Puri, Issam H Laradji, Krishnamurthy DJ Dvijotham, Jason Stan- ley, Laurent Charlin, and Christopher Pal. 2024b. Llms for literature review: Are we there yet? arXiv preprint arXiv:2412.15249. · arXiv
  3. Microsoft Research AI4Science and Microsoft Azure Quantum. 2023. The impact of large language mod- els on scientific discovery: a preliminary study using GPT-4. CoRR, abs/2311.07361. · DOI
  4. Fadi Aljamaan, Mohamad-Hani Temsah, Ibraheem Altamimi, Ayman Al-Eyadhy, Amr Jamal, Khalid Alhasan, Tamer A Mesallam, Mohamed Farahat, Khalid H Malki, and 1 others. 2024. Reference hallucination score for medical artificial intelligence chatbots: development and usability study. JMIR Medical Informatics, 12(1):e54345.
  5. Nouf Ibrahim Altmami and Mohamed El Bachir Menai. 2022. Automatic summarization of scientific arti- cles: A survey. J. King Saud Univ. Comput. Inf. Sci., 34(4):1011-1028. · DOI
  6. Enes Altuncu, Jason R. C. Nurse, Meryem Bagriacik, Sophie Kaleba, Haiyue Yuan, Lisa Bonheme, and Shujun Li. 2023. aedfact: Scientific fact-checking made easier via semi-automatic discovery of relevant expert opinions. CoRR, abs/2305.07796. · arXiv · doi:10.48550/arxiv.2305.07796
  7. Sören Arlt, Haonan Duan, Felix Li, Sang Michael Xie, Yuhuai Wu, and Mario Krenn. 2024. Meta-designing quantum experiments with language models. CoRR, abs/2406.02470. · arXiv · doi:10.48550/arxiv.2406.02470
  8. Akari Asai, Jacqueline He, Rulin Shao, Weijia Shi, Amanpreet Singh, Joseph Chee Chang, Kyle Lo, Luca Soldaini, Sergey Feldman, Mike D'Arcy, David Wadden, Matt Latzke, Minyang Tian, Pan Ji, Shengyan Liu, Hao Tong, Bohao Wu, Yanyu Xiong, Luke Zettlemoyer, and 6 others. 2024. Openscholar: Synthesizing scientific literature with retrieval-augmented lms. CoRR, abs/2411.14199. · arXiv · doi:10.48550/arxiv.2411.14199 · Paper page
  9. Pepa Atanasova, Jakob Grue Simonsen, Christina Li- oma, and Isabelle Augenstein. 2020. Generating fact checking explanations. In Proceedings of the 58th Annual Meeting of the Association for Compu- tational Linguistics, ACL 2020, Online, July 5-10, 2020, pages 7352-7364. Association for Computa- tional Linguistics. · DOI
  10. Jinheon Baek, Sujay Kumar Jauhar, Silviu Cucerzan, and Sung Ju Hwang. 2024. Researchagent: Iterative research idea generation over scientific literature with large language models. CoRR, abs/2404.07738. · arXiv · doi:10.48550/arxiv.2404.07738 · Paper page
  11. Xiaomei Bai, Mengyang Wang, Ivan Lee, Zhuo Yang, Xiangjie Kong, and Feng Xia. 2019. Scientific paper recommendation: A survey. IEEE Access, 7:9324- 9339. · DOI · Paper page
  12. André Bauer, Simon Trapp, Michael Stenger, Robert Leppich, Samuel Kounev, Mark Leznik, Kyle Chard, and Ian Foster. 2024. Comprehensive exploration of synthetic data generation: A survey. arXiv preprint arXiv:2401.02524. · arXiv
  13. Adrián Bazaga, Pietro Lio, and Gos Micklem. 2024. Unsupervised pretraining for fact verification by language model distillation. In The Twelfth Inter- national Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. Open- Review.net.
  14. Joeran Beel, Bela Gipp, Stefan Langer, and Corinna Breitinger. 2016. Paper recommender systems: a literature survey. International Journal on Digital Libraries, 17:305-338.
  15. Dale J Benos, Edlira Bashari, Jose M Chaves, Amit Gag- gar, Niren Kapoor, Martin LaFrance, Robert Mans, David Mayhew, Sara McGowan, Abigail Polter, and 1 others. 2007. The ups and downs of peer review. Advances in physiology education, 31(2):145-152.
  16. Loraine Blaxter, Christina Hughes, and Malcolm Tight. 2010. How to research. McGraw-Hill Education (UK).
  17. Joern Block and Andreas Kuckertz. 2024. What is the future of human-generated systematic literature reviews in an age of artificial intelligence? Manage- ment Review Quarterly, pages 1-6.
  18. Ben Bogin, Kejuan Yang, Shashank Gupta, Kyle Richardson, Erin Bransom, Peter Clark, Ashish Sab- harwal, and Tushar Khot. 2024. SUPER: evaluating agents on setting up and executing tasks from re- search repositories. In Proceedings of the 2024 Con- ference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, Novem- ber 12-16, 2024, pages 12622-12645. Association for Computational Linguistics.
  19. Daniil A. Boiko, Robert MacKnight, Ben Kline, and Gabe Gomes. 2023. Autonomous chemical research with large language models. Nat., 624(7992):570- 578. · DOI · Paper page
  20. Francisco Bolaños, Angelo A. Salatino, Francesco Os- borne, and Enrico Motta. 2024. Artificial intelligence for literature reviews: opportunities and challenges. Artif. Intell. Rev., 57(9):259. · DOI · Paper page
  21. James Boyko, Joseph Cohen, Nathan Fox, Maria Han Veiga, Jennifer I-Hsiu Li, Jing Liu, Bernardo Mod- enesi, Andreas H. Rauch, Kenneth N. Reid, Soumi Tribedi, Anastasia Visheratina, and Xin Xie. 2023. An interdisciplinary outlook on large language mod- els for scientific research. CoRR, abs/2311.04929. · DOI
  22. Andres M. Bran, Sam Cox, Oliver Schilter, Carlo Bal- dassari, Andrew D. White, and Philippe Schwaller. 2024. Augmenting large language models with chem- istry tools. Nat. Mac. Intell., 6(5):525-535. · DOI · Paper page
  23. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, and 1 others. 2020. Language models are few-shot learners. Advances in neural information processing systems, 33:1877-1901.
  24. Markus J. Buehler. 2024. Accelerating scientific discovery with generative knowledge extraction, graph-based representation, and multimodal intelli- gent graph reasoning. Mach. Learn. Sci. Technol., 5(3):35083. · DOI
  25. Yupeng Cao, Aishwarya Muralidharan Nair, Elyon Ey- imife, Nastaran Jamalipour Soofi, K. P. Subbalak- shmi, John R. Wullert II, Chumki Basu, and David Shallcross. 2024b. Can large language models detect misinformation in scientific news reporting? CoRR, abs/2402.14268. · DOI
  26. Eric Chamoun, Michael Sejr Schlichtkrull, and Andreas Vlachos. 2024. Automated focused feedback genera- tion for scientific writing assistance. In Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, Au- gust 11-16, 2024, pages 9742-9763. Association for Computational Linguistics. · DOI
  27. Tzeng-Ji Chen. 2023. Chatgpt and other artificial intel- ligence applications speed up scientific writing. Jour- nal of the Chinese Medical Association, 86(4):351- 353.
  28. Ziru Chen, Shijie Chen, Yuting Ning, Qianheng Zhang, Boshi Wang, Botao Yu, Yifei Li, Zeyi Liao, Chen Wei, Zitong Lu, Vishal Dey, Mingyi Xue, Frazier N. Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, and Huan Sun. 2025. Scienceagentbench: Toward rigorous assessment of language agents for data-driven sci- entific discovery. In The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025. OpenReview.net.
  29. Gautam Choudhary, Natwar Modani, and Nitish Mau- rya. 2021. React: A review comment dataset for actionability (and more). In Web Information Sys- tems Engineering -WISE 2021 -22nd International Conference on Web Information Systems Engineer- ing, WISE 2021, Melbourne, VIC, Australia, October 26-29, 2021, Proceedings, Part II, volume 13081 of Lecture Notes in Computer Science, pages 336-343. Springer. · DOI · Paper page
  30. Julia Colyar. 2009. Becoming writing, becoming writ- ers. Qualitative Inquiry, 15(2):421-436.
  31. Paulo Henrique Couto, Quang Phuoc Ho, Nageeta Ku- mari, Benedictus Kent Rachmat, Thanh Gia Hieu Khuong, Ihsan Ullah, and Lisheng Sun-Hosoya. 2024. Relevai-reviewer: A benchmark on AI reviewers for survey paper relevance. CoRR, abs/2406.10294. · DOI
  32. Robert Dale and Adam Kilgarriff. 2010. Helping our own: Text massaging for computational linguistics as a new shared task. In Proceedings of the 6th Inter- national Natural Language Generation Conference.
  33. Preetam Prabhu Srikar Dammu, Himanshu Naidu, Mouly Dewan, YoungMin Kim, Tanya Roosta, Aman Chadha, and Chirag Shah. 2024. Claimver: Explain- able claim-level verification and evidence attribution of text through knowledge graphs. In Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, Florida, USA, November 12-16, 2024, pages 13613-13627. Association for Computational Linguistics.
  34. Hai Dang, Chelse Swoopes, Daniel Buschek, and Elena L. Glassman. 2025. Corpusstudio: Surfacing emergent patterns in A corpus of prior work while writing. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, CHI 2025, YokohamaJapan, 26 April 2025-1 May 2025, pages 1211:1-1211:19. ACM. · DOI
  35. Mike D'Arcy, Tom Hope, Larry Birnbaum, and Doug Downey. 2024a. MARG: multi-agent review genera- tion for scientific papers. CoRR, abs/2401.04259. · DOI · Paper page
  36. Mike D'Arcy, Alexis Ross, Erin Bransom, Bailey Kuehl, Jonathan Bragg, Tom Hope, and Doug Downey. 2024b. ARIES: A corpus of scientific paper edits made in response to peer reviews. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024, pages 6985-7001. Association for Computational Linguistics. · DOI · Paper page
  37. Anubrata Das, Houjiang Liu, Venelin Kovatchev, and Matthew Lease. 2023. The state of human-centered NLP technology for fact-checking. Inf. Process. Manag., 60(2):103219. · DOI
  38. Vidas Daudaravicius. 2015. Automated evaluation of scientific writing: Aesw shared task proposal. In Proceedings of the Tenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 56-63.
  39. José de la Torre-López, Aurora Ramírez, and José Raúl Romero. 2023. Artificial intelligence to automate the systematic review of scientific literature. Computing, 105(10):2171-2194. · DOI · Paper page
  40. DeepSeek-AI, Aixin Liu, Bei Feng, Bing Xue, Bingx- uan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, Damai Dai, Daya Guo, Dejian Yang, Deli Chen, Dongjie Ji, Erhang Li, Fangyun Lin, Fucong Dai, and 81 others. 2024. Deepseek-v3 technical report. CoRR, abs/2412.19437. · DOI · Paper page
  41. Alphaeus Dmonte, Roland Oruche, Marcos Zampieri, Prasad Calyam, and Isabelle Augenstein. 2024. Claim verification in the age of large language mod- els: A survey. CoRR, abs/2408.14317. · DOI
  42. Iddo Drori and Dov Te'eni. 2024. Human-in-the-loop AI reviewing: Feasibility, opportunities, and risks. J. Assoc. Inf. Syst., 25(1):7.
  43. Wanyu Du, Zae Myung Kim, Vipul Raheja, Dhruv Ku- mar, and Dongyeop Kang. 2022a. Read, revise, re- peat: A system demonstration for human-in-the-loop iterative text revision. CoRR, abs/2204.03685. · DOI
  44. Wanyu Du, Vipul Raheja, Dhruv Kumar, Zae Myung Kim, Melissa Lopez, and Dongyeop Kang. 2022b. Understanding iterative revision from human-written text. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Vol- ume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022, pages 3573-3590. Association for Computational Linguistics. · DOI
  45. Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Zhang, and 82 others. 2024. The llama 3 herd of models. CoRR, abs/2407.21783. · DOI · Paper page
  46. Nils Dycke, Ilia Kuznetsov, and Iryna Gurevych. 2023. Nlpeer: A unified resource for the computational study of peer review. In Proceedings of the 61st An- nual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023, pages 5049-5073. Association for Computational Linguistics. · DOI · Paper page
  47. Steffen Eger, Yong Cao, Jennifer D'Souza, Andreas Geiger, Christian Greisinger, Stephanie Gross, Yu- fang Hou, Brigitte Krenn, Anne Lauscher, Yizhi Li, Chenghua Lin, Nafise Sadat Moosavi, Wei Zhao, and Tristan Miller. 2025. Transforming science with large language models: A survey on ai-assisted scientific discovery, experimentation, content generation, and evaluation. CoRR, abs/2502.05151. · DOI
  48. Islam Eldifrawi, Shengrui Wang, and Amine Trabelsi. 2024. Automated justification production for claim veracity in fact checking: A survey on architectures and approaches. In Proceedings of the 62nd An- nual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024, pages 6679- 6692. Association for Computational Linguistics. · DOI · Paper page
  49. Noemie Elhadad, M-Y Kan, Judith L Klavans, and Kath- leen R McKeown. 2005. Customization in a unified framework for summarizing medical literature. Arti- ficial intelligence in medicine, 33(2):179-198. Eurostat. 2018. The measurement of scientific, techno- logical and innovation activities Oslo manual 2018 guidelines for collecting, reporting and using data on innovation. OECD publishing.
  50. Benedikt Fecher, Marcel Hebing, Melissa Laufer, Jörg Pohle, and Fabian Sofsky. 2023. Friend or foe? ex- ploring the implications of large language models on the science system. CoRR, abs/2306.09928. · DOI
  51. K. J. Kevin Feng, Kevin Pu, Matt Latzke, Tal August, Pao Siangliulue, Jonathan Bragg, Daniel S. Weld, Amy X. Zhang, and Joseph Chee Chang. 2024. Co- coa: Co-planning and co-execution with AI agents. CoRR, abs/2412.10999. · arXiv · doi:10.48550/arxiv.2412.10999
  52. Emily First, Markus N. Rabe, Talia Ringer, and Yuriy Brun. 2023. Baldur: Whole-proof generation and repair with large language models. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2023, San Fran- cisco, CA, USA, December 3-9, 2023, pages 1229- 1241. ACM. · DOI · Paper page
  53. Martin Funkquist, Ilia Kuznetsov, Yufang Hou, and Iryna Gurevych. 2023. Citebench: A benchmark for scientific citation text generation. In Proceedings of the 2023 Conference on Empirical Methods in Natu- ral Language Processing, EMNLP 2023, Singapore, December 6-10, 2023, pages 7337-7353. Association for Computational Linguistics. · DOI
  54. Catherine A. Gao, Frederick M. Howard, Nikolay S. Markov, Emma C. Dyer, Siddhi Ramesh, Yuan Luo, 11784 and Alexander T. Pearson. 2023a. Comparing scien- tific abstracts generated by chatgpt to real abstracts with detectors and blinded human reviewers. npj Digit. Medicine, 6. · DOI · Paper page
  55. Tianyu Gao, Howard Yen, Jiatong Yu, and Danqi Chen. 2023b. Enabling large language models to gener- ate text with citations. In Proceedings of the 2023 Conference on Empirical Methods in Natural Lan- guage Processing, EMNLP 2023, Singapore, Decem- ber 6-10, 2023, pages 6465-6488. Association for Computational Linguistics. · DOI · Paper page
  56. Alireza Ghafarollahi and Markus J. Buehler. 2024. Sci- agents: Automating scientific discovery through multi-agent intelligent graph reasoning. CoRR, abs/2409.05556. · DOI
  57. Karan Girotra, Lennart Meincke, Christian Terwiesch, and Karl T Ulrich. 2023. Ideas are dimes a dozen: Large language models for idea generation in innova- tion. Available at SSRN 4526071.
  58. Max Glockner, Yufang Hou, and Iryna Gurevych. 2022. Missing counter-evidence renders NLP fact-checking unrealistic for misinformation. In Proceedings of the 2022 Conference on Empirical Methods in Natu- ral Language Processing, EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022, pages 5916-5936. Association for Computational Linguis- tics. · DOI
  59. Max Glockner, Yufang Hou, Preslav Nakov, and Iryna Gurevych. 2024a. Grounding fallacies misrepre- senting scientific publications in evidence. CoRR, abs/2408.12812. · arXiv · doi:10.48550/arxiv.2408.12812
  60. Max Glockner, Yufang Hou, Preslav Nakov, and Iryna Gurevych. 2024b. Missci: Reconstructing fallacies in misrepresented science. In Proceedings of the 62nd Annual Meeting of the Association for Compu- tational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024, pages 4372-4405. Association for Computational Linguis- tics. · DOI
  61. Mourad Gridach, Jay Nanavati, Khaldoun Zine El Abidine, Lenon Mendes, and Christina Mack. 2025. Agentic ai for scientific discovery: A survey of progress, challenges, and future directions. arXiv preprint arXiv:2503.08979. · arXiv
  62. Nianlong Gu and Richard Hahnloser. 2024. Control- lable citation sentence generation with language mod- els. In Proceedings of the Fourth Workshop on Schol- arly Document Processing (SDP 2024), pages 22-37. Association for Computational Linguistics.
  63. Nianlong Gu and Richard H. R. Hahnloser. 2023. Scilit: A platform for joint scientific literature discovery, summarization and citation generation. In Proceed- ings of the 61st Annual Meeting of the Association for Computational Linguistics: System Demonstrations, ACL 2023, Toronto, Canada, July 10-12, 2023, pages 235-246. Association for Computational Linguistics. · DOI
  64. Xuemei Gu and Mario Krenn. 2024. Generation and human-expert evaluation of interesting research ideas using knowledge graphs and large language models. CoRR, abs/2405.17044. · DOI
  65. Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shi- rong Ma, Peiyi Wang, Xiao Bi, and 1 others. 2025. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948. · arXiv
  66. Sikun Guo, Amir Hassan Shariatmadari, Guangzhi Xiong, Albert Huang, Eric Xie, Stefan Bekiranov, and Aidong Zhang. 2024. Ideabench: Benchmarking large language models for research idea generation. CoRR, abs/2411.02429. · DOI
  67. Rohun Gupta, Isabel Herzog, Joseph Weisberger, John Chao, Kongkrit Chaiyasate, and Edward S Lee. 2023. Utilization of chatgpt for plastic surgery research: friend or foe? Journal of Plastic, Reconstructive & Aesthetic Surgery, 80:145-147.
  68. Tarun Gupta and Danish Pruthi. 2025. All that glitters is not novel: Plagiarism in AI generated research. CoRR, abs/2502.16487. · DOI
  69. Andrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S. Weld, and Marti A. Hearst. 2021. Augmenting scientific papers with just- in-time, position-sensitive definitions of terms and symbols. In CHI '21: CHI Conference on Human Factors in Computing Systems, Virtual Event / Yoko- hama, Japan, May 8-13, 2021, pages 413:1-413:18. ACM. · DOI
  70. Sam Henry and Bridget T. McInnes. 2017. Literature based discovery: Models, methods, and trends. J. Biomed. Informatics, 74:20-32. · DOI · Paper page
  71. Aidan Hogan, Eva Blomqvist, Michael Cochez, Clau- dia D'amato, Gerard De Melo, Claudio Gutierrez, Sabrina Kirrane, José Emilio Labra Gayo, Roberto Navigli, Sebastian Neumaier, Axel-Cyrille Ngonga Ngomo, Axel Polleres, Sabbir M. Rashid, Anisa Rula, Lukas Schmelzeisen, Juan Sequeda, Steffen Staab, and Antoine Zimmermann. 2021. Knowledge graphs. ACM Comput. Surv., 54(4). · DOI · Paper page
  72. Chao-Chun Hsu, Erin Bransom, Jenna Sparks, Bailey Kuehl, Chenhao Tan, David Wadden, Lucy Lu Wang, and Aakanksha Naik. 2024. CHIME: llm-assisted hierarchical organization of scientific studies for liter- ature review support. In Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024, pages 118-132. Association for Computational Lin- guistics. · DOI
  73. Xiang Hu, Hongyu Fu, Jinge Wang, Yifeng Wang, Zhikun Li, Renjun Xu, Yu Lu, Yaochu Jin, Lili Pan, and Zhenzhong Lan. 2024a. Nova: An itera- tive planning and search approach to enhance nov- elty and diversity of LLM generated ideas. CoRR, abs/2410.14255. · DOI
  74. Yuntong Hu, Zhuofeng Li, Zheng Zhang, Chen Ling, Raasikh Kanjiani, Boxin Zhao, and Liang Zhao. 2024b. Hireview: Hierarchical taxonomy-driven au- tomatic literature review generation. arXiv preprint arXiv:2410.03761. · arXiv
  75. Xinyu Hua, Mitko Nikolov, Nikhil Badugu, and Lu Wang. 2019. Argument mining for understanding peer reviews. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Tech- nologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers), pages 2131-2137. Association for Computational Linguistics. · DOI · Paper page
  76. Jingshan Huang and Ming Tan. 2023. The role of chat- gpt in scientific communication: writing better sci- entific review articles. American journal of cancer research, 13(4):1148.
  77. Kaixuan Huang, Yuanhao Qu, Henry Cousins, William A. Johnson, Di Yin, Mihir Shah, Denny Zhou, Russ B. Altman, Mengdi Wang, and Le Cong. 2024a. CRISPR-GPT: an LLM agent for auto- mated design of gene-editing experiments. CoRR, abs/2404.18021. · DOI
  78. Kexin Huang, Ying Jin, Ryan Li, Michael Y. Li, Em- manuel J. Candès, and Jure Leskovec. 2025. Auto- mated hypothesis validation with agentic sequential falsifications. CoRR, abs/2502.09858. · DOI · Paper page
  79. Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, and Ting Liu. 2023. A survey on hallucination in large lan- guage models: Principles, taxonomy, challenges, and open questions. CoRR, abs/2311.05232. · DOI · Paper page
  80. Qian Huang, Jian Vora, Percy Liang, and Jure Leskovec. 2024b. Mlagentbench: Evaluating language agents on machine learning experimentation. In Forty- first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. Open- Review.net.
  81. Yinya Huang, Xiaohan Lin, Zhengying Liu, Qingxing Cao, Huajian Xin, Haiming Wang, Zhenguo Li, Linqi Song, and Xiaodan Liang. 2024c. MUSTARD: mas- tering uniform synthesis of theorem and proof data. In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net.
  82. Matthew Hutson. 2022. Could ai help you to write your next paper? Nature, 611(7934):192-193.
  83. Maximilian Idahl and Zahra Ahmadi. 2024. Open- reviewer: A specialized large language model for generating critical scientific paper reviews. CoRR, abs/2412.11948. · DOI · Paper page
  84. Tal Ifargan, Lukas Hafner, Maor Kern, Ori Alcalay, and Roy Kishony. 2024. Autonomous llm-driven re- search from data to human-verifiable research papers. CoRR, abs/2404.17605. · DOI
  85. Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richard- son, Ahmed El-Kishky, Aiden Low, Alec Hel- yar, Aleksander Madry, Alex Beutel, Alex Carney, Alex Iftimie, Alex Karpenko, Alex Tachard Passos, Alexander Neitz, Alexander Prokofiev, Alexander Wei, Allison Tam, Ally Bennett, Ananya Kumar, and 80 others. 2024. Openai o1 system card. CoRR, abs/2412.16720. · arXiv · doi:10.48550/arxiv.2412.16720 · Paper page
  86. Peter Jansen, Oyvind Tafjord, Marissa Radensky, Pao Siangliulue, Tom Hope, Bhavana Dalvi Mishra, Bod- hisattwa Prasad Majumder, Daniel S Weld, and Pe- ter Clark. 2025. Codescientist: End-to-end semi- automated scientific discovery with code-based ex- perimentation. arXiv preprint arXiv:2503.22708. · arXiv
  87. Peter A. Jansen, Marc-Alexandre Côté, Tushar Khot, Erin Bransom, Bhavana Dalvi Mishra, Bod- hisattwa Prasad Majumder, Oyvind Tafjord, and Peter Clark. 2024. Discoveryworld: A virtual environment for developing and evaluating automated scientific discovery agents. In Advances in Neural Information Processing Systems 38: Annual Conference on Neu- ral Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 -15, 2024.
  88. Albert Qiaochu Jiang, Wenda Li, Szymon Tworkowski, Konrad Czechowski, Tomasz Odrzygózdz, Piotr Mi- los, Yuhuai Wu, and Mateja Jamnik. 2022a. Thor: Wielding hammers to integrate language models and automated theorem provers. In Advances in Neural Information Processing Systems 35: Annual Confer- ence on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 -December 9, 2022.
  89. Albert Qiaochu Jiang, Sean Welleck, Jin Peng Zhou, Timothée Lacroix, Jiacheng Liu, Wenda Li, Mateja Jamnik, Guillaume Lample, and Yuhuai Wu. 2023. Draft, sketch, and prove: Guiding formal theorem provers with informal proofs. In The Eleventh In- ternational Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. Open- Review.net.
  90. Chao Jiang, Wei Xu, and Samuel Stevens. 2022b. arx- ivedits: Understanding the human revision process in scientific writing. In Proceedings of the 2022 Con- ference on Empirical Methods in Natural Language Processing, EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022, pages 9420-9435. Association for Computational Linguistics. · DOI · Paper page
  91. Yiqiao Jin, Qinlin Zhao, Yiyang Wang, Hao Chen, Kai- jie Zhu, Yijia Xiao, and Jindong Wang. 2024. Agen- treview: Exploring peer review dynamics with LLM agents. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024, pages 1208-1226. Association for Computa- tional Linguistics.
  92. Léane Jourdan, Florian Boudin, Richard Dufour, and Nicolas Hernandez. 2023. Text revision in sci- entific writing assistance: An overview. CoRR, abs/2303.16726. · DOI
  93. Léane Jourdan, Nicolas Hernandez, Richard Dufour, Florian Boudin, and Akiko Aizawa. 2025. Pararev: Building a dataset for scientific paragraph revision annotated with revision instruction. arXiv preprint arXiv:2501.05222. · arXiv
  94. Léane Isabelle Jourdan, Florian Boudin, Nicolas Her- nandez, and Richard Dufour. 2024. CASIMIR: A corpus of scientific articles enhanced with multiple author-integrated revisions. In Proceedings of the 2024 Joint International Conference on Computa- tional Linguistics, Language Resources and Evalua- tion, LREC/COLING 2024, 20-25 May, 2024, Torino, Italy, pages 2883-2892. ELRA and ICCL.
  95. Shing-Yun Jung, Ting-Han Lin, Chia-Hung Liao, Shyan- Ming Yuan, and Chuen-Tsai Sun. 2022. Intent- controllable citation text generation. Mathematics, 10(10):1763.
  96. Melissa A Kacena, Lilian I Plotkin, and Jill C Fehren- bacher. 2024. The use of artificial intelligence in writing scientific review articles. Current Osteoporo- sis Reports, 22(1):115-121.
  97. Subbarao Kambhampati, Karthik Valmeekam, Lin Guan, Mudit Verma, Kaya Stechly, Siddhant Bham- bri, Lucas Saldyt, and Anil Murthy. 2024. Position: Llms can't plan, but can help planning in llm-modulo frameworks. In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net.
  98. Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine van Zuylen, Sebastian Kohlmeier, Ed- uard H. Hovy, and Roy Schwartz. 2018. A dataset of peer reviews (peerread): Collection, insights and NLP applications. In Proceedings of the 2018 Con- ference of the North American Chapter of the Associ- ation for Computational Linguistics: Human Lan- guage Technologies, NAACL-HLT 2018, New Or- leans, Louisiana, USA, June 1-6, 2018, Volume 1 (Long Papers), pages 1647-1661. Association for Computational Linguistics. · DOI · Paper page
  99. Dongyeop Kang, Andrew Head, Risham Sidhu, Kyle Lo, Daniel S. Weld, and Marti A. Hearst. 2020. Document-level definition detection in scholarly doc- uments: Existing models, error analyses, and future directions. In Proceedings of the First Workshop on Scholarly Document Processing, SDP@EMNLP 2020, Online, November 19, 2020, pages 196-206. Association for Computational Linguistics. · DOI
  100. Hyeonsu B. Kang, Rafal Kocielnik, Andrew Head, Jiangjiang Yang, Matt Latzke, Aniket Kittur, Daniel S. Weld, Doug Downey, and Jonathan Bragg. 2022. From who you know to what you read: Aug- menting scientific recommendations with implicit social networks. In CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022 -5 May 2022, pages 302:1- 302:23. ACM. · DOI
  101. Hyeonsu B. Kang, Nouran Soliman, Matt Latzke, Joseph Chee Chang, and Jonathan Bragg. 2023. Com- littee: Literature discovery with personal elected au- thor committees. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023, Hamburg, Germany, April 23-28, 2023, pages 738:1-738:20. ACM. · DOI
  102. Ying Kang, Aiqin Hou, Zimin Zhao, and Daguang Gan. 2021. A hybrid approach for paper recommendation. IEICE TRANSACTIONS on Information and Systems, 104(8):1222-1231.
  103. Wei-Yu Kao and An-Zi Yen. 2024. MAGIC: multi- argument generation with self-refinement for domain generalization in automatic fact-checking. In Pro- ceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC/COLING 2024, 20-25 May, 2024, Torino, Italy, pages 10891-10902. ELRA and ICCL.
  104. Tetsu Kasanishi, Masaru Isonuma, Junichiro Mori, and Ichiro Sakata. 2023. Scireviewgen: A large-scale dataset for automatic literature review generation. In Findings of the Association for Computational Lin- guistics: ACL 2023, Toronto, Canada, July 9-14, 2023, pages 6695-6715. Association for Computa- tional Linguistics. · DOI
  105. Uri Katz, Mosh Levy, and Yoav Goldberg. 2024. Knowl- edge navigator: Llm-guided browsing framework for exploratory search in scientific literature. In Find- ings of the Association for Computational Linguis- tics: EMNLP 2024, Miami, Florida, USA, November 12-16, 2024, pages 8838-8855. Association for Com- putational Linguistics.
  106. Jiho Kim, Sungjin Park, Yeonsu Kwon, Yohan Jo, James Thorne, and Edward Choi. 2023. Factkg: Fact ver- ification via reasoning on knowledge graphs. In Proceedings of the 61st Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023, pages 16190-16206. Association for Computa- tional Linguistics. · DOI
  107. Zae Myung Kim, Wanyu Du, Vipul Raheja, Dhruv Ku- mar, and Dongyeop Kang. 2022. Improving iterative Ryan Koo, Anna Martin, Linghe Wang, and Dongyeop Kang. 2023. Decoding the end-to-end writ- ing trajectory in scholarly manuscripts. CoRR, abs/2304.00121. · DOI
  108. Kayvan Kousha and Mike Thelwall. 2024. Artificial intelligence to support publishing and peer review: A summary and review. Learn. Publ., 37(1):4-12. · DOI · Paper page
  109. Mario Krenn, Lorenzo Buffoni, Bruno C. Coutinho, Sagi Eppel, Jacob Gates Foster, Andrew Gritsevskiy, Harlin Lee, Yichao Lu, João P. Moutinho, Nima San- jabi, Rishi Sonthalia, Ngoc Mai Tran, Francisco Va- lente, Yangxinyu Xie, Rose Yu, and Michael Kopp. 2022. Predicting the future of AI with AI: high- quality link prediction in an exponentially growing knowledge network. CoRR, abs/2210.00881. · arXiv · doi:10.48550/arxiv.2210.00881
  110. Christin Katharina Kreutz and Ralf Schenkel. 2022. Sci- entific paper recommendation systems: a literature review of recent publications. Int. J. Digit. Libr., 23(4):335-369. · DOI
  111. Amrith Krishna, Sebastian Riedel, and Andreas Vlachos. 2022. Proofver: Natural logic theorem proving for fact verification. Trans. Assoc. Comput. Linguistics, 10:1013-1030. · DOI · Paper page
  112. Adithya Kulkarni, Fatimah Alotaibi, Xinyue Zeng, Longfeng Wu, Tong Zeng, Barry Menglong Yao, Minqian Liu, Shuaicheng Zhang, Lifu Huang, and Dawei Zhou. 2025. Scientific hypothesis generation and validation: Methods, datasets, and future direc- tions. arXiv preprint arXiv:2505.04651. · arXiv
  113. Sandeep Kumar, Tirthankar Ghosal, and Asif Ekbal. 2023. When reviewers lock horns: Finding disagree- ments in scientific peer reviews. In Proceedings of the 2023 Conference on Empirical Methods in Natu- ral Language Processing, EMNLP 2023, Singapore, December 6-10, 2023, pages 16693-16704. Associa- tion for Computational Linguistics. · DOI
  114. Sandeep Kumar, Tirthankar Ghosal, Vinayak Goyal, and Asif Ekbal. 2024. Can large language mod- els unlock novel scientific research ideas? CoRR, abs/2409.06185. · DOI
  115. Ilia Kuznetsov, Osama Mohammed Afzal, Koen Der- cksen, Nils Dycke, Alexander Goldberg, Tom Hope, Dirk Hovy, Jonathan K. Kummerfeld, Anne Lauscher, Kevin Leyton-Brown, Sheng Lu, Mausam, Margot Mieskes, Aurélie Névéol, Danish Pruthi, Lizhen Qu, Roy Schwartz, Noah A. Smith, Thamar Solorio, and 5 others. 2024. What can natural language processing do for peer review? CoRR, abs/2405.06563. · DOI · Paper page
  116. Yuxuan Lai, Yupeng Wu, Yidan Wang, Wenpeng Hu, and Chen Zheng. 2024. Instruct large language mod- els to generate scientific literature survey step by step. In Natural Language Processing and Chinese Com- puting -13th National CCF Conference, NLPCC 2024, Hangzhou, China, November 1-3, 2024, Pro- ceedings, Part V, volume 15363 of Lecture Notes in Computer Science, pages 484-496. Springer. · DOI
  117. Guillaume Lample, Timothée Lacroix, Marie-Anne Lachaux, Aurélien Rodriguez, Amaury Hayat, Thibaut Lavril, Gabriel Ebner, and Xavier Martinet. 2022. Hypertree proof search for neural theorem proving. In Advances in Neural Information Pro- cessing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 -December 9, 2022.
  118. Jon M. Laurent, Joseph D. Janizek, Michael Ruzo, Michaela M. Hinks, Michael J. Hammerling, Sid- dharth Narayanan, Manvitha Ponnapati, Andrew D. White, and Samuel G. Rodriques. 2024. Lab-bench: Measuring capabilities of language models for biol- ogy research. CoRR, abs/2407.10362. · DOI · Paper page
  119. Yoonjoo Lee, Hyeonsu B. Kang, Matt Latzke, Juho Kim, Jonathan Bragg, Joseph Chee Chang, and Pao Siangliulue. 2024. Paperweaver: Enriching topical paper alerts by contextualizing recommended papers with user-collected papers. In Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI 2024, Honolulu, HI, USA, May 11-16, 2024, pages 19:1-19:19. ACM. · DOI
  120. Jingjing Li, Zichao Li, Tao Ge, Irwin King, and Michael R. Lyu. 2022. Text revision by on-the-fly representation optimization. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial In- telligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022, pages 10956-10964. AAAI Press. · DOI
  121. Long Li, Weiwen Xu, Jiayan Guo, Ruochen Zhao, Xingxuan Li, Yuqian Yuan, Boqiang Zhang, Yuming Jiang, Yifei Xin, Ronghao Dang, Deli Zhao, Yu Rong, Tian Feng, and Lidong Bing. 2024a. Chain of ideas: Revolutionizing research via novel idea development with LLM agents. CoRR, abs/2410.13185. · DOI
  122. Miao Li, Eduard H. Hovy, and Jey Han Lau. 2023. Sum- marizing multiple documents with conversational structure for meta-review generation. In Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023, pages 7089-7112. Association for Computational Linguistics. · DOI
  123. Miao Li, Jey Han Lau, and Eduard H. Hovy. 2024b. A sentiment consolidation framework for meta-review generation. In Proceedings of the 62nd Annual Meet- ing of the Association for Computational Linguis- tics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024, pages 10158-10177. Association for Computational Linguistics. · DOI
  124. Ruochen Li, Liqiang Jing, Chi Han, Jiawei Zhou, and Xinya Du. 2024c. Learning to generate research idea with dynamic control. CoRR, abs/2412.14626. · arXiv · doi:10.48550/arxiv.2412.14626
  125. Ruochen Li, Teerth Patel, Qingyun Wang, and Xinya Du. 2024d. Mlr-copilot: Autonomous machine learn- ing research based on large language models agents. CoRR, abs/2408.14033. · DOI
  126. Weisheng Li, Chao Chang, Chaobo He, Zhengyang Wu, Jiongsheng Guo, and Bo Peng. 2020. Academic paper recommendation method combining hetero- geneous network and temporal attributes. In Com- puter Supported Cooperative Work and Social Com- puting -15th CCF Conference, ChineseCSCW 2020, Shenzhen, China, November 7-9, 2020, Revised Se- lected Papers, volume 1330 of Communications in Computer and Information Science, pages 456-468. Springer. · doi:10.1007/978-981-16-2540-4_33
  127. Xiangci Li and Jessica Ouyang. 2022. Automatic related work generation: A meta study. CoRR, abs/2201.01880. · arXiv
  128. Xiangci Li and Jessica Ouyang. 2024. Related work and citation text generation: A survey. In Proceedings of the 2024 Conference on Empirical Methods in Natu- ral Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024, pages 13846-13864. Association for Computational Linguistics.
  129. Zhaoyu Li, Jialiang Sun, Logan Murphy, Qidong Su, Zenan Li, Xian Zhang, Kaiyu Yang, and Xujie Si. 2024e. A survey on deep learning for theorem prov- ing. CoRR, abs/2404.09939. · DOI
  130. Zhi Li and Xiaozhu Zou. 2019. A review on personal- ized academic paper recommendation. Comput. Inf. Sci., 12(1):33-43. · DOI
  131. Weixin Liang, Zachary Izzo, Yaohui Zhang, Haley Lepp, Hancheng Cao, Xuandong Zhao, Lingjiao Chen, Hao- tian Ye, Sheng Liu, Zhi Huang, Daniel A. McFarland, and James Y. Zou. 2024a. Monitoring ai-modified content at scale: A case study on the impact of chat- gpt on AI conference peer reviews. In Forty-first In- ternational Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenRe- view.net.
  132. Weixin Liang, Yaohui Zhang, Zhengxuan Wu, Haley Lepp, Wenlong Ji, Xuandong Zhao, Hancheng Cao, Sheng Liu, Siyu He, Zhi Huang, Diyi Yang, Christo- pher Potts, Christopher D. Manning, and James Y. Zou. 2024b. Mapping the increasing use of llms in scientific papers. CoRR, abs/2404.01268. · DOI · Paper page
  133. Weixin Liang, Yuhui Zhang, Hancheng Cao, Binglu Wang, Daisy Ding, Xinyu Yang, Kailas Vodrahalli, Siyu He, Daniel Scott Smith, Yian Yin, Daniel A. McFarland, and James Zou. 2023. Can large lan- guage models provide useful feedback on research papers? A large-scale empirical analysis. CoRR, abs/2310.01783. · DOI · Paper page
  134. Zhehui Liao, Maria Antoniak, Inyoung Cheong, Evie Yu-Yen Cheng, Ai-Heng Lee, Kyle Lo, Joseph Chee Chang, and Amy X. Zhang. 2024. Llms as research tools: A large scale survey of researchers' usage and perceptions. CoRR, abs/2411.05025. · DOI · Paper page
  135. Haohan Lin, Zhiqing Sun, Yiming Yang, and Sean Welleck. 2024. Lean-star: Learning to interleave thinking and proving. CoRR, abs/2407.10040. · DOI · Paper page
  136. Jialiang Lin, Jiaxin Song, Zhangping Zhou, Yidong Chen, and Xiaodong Shi. 2023a. Automated schol- arly paper review: Concepts, technologies, and chal- lenges. Inf. Fusion, 98:101830. · DOI · Paper page
  137. Jialiang Lin, Jiaxin Song, Zhangping Zhou, Yidong Chen, and Xiaodong Shi. 2023b. MOPRD: A multi- disciplinary open peer review dataset. Neural Com- put. Appl., 35(34):24191-24206. · doi:10.1007/s00521-023-08891-5 · Paper page
  138. Zhicheng Lin. 2024. Techniques for supercharging aca- demic writing with generative ai. Nature Biomedical Engineering, pages 1-6.
  139. Chengwu Liu, Jianhao Shen, Huajian Xin, Zhengying Liu, Ye Yuan, Haiming Wang, Wei Ju, Chuanyang Zheng, Yichun Yin, Lin Li, Ming Zhang, and Qun Liu. 2023a. FIMO: A challenge formal dataset for automated theorem proving. CoRR, abs/2309.04295. · DOI
  140. Haokun Liu, Yangqiaoyu Zhou, Mingxuan Li, Chenfei Yuan, and Chenhao Tan. 2024a. Literature meets data: A synergistic approach to hypothesis genera- tion. CoRR, abs/2410.17309. · arXiv · doi:10.48550/arxiv.2410.17309
  141. Ruibo Liu, Ruixin Yang, Chenyan Jia, Ge Zhang, Denny Zhou, Andrew M. Dai, Diyi Yang, and Soroush Vosoughi. 2023b. Training socially aligned lan- guage models in simulated human society. CoRR, abs/2305.16960. · DOI · Paper page
  142. Ryan Liu and Nihar B. Shah. 2023. Reviewergpt? an exploratory study on using large language models for paper reviewing. CoRR, abs/2306.00622. · DOI · Paper page
  143. Shengchao Liu, Jiongxiao Wang, Yijin Yang, Cheng- peng Wang, Ling Liu, Hongyu Guo, and Chaowei Xiao. 2024b. Conversational drug editing using re- trieval and domain feedback. In The Twelfth Inter- national Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. Open- Review.net.
  144. Shuaiqi Liu, Jiannong Cao, Ruosong Yang, and Zhiyuan Wen. 2022. Generating a structured summary of numerous academic papers: Dataset and method. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022, Vienna, Austria, 23-29 July 2022, pages 4259-4265. ijcai.org. · DOI
  145. Siyi Liu, Chen Gao, and Yong Li. 2024c. Large lan- guage model agent for hyper-parameter optimization. CoRR, abs/2402.01881. · DOI
  146. Zijun Liu, Kaiming Liu, Yiqi Zhu, Xuanyu Lei, Zong- han Yang, Zhenhe Zhang, Peng Li, and Yang Liu. 2024d. AIGS: generating science from ai-powered automated falsification. CoRR, abs/2411.11910. · DOI · Paper page
  147. Kyle Lo, Joseph Chee Chang, Andrew Head, Jonathan Bragg, Amy X. Zhang, Cassidy Trier, Chloe Anas- tasiades, Tal August, Russell Authur, Danielle Bragg, Erin Bransom, Isabel Cachola, Stefan Candra, Yo- ganand Chandrasekhar, Yen-Sung Chen, Evie Yu- Yen Cheng, Yvonne Chou, Doug Downey, Rob Evans, and 36 others. 2023. The semantic reader project: Augmenting scholarly documents through ai-powered interactive reading interfaces. CoRR, abs/2303.14334. · DOI
  148. Renze Lou, Hanzi Xu, Sijia Wang, Jiangshu Du, Ryo Kamoi, Xiaoxin Lu, Jian Xie, Yuxuan Sun, Yusen Zhang, Jihyun Janice Ahn, Hongchao Fang, Zhuoyang Zou, Wenchao Ma, Xi Li, Kai Zhang, Con- gying Xia, Lifu Huang, and Wenpeng Yin. 2024. AAAR-1.0: assessing ai's potential to assist research. CoRR, abs/2410.22394. · DOI · Paper page
  149. Chris Lu, Cong Lu, Robert Tjarko Lange, Jakob Foer- ster, Jeff Clune, and David Ha. 2024. The AI scien- tist: Towards fully automated open-ended scientific discovery. CoRR, abs/2408.06292. · DOI · Paper page
  150. Xinyuan Lu, Liangming Pan, Qian Liu, Preslav Nakov, and Min-Yen Kan. 2023. SCITAB: A challenging benchmark for compositional reasoning and claim verification on scientific tables. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, De- cember 6-10, 2023, pages 7787-7813. Association for Computational Linguistics. · DOI
  151. Ziming Luo, Zonglin Yang, Zexin Xu, Wei Yang, and Xinya Du. 2025. Llm4sr: A survey on large lan- guage models for scientific research. arXiv preprint arXiv:2501.04306. · arXiv
  152. Pingchuan Ma, Tsun-Hsuan Wang, Minghao Guo, Zhiqing Sun, Joshua B. Tenenbaum, Daniela Rus, Chuang Gan, and Wojciech Matusik. 2024. LLM and simulation as bilevel optimizers: A new paradigm to advance physical scientific discovery. In Forty- first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. Open- Review.net.
  153. Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdan- bakhsh, and Peter Clark. 2023. Self-refine: Itera- tive refinement with self-feedback. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Sys- tems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023.
  154. Bodhisattwa Prasad Majumder, Harshit Surana, Dhruv Agarwal, Sanchaita Hazra, Ashish Sabharwal, and Peter Clark. 2024a. Position: Data-driven discovery with large generative models. In Forty-first Interna- tional Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net.
  155. Bodhisattwa Prasad Majumder, Harshit Surana, Dhruv Agarwal, Bhavana Dalvi Mishra, Abhijeetsingh Meena, Aryan Prakhar, Tirth Vora, Tushar Khot, Ashish Sabharwal, and Peter Clark. 2024b. Discov- erybench: Towards data-driven discovery with large language models. CoRR, abs/2407.01725. · DOI
  156. Anna Martin-Boyle, Aahan Tyagi, Marti A. Hearst, and Dongyeop Kang. 2024. Shallow synthesis of knowledge in gpt-generated texts: A case study in automatic related work composition. CoRR, abs/2402.12255. · DOI
  157. Rui Meng, Khushboo Thaker, Lei Zhang, Yue Dong, Xingdi Yuan, Tong Wang, and Daqing He. 2021. Bringing structure into summaries: a faceted sum- marization dataset for long scientific documents. In Proceedings of the 59th Annual Meeting of the Asso- ciation for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 2: Short Papers), Virtual Event, August 1-6, 2021, pages 1080- 1089. Association for Computational Linguistics. · DOI
  158. Lisa Messeri and MJ Crockett. 2024. Artificial intel- ligence and illusions of understanding in scientific research. Nature, 627(8002):49-58.
  159. Xinyi Mou, Xuanwen Ding, Qi He, Liang Wang, Jing- cong Liang, Xinnong Zhang, Libo Sun, Jiayu Lin, Jie Zhou, Xuanjing Huang, and Zhongyu Wei. 2024. From individual to society: A survey on social simu- lation driven by large language model-based agents. CoRR, abs/2412.03563. · DOI
  160. Panitan Muangkammuen, Fumiyo Fukumoto, Jiyi Li, and Yoshimi Suzuki. 2022. Exploiting labeled and unlabeled data via transformer fine-tuning for peer- review score prediction. In Findings of the Associ- ation for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022, pages 2233-2240. Association for Computa- tional Linguistics. · DOI
  161. Arief Purnama Muharram and Ayu Purwarianti. 2024. Enhancing natural language inference performance with knowledge graph for COVID-19 automated fact-checking in indonesian language. CoRR, abs/2409.00061. · arXiv · doi:10.48550/arxiv.2409.00061
  162. Bo Ni and Markus J. Buehler. 2023. Mechagents: Large language model multi-agent collaborations can solve mechanics problems, generate new data, and inte- grate knowledge. CoRR, abs/2311.08166. · DOI
  163. Ziqi Ni, Yahao Li, Kaijia Hu, Kunyuan Han, Ming Xu, Xingyu Chen, Fengqi Liu, Yicong Ye, and Shuxin Bai. 2024. Matpilot: an llm-enabled AI materials scientist under the framework of human-machine col- laboration. CoRR, abs/2411.08063. · DOI
  164. Harshit Nigam, Manasi Patwardhan, Lovekesh Vig, and Gautam Shroff. 2024. Acceleron: A tool to acceler- ate research ideation. CoRR, abs/2403.04382. · DOI
  165. Kazuya Nishimura, Kuniaki Saito, Tosho Hirasawa, and Yoshitaka Ushiku. 2024. Toward related work genera- tion with structure and novelty statement. In Proceed- ings of the Fourth Workshop on Scholarly Document Processing (SDP 2024), pages 38-57.
  166. Liang Niu, Nian Xue, and Christina Pöpper. 2023. Un- veiling the sentinels: Assessing AI performance in cybersecurity peer review. CoRR, abs/2309.05457. · DOI
  167. OpenAI. 2023. GPT-4 technical report. CoRR, abs/2303.08774. · DOI · Paper page
  168. Srishti Palani, Aakanksha Naik, Doug Downey, Amy X. Zhang, Jonathan Bragg, and Joseph Chee Chang. 2023. Relatedly: Scaffolding literature reviews with existing related work sections. In Proceedings of the 2023 CHI Conference on Human Factors in Comput- ing Systems, CHI 2023, Hamburg, Germany, April 23-28, 2023, pages 742:1-742:20. ACM. · DOI
  169. Liangming Pan, Xiaobao Wu, Xinyuan Lu, Anh Tuan Luu, William Yang Wang, Min-Yen Kan, and Preslav Nakov. 2023a. Fact-checking complex claims with program-guided reasoning. In Proceedings of the 61st Annual Meeting of the Association for Compu- tational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023, pages 6981- 7004. Association for Computational Linguistics. · DOI
  170. Liangming Pan, Yunxiang Zhang, and Min-Yen Kan. 2023b. Investigating zero-and few-shot general- ization in fact verification. In Proceedings of the 13th International Joint Conference on Natural Lan- guage Processing and the 3rd Conference of the Asia- Pacific Chapter of the Association for Computational Linguistics, IJCNLP 2023 -Volume 1: Long Papers, Nusa Dua, Bali, November 1 -4, 2023, pages 511- 524. Association for Computational Linguistics. · DOI
  171. Pat Pataranutaporn, Nattavudh Powdthavee, and Pat- tie Maes. 2025. Can AI solve the peer review cri- sis? A large scale experiment on llm's performance and biases in evaluating economics papers. CoRR, abs/2502.00070. · DOI
  172. Alison Pease, Simon Colton, Chris Warburton, Athana- sios Nathanail, Irina Preda, Daniel Arnold, Daniel Winterstein, and Mike Cook. 2019. The importance of applying computational creativity to scientific and mathematical domains. In 10th International Confer- ence on Computational Creativity, ICCC 2019, pages 250-257. Association for Computational Creativity.
  173. Iratxe Pinedo, Mikel Larrañaga, and Ana Arruarte. 2024. Arzigo: A recommendation system for scientific arti- cles. Inf. Syst., 122:102367. · DOI
  174. Milton Pividori and Casey S. Greene. 2024. A pub- lishing infrastructure for artificial intelligence (ai)- assisted academic authoring. J. Am. Medical Infor- matics Assoc., 31(9):2103-2113. · DOI
  175. Andrea Polonioli. 2021. The ethics of scientific recom- mender systems. Scientometrics, 126(2):1841-1848. · DOI
  176. Stanislas Polu and Ilya Sutskever. 2020. Generative language modeling for automated theorem proving. CoRR, abs/2009.03393. · arXiv
  177. Kevin Pu, K. J. Kevin Feng, Tovi Grossman, Tom Hope, Bhavana Dalvi Mishra, Matt Latzke, Jonathan Bragg, Joseph Chee Chang, and Pao Siangliu- lue. 2024. Ideasynth: Iterative research idea de- velopment through evolving and composing idea facets with literature-grounded feedback. CoRR, abs/2410.04025. · arXiv · doi:10.48550/arxiv.2410.04025
  178. Biqing Qi, Kaiyan Zhang, Haoxiang Li, Kai Tian, Si- hang Zeng, Zhang-Ren Chen, and Bowen Zhou. 2023. Large language models are zero shot hypothesis pro- posers. CoRR, abs/2311.05965. · DOI
  179. Hanhao Qu, Yu Cao, Jun Gao, Liang Ding, and Ruifeng Xu. 2022. Interpretable proof generation via iterative backward reasoning. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2022, Seattle, WA, United States, July 10-15, 2022, pages 2968-2981. Association for Computational Linguistics. · DOI
  180. Gollam Rabby, Diyana Muhammed, Prasenjit Mitra, and Sören Auer. 2025. Iterative hypothesis gen- eration for scientific discovery with monte carlo nash equilibrium self-refining trees. arXiv preprint arXiv:2503.19309. · arXiv
  181. Dragomir R. Radev, Pradeep Muthukrishnan, Vahed Qazvinian, and Amjad Abu-Jbara. 2013. The ACL anthology network corpus. Lang. Resour. Evaluation, 47(4):919-944. · DOI · Paper page
  182. Zachary Robertson. 2023. GPT4 is slightly helpful for peer-review assistance: A pilot study. CoRR, abs/2307.05492. · DOI · Paper page
  183. Ambrose Robinson, William Thorne, Ben P. Wu, Ab- dullah Pandor, Munira Essat, Mark Stevenson, and Xingyi Song. 2023. Bio-sieve: Exploring instruction tuning large language models for systematic review automation. CoRR, abs/2308.06610. · DOI
  184. Bernardino Romera-Paredes, Mohammadamin Barekatain, Alexander Novikov, Matej Balog, M Pawan Kumar, Emilien Dupont, Francisco JR Ruiz, Jordan S Ellenberg, Pengming Wang, Omar Fawzi, and 1 others. 2024. Mathematical discoveries from program search with large language models. Nature, 625(7995):468-475.
  185. Kai Ruan, Xuan Wang, Jixiang Hong, and Hao Sun. 2024a. Liveideabench: Evaluating llms' scientific creativity and idea generation with minimal context. CoRR, abs/2412.17596. · DOI
  186. Yixiang Ruan, Chenyin Lu, Ning Xu, Yuchen He, Yixin Chen, Jian Zhang, Jun Xuan, Jianzhang Pan, Qun Fang, Hanyu Gao, and 1 others. 2024b. An auto- matic end-to-end chemical synthesis development platform powered by large language models. Nature communications, 15(1):10160. · DOI
  187. Shubhra Kanti Karmaker Santu, Sanjeev Kumar Sinha, Naman Bansal, Alex Knipper, Souvika Sarkar, John Salvador, Yash Mahajan, Sri Guttikonda, Mousumi Akter, Matthew Freestone, and Matthew C. Williams Jr. 2024. Prompting llms to compose meta-review drafts from peer-review narratives of scholarly manuscripts. CoRR, abs/2402.15589. · DOI
  188. Mourad Sarrouti, Asma Ben Abacha, Yassine Mrabet, and Dina Demner-Fushman. 2021. Evidence-based fact-checking of health-related claims. In Findings of the Association for Computational Linguistics: EMNLP 2021, Virtual Event / Punta Cana, Domini- can Republic, 16-20 November, 2021, pages 3499- 3512. Association for Computational Linguistics. · DOI · Paper page
  189. Rylan Schaeffer, Brando Miranda, and Sanmi Koyejo. 2023. Are emergent abilities of large language mod- els a mirage? In Advances in Neural Information Processing Systems 36: Annual Conference on Neu- ral Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023.
  190. Laurie A. Schintler, Connie L. McNeely, and James Witte. 2023. A critical examination of the ethics of ai-mediated peer review. CoRR, abs/2309.12356. · DOI
  191. Samuel Schmidgall and Michael Moor. 2025. Agen- trxiv: Towards collaborative autonomous research. arXiv preprint arXiv:2503.18102. · arXiv
  192. Samuel Schmidgall, Yusheng Su, Ze Wang, Ximeng Sun, Jialian Wu, Xiaodong Yu, Jiang Liu, Zicheng Liu, and Emad Barsoum. 2025. Agent labora- tory: Using llm agents as research assistants. arXiv preprint arXiv:2501.04227. · arXiv
  193. Yakub Sebastian, Eu-Gene Siew, and Sylvester O. Ori- maye. 2017. Emerging approaches in literature- based discovery: techniques and performance review. The Knowledge Engineering Review, 32:e12. · DOI
  194. Basuki Setio and Masatoshi Tsuchiya. 2022. The qual- ity assist: A technology-assisted peer review based on citation functions to predict the paper quality. IEEE Access, 10:126815-126831. · DOI
  195. Abdul Shahid, Muhammad Tanvir Afzal, Moloud Ab- dar, Mohammad Ehsan Basiri, Xujuan Zhou, Neil Y Yen, and Jia-Wei Chang. 2020. Insights into relevant knowledge extraction techniques: a comprehensive review. The Journal of Supercomputing, 76:1695- 1733.
  196. Yijia Shao, Yucheng Jiang, Theodore A. Kanell, Peter Xu, Omar Khattab, and Monica S. Lam. 2024. As- sisting in writing wikipedia-like articles from scratch with large language models. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Hu- man Language Technologies (Volume 1: Long Pa- pers), NAACL 2024, Mexico City, Mexico, June 16-21, 2024, pages 6252-6278. Association for Computa- tional Linguistics. · DOI · Paper page
  197. Ritu Sharma, Dinesh Gopalani, and Yogesh Kumar Meena. 2023. An anatomization of research paper recommender system: Overview, approaches and challenges. Eng. Appl. Artif. Intell., 118:105641. · DOI
  198. Chenhui Shen, Liying Cheng, Ran Zhou, Lidong Bing, Yang You, and Luo Si. 2022. Mred: A meta-review dataset for structure-controllable text generation. In Findings of the Association for Computational Lin- guistics: ACL 2022, Dublin, Ireland, May 22-27, 2022, pages 2521-2535. Association for Computa- tional Linguistics. · DOI · Paper page
  199. Yongliang Shen, Kaitao Song, Xu Tan, Wenqi Zhang, Kan Ren, Siyu Yuan, Weiming Lu, Dongsheng Li, and Yueting Zhuang. 2024. Taskbench: Benchmark- ing large language models for task automation. In Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Pro- cessing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 -15, 2024.
  200. Zhengliang Shi, Shen Gao, Zhen Zhang, Xiuying Chen, Zhumin Chen, Pengjie Ren, and Zhaochun Ren. 2023. Towards a unified framework for reference retrieval and related work generation. In Findings of the Asso- ciation for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023, pages 5785-5799. Association for Computational Linguistics. · DOI

200 of 277 shown

Cited by

See all 7

Metadata

Authors
Zhou, Z., Feng, X., Huang, L., Feng, X., Song, Z., Chen, R., Zhao, L., Ma, W., Gu, Y., Wang, B., Wu, D., Hu, G., Liu, T., & Qin, B.
Venue
Findings of the Association for Computational Linguistics: EMNLP 2025
Published
2025
Pages
11773-11803
Cited by
7
References
9

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems. https://app.cochat.ai/papers/10.18653/v1/2025.findings-emnlp.631
The paper
Zhou, Z., Feng, X., Huang, L., Feng, X., Song, Z., Chen, R., Zhao, L., Ma, W., Gu, Y., Wang, B., Wu, D., Hu, G., Liu, T., & Qin, B. (2025). From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems. Findings of the Association for Computational Linguistics: EMNLP 2025. https://doi.org/10.18653/v1/2025.findings-emnlp.631

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.