The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
MetaWriter: Exploring the Potential and Perils of AI Writing Support in Scientific Peer Review
Abstract
Recent advances in Large Language Models (LLMs) show the potential to significantly augment or even replace complex human writing activities. However, for complex tasks where people need to make decisions as well as write a justification, the trade offs between making work efficient and hindering decisions remain unclear. In this paper, we explore this question in the context of designing intelligent scaffolding for writing meta-reviews for an academic peer review process. We prototyped a system called "MetaWriter'' trained on five years of open peer review data to support meta-reviewing. The system highlights common topics in the original peer reviews, extracts key points by each reviewer, and on request, provides a preliminary draft of a meta-review that can be further edited. To understand how novice and experienced meta-reviewers use MetaWriter, we conducted a within-subject study with 32 participants. Each participant wrote meta-reviews for two papers: one with and one without MetaWriter. We found that MetaWriter significantly expedited the authoring process and improved the coverage of meta-reviews, as rated by experts, compared to the baseline. While participants recognized the efficiency benefits, they raised concerns around trust, over-reliance, and agency. We also interviewed six paper authors to understand their opinions of using machine intelligence to support the peer review process and reported critical reflections. We discuss implications for future interactive AI writing tools to support complex synthesis work.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“AI systems pose ethical issues including generating inaccuracies [165], violating academic integrity [107], amplifying dominant views [148], and fostering human biases like confirmation bias and over-reliance [107].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [165]
In the citing paper
“Much of the current literature focuses on isolated AI-generated reviews or single-reviewer assistance (Chen et al. 2025;Sun et al. 2024;Farber 2025).”
From Who Reviews the Reviewer? A Multi‐Agent LLM Architecture With Meta‐Review Synthesis for Editorial Peer Review (2026) · cites this paper as Sun et al. 2024
In the citing paper
“Similarly, MetaWriter demonstrated that AI support can accelerate meta-review synthesis and improve the coverage of reviewer feedback, particularly for less experienced reviewers (Sun et al. 2024).”
From Who Reviews the Reviewer? A Multi‐Agent LLM Architecture With Meta‐Review Synthesis for Editorial Peer Review (2026) · cites this paper as Sun et al. 2024
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“Prior work has raised concerns about the potential loss of agency or control when working with AI on complex tasks [6, 33, 75].”
BackgroundThe use of MMR, diversity-based reranking for reordering documents and producing summaries
Carbonell, J., & Goldstein, J. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291025 · Cited by 2,329
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
The Corsini encyclopedia of psychology
(2010) · Choice Reviews Online · doi:10.5860/choice.47-6008 · Cited by 1,082
Scaffolding Complex Learning: The Mechanisms of Structuring and Problematizing Student Work
Reiser, B. J. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1303_2 · Cited by 1,054
Chapter 3: Rethinking Transfer: A Simple Proposal With Multiple Implications
BRANSFORD, J. D., & SCHWARTZ, D. L. (1999) · Review of Research in Education · doi:10.3102/0091732x024001061 · Cited by 881 · cited 1×
“…the system not only provides an example from some other context (which requires users to conceptually “transfer” insights into the current task [13, 25]), MetaWriter also generates a highly contextual example that uses language from the current context, potentially reducing the burden of…”
Research works printed but not linked: 27
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.
- Yang Gao, Steffen Eger, Ilia Kuznetsov, Iryna Gurevych, and Yusuke Miyao. 2019. Does my rebuttal matter? insights from a major nlp conference. arXiv preprint arXiv:1903.11367 (2019). · arXiv
- Katy Ilonka Gero, Vivian Liu, and Lydia B. Chilton. 2021. Sparks: Inspiration for Science Writing using Language Models. arXiv. http://arxiv.org/abs/2110.07640 arXiv:2110.07640 [cs]. · arXiv
- Navita Goyal, Eleftheria Briakou, Amanda Liu, Connor Baumler, Claire Bonial, Jeffrey Micher, Clare R Voss, Marine Carpuat, and Hal Daumé III. 2023. What Else Do I Need to Know? The Effect of Background Information on Users' Reliance on AI Systems. arXiv preprint arXiv:2305.14331 (2023). · arXiv
- Chao-Chun Hsu and Chenhao Tan. 2021. Decision-Focused Summarization. arXiv preprint arXiv:2109.06896 (2021). · arXiv
- Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Yejin Bang, Andrea Madotto, and Pascale Fung. 2022. Survey of hallucination in natural language generation. Comput. Surveys (2022).
- Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine Van Zuylen, Sebastian Kohlmeier, Eduard Hovy, and Roy Schwartz. 2018. A dataset of peer reviews (peerread): Collection, insights and nlp applications. arXiv preprint arXiv:1804.09635 (2018). · arXiv
- Miao Li Jianzhong Qi and Jey Han Lau. 2022. PeerSum: A Peer Review Dataset for Abstractive Multi-document Summarization. http://arxiv.org/abs/2203.01769 arXiv:2203.01769 [cs]. · arXiv
- Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74--81.
- Stephanie Lin, Jacob Hilton, and Owain Evans. 2021. Truthfulqa: Measuring how models mimic human falsehoods. arXiv preprint arXiv:2109.07958 (2021). · arXiv
- Yang Liu and Mirella Lapata. 2019. Text summarization with pretrained encoders. arXiv preprint arXiv:1908.08345 (2019). · arXiv
- Alison McCook. 2006. Is peer review broken? Submissions are up reviewers are overtaxed and authors are lodging complaint after complaint about the process at top-tier journals. What's wrong with peer review? The scientist 20 2 (2006) 26--35.
- Piotr Mirowski Kory W. Mathewson Jaylen Pittman and Richard Evans. 2022. Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionals. arXiv. http://arxiv.org/abs/2209.14958 arXiv:2209.14958 [cs]. · arXiv
- Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, and Michael Auli. 2019. fairseq: A fast, extensible toolkit for sequence modeling. arXiv preprint arXiv:1904.01038 (2019). · arXiv
- Andrea Papenmeier, Gwenn Englebienne, and Christin Seifert. 2019. How model accuracy and explanation fidelity influence user trust. arXiv preprint arXiv:1907.12652 (2019). · arXiv
- Napol Rachatasumrit, Gonzalo Ramos, Jina Suh, Rachel Ng, and Christopher Meek. 2021. ForSense: Accelerating Online Research Through Sensemaking Integration and Machine Research Support. In 26th International Conference on Intelligent User Interfaces. 608--618.
- Nihar B Shah. 2022. An overview of challenges, experiments, and computational solutions in peer review (extended version). Commun. ACM (2022).
- Nihar B Shah, Behzad Tabibian, Krikamol Muandet, Isabelle Guyon, and Ulrike Von Luxburg. 2018. Design and analysis of the NIPS 2016 review process. Journal of machine learning research (2018).
- Ben Shneiderman and Pattie Maes. 1997. Direct manipulation vs. interface agents. interactions 4, 6 (1997), 42--61.
- Raimel Sobrino-Duque, Juan Manuel Carrillo-de Gea, Juan José López-Jiménez, Joaquín Nicolás Ros, and José Luis Fernández-Alemán. 2022. Usevalia: Managing Inspection-Based Usability Audits. International Journal of Human-- Computer Interaction (2022), 1--25.
- Ivan Stelmakh Nihar B Shah and Aarti Singh. 2019. PeerReview4All: Fair and accurate reviewer assignment in peer review. In Algorithmic Learning Theory. PMLR 828--856.
- T Elizabeth Workman, Marcelo Fiszman, and John F Hurdle. 2012. Text summarization as a decision support aid. BMC medical informatics and decision making 12, 1 (2012), 1--12.
- Wenting Xiong and Diane Litman. 2011. Automatically Predicting Peer-Review Helpfulness. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Portland, Oregon, USA, 502--507. https://aclanthology.org/P11--2088
- Jiacheng Xu and Greg Durrett. 2019. Neural extractive text summarization with syntactic compression. arXiv preprint arXiv:1902.00863 (2019). · arXiv
- Kevin Yang, Dan Klein, Nanyun Peng, and Yuandong Tian. 2022. Doc: Improving long story coherence with detailed outline control. arXiv preprint arXiv:2212.10077 (2022). · arXiv
- Ann Yuan, Andy Coenen, Emily Reif, and Daphne Ippolito. 2022. Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces. 841--852.
- Zheng Zhang, Jie Gao, Ranjodh Singh Dhaliwal, and Toby Jia-Jun Li. 2023. VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping. arXiv preprint arXiv:2304.07810 (2023). · arXiv
Cited by
'I'm Categorizing LLM as a Productivity Tool': Examining Ethics of LLM Use in HCI Research Practices
Kapania, S., Wang, R., Li, T. J.-J., Li, T., & Shen, H. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711000 · Cited by 79
ImaginateAR: AI-Assisted In-Situ Authoring in Augmented Reality
Lee, J., Aleotti, F., Mazala, D., Garcia-Hernando, G., Vicente, S., Johnston, O., Kraus-Liang, I., Powierza, J., Shin, D.-H., Froehlich, J. E., et al. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747635 · Cited by 51
ReviewFlow: Intelligent Scaffolding to Support Academic Peer Reviewing
Sun, L., Chan, A., Chang, Y. S., & Dow, S. P. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645159 · Cited by 50
Self-citationBlockchain and Its Application in the Peer Review of Scientific Works: A Systematic Review
Morales-Alarcón, C. H., Poveda, E. M. B., Yánez, H. M. V., & Guisñan, P. A. B. (2024) · Publications · doi:10.3390/publications12040040 · Cited by 42
Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37
“…processes and contexts–for example, strong representation of Generating and Translating activities in Creative and Academic settings, and limited focus on Monitoring across all contexts. process across them; we also report how many papers 1 were coded into each writing context, as shown in Table 1.”
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36
Safeguarding Crowdsourcing Surveys from ChatGPT through Prompt Injection
Wang, C., Freire, S. K., Zhang, M., Wei, J., Gonçalves, J., Kostakos, V., Bozzon, A., & Niforatos, E. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757503 · Cited by 28
How Far Are AI Scientists from Changing the World? A Survey of Autonomous Scientific Discovery
Xie, Q., Weng, Y., Zhu, M., 方俊英, Shen, F., Huang, S., Lin, Z., Wang, Z., Li, S., Zhou, J., et al. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.48550/arxiv.2507.23276 · Cited by 24
Nabavi, A., Safari, F., Shmoury, A. H., Tabet, S., Perdomo-Luna, C., & Celi, L. A. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106418 · Cited by 23
Lim, G., & Perrault, S. T. (2024) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3678884.3681867 · Cited by 20
Past, Present, and Future of Citation Practices in HCI
Oppenlaender, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713556 · Cited by 20
Can AI Validate Science? Benchmarking LLMs on Claim →Evidence Reasoning in AI Papers
Javaji, S. R., Cao, Y., Li, H., Yu, Y., Muralidhar, N., & Zhu, Z. (2025) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2025.ijcnlp-long.127 · Cited by 17
Gawlik-Kobylińska, M. (2024) · Education Sciences · doi:10.3390/educsci14101132 · Cited by 14
Investigating How Computer Science Researchers Design Their Co-Writing Experiences With AI
Roffarello, A. M., Calò, T., Scibetta, L., & Russis, L. D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713205 · Cited by 14
Identifying Aspects in Peer Reviews
Lu, S., Kuznetsov, I., & Gurevych, I. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.326 · Cited by 14
Insights from the ICLR Peer Review and Rebuttal ProcessPreprint
Kargaran, A. H., Nikeghbal, N., Yang, J., & Ousidhoum, N. D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.15462 · Cited by 14
The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance Rates
Russo, G., Horta Ribeiro, M., Davidson, T. R., Veselovsky, V., & West, R. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757667 · Cited by 12
Zhou, L., Zhang, R., Dai, X., Hershcovich, D., & Li, H. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114988 · Cited by 12
Collaborative Document Editing with Multiple Users and AI Agents
Lehmann, F., Shauchenka, K., & Buschek, D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790648 · Cited by 11
FeedQUAC: Quick Unobtrusive AI-Generated Commentary
Long, T., Wannamaker, K., Vermeulen, J., Fitzmaurice, G. W., & Matejka, J. (2025) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3765766.3765861 · Cited by 11
When AI reviews science: Can we trust the referee?
Wang, J., Liu, Y., Xu, H., Hu, K., Di, S., Ni, W., Yue, L., Zhang, M.-L., Ren, K., & Chen, L. (2026) · The Innovation Informatics · doi:10.59717/j.xinn-inform.2026.100030 · Cited by 9
FRAME: Feedback-Refined Agent Methodology for Enhancing Medical Research Insights
Yu, C., Zhang, Y., Liu, Z., Ding, Z., Sun, Y., & Jin, Z. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.400 · Cited by 9
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support SystemsPreprint
Zhou, Z., Feng, X., Huang, L., Feng, X., Song, Z., Chen, R., Zhao, L., Ma, W., Gu, Y., Wang, B., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.01424 · Cited by 9
Li, C., Lai, Z., An, D. U., Hu, J., & Wen, Z. (2026) · Journal of Scientific Computing · doi:10.1007/s10915-026-03493-4 · Cited by 8
Self-citationUnderstanding and Supporting Peer Review Using AI-reframed Positive Summary
Yang, C.-L., Uhde, A., Yamashita, N., & Kuzuoka, H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713219 · Cited by 8
Neshaei, S. P., Tolzin, A., Berkle, Y., Leuchter, M., Leimeister, J. M., Janson, A., & Wambsganß, T. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711023 · Cited by 8
LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions
Liao, Z., Antoniak, M., Cheong, I., Cheng, E. Y.-Y., Lee, A.-H., Lo, K., Chang, J. C., & Zhang, A. X. (2024) · arXiv · doi:10.48550/arxiv.2411.05025 · Cited by 7
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems
Zhou, Z., Feng, X., Huang, L., Feng, X., Song, Z., Chen, R., Zhao, L., Ma, W., Gu, Y., Wang, B., et al. (2025) · Findings of the Association for Computational Linguistics: EMNLP 2025 · doi:10.18653/v1/2025.findings-emnlp.631 · Cited by 7
Incorporating Personality into AI Writing Companions: Mapping the Design Space
Wu, M., Quan, K., Liu, W., Yao, M. Z., & Chin, J. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720185 · Cited by 7
Schaper, C. D. (2026) · Annals of the Chrysene Formalism · doi:10.68366/kjwc7142 · Cited by 7
An Analysis of Tasks and Datasets in Peer Reviewing
Staudinger, M., Kusa, W., Piroi, F., & Hanbury, A. (2024) · Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024) · doi:10.18653/v1/2024.sdp-1.24 · Cited by 6
Narrix: Remixing Narrative Strategies from Examples for Story Writing
Zhang, C., Guo, S., Davis, A., & Koh, E. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790813 · Cited by 6
Harnessing artificial intelligence for identifying conflicts of interest in research
Nashwan, A. J. (2024) · World Journal of Methodology · doi:10.5662/wjm.v15.i1.98376 · Cited by 6
Javaji, S. R., Cao, Y., Li, H., Yu, Y., Muralidhar, N., & Zhu, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.08235 · Cited by 6
Chen, S., Brumby, D., & Cox, A. (2025) · Proceedings of the 4th Annual Symposium on Human-Computer Interaction for Work · doi:10.1145/3729176.3729196 · Cited by 5
Defining and assessing AI literacy for researchers across the research lifecycle
Parker, J. L., & Becker, K. P. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1827603 · Cited by 5
AI4Research: a survey of artificial intelligence for scientific research
Chen, Q., Yang, M., Qin, L., Liu, J., Yan, Z., Guan, J., Peng, D., Ji, Y., Li, H., Hu, M., et al. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-5000-y · Cited by 4
What Happens When Reviewers Receive AI Feedback in Their Reviews?
Chen, S., Zhong, S., Brumby, D. P., & Cox, A. L. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791431 · Cited by 4
Hassan, T., Edmison, B., Williams, D., Cox, L., Louvet, M., Knijnenburg, B. P., & McCrickard, D. S. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687051 · Cited by 4
Understanding How Paper Writers Use AI-Generated Captions in Figure Caption Writing
Ng, H. Y., Hsu, T.-Y., Min, J., Kim, S., Rossi, R. A., Yu, T., Jung, H., & Huang, T.-H. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-8912-5_8 · Cited by 4
When AI Reviews Science: Can We Trust the Referee?Preprint
Wang, J., Liu, Y., Xu, H., Hu, K., Di, S., Ni, W., Yue, L., Zhang, M.-L., Ren, K., & Chen, L. (2025) · Preprints.org · doi:10.20944/preprints202511.1542.v1 · Cited by 4
Project Rachel: Can an AI Become a Scholarly Author?Preprint
Monperrus, M., Baudry, B., & Vidal, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.14819 · Cited by 4
Attorneys and AI: How Lawyers Use Artificial Intelligence and Analyze Its Impacts
Schieber, E. A. G., Kite, N., Hall, M. I., Turner, C., & Schlesinger, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757554 · Cited by 3
Yao, W., & Saad, M. N. (2025) · Asian Education and Development Studies · doi:10.1108/aeds-02-2025-0061 · Cited by 3
Guo, S., Hu, W., Zhao, Y., Zhou, L., Lyu, Y., Yan, X., & Ren, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.00005 · Cited by 3
Anthuvan, T., Nagendra, L., Lakhani, O., Prabhuram, S., Rizvi, A. H., Maheshwari, K., & Kalra, S. (2025) · doi:10.2139/ssrn.5394918 · Cited by 2
Supporting Artifact Evaluation with LLMs: A Study with Published Security Research Papers
Heye, D., Kindermann, K., Decker, R., Lohmöller, J., Belova, A., Geisler, S., Wehrle, K., & Pennekamp, J. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401815 · Cited by 2
Karnatak, N., Chatila, M., Hernandez, D. A. P., Yazdanfar, R., DUGAS, M. A., & Vakis, R. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791062 · Cited by 2
Gautam, S., Liu, H., Choi, Y., & Lease, M. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812262 · Cited by 2
It’s Complicated: How Experts Co-constructed Knowledge in the Academic Peer Review
Wei, S.-Y., Shi, H., & Tang, Y. M. (2025) · Proceedings. · doi:10.22318/icls2025.100090 · Cited by 1
Unseen Work: Leveraging Generative AI for Invisible Academic Labour
Mella, J., Frampton, S. L., & Cox, A. L. (2024) · UCL Discovery (University College London) · doi:10.18420/muc2024-mci-ws09-142 · Cited by 1
Hands-Off or Hands-On? Variation in Area Chair Practices and Implications for AI Support
Arous, I., Kennard, N. N., Mircea, A., Kuang, E., Cheung, J. C. K., & McCallum, A. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i1.43138 · Cited by 1
Narrative Keyframing for Generative Creative Writing
Zhang, C., & Davis, A. (2026) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3830398.3830586 · Cited by 1
Attract & Engage Visitors for Tabular Data Maintenance: a Longitudinal Naturalistic Field Study
Wallace, S., Lee, N. K., Peng, Z., Massachi, T., Do, L., Rathore, S., Brown, S. M., & Huang, J. J. S. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816901 · Cited by 1
Guo, S., Hu, W., Zhao, Y., Lyu, Y., Yan, X., & Ren, Z. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1981 · Cited by 1
Shulman, Y., Kitkowska, A., & Warner, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.19429 · Cited by 1
Designing Proactive Thought Partners for WritingPreprint
Zhang, C., Davis, A., Chen, C.-W., & Hsu, C.-C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.01588 · Cited by 1
Ali, Ș., Oprea, S., & Bâra, A. (2026) · Systems Research and Behavioral Science · doi:10.1002/sres.70163
Mind the Blind Spots: A Focus-Level Evaluation Framework for LLM Reviews
Shin, H., Tang, J., Lee, Y., Kim, N., Lim, H., Cho, J. Y., Hong, H., Lee, M., & Kim, J. (2025) · arXiv · doi:10.48550/arxiv.2502.17086
Scaffolding recommendations for students’ essay planning
van Rijn, L., Wrede, S. E., de Witt, C., Wang, X., Duong‐Trung, N., Jose, A. M., & Pinkwart, N. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1621151
Zero-shot reasoning for simulating scholarly peer-reviewPreprint
KNOWDYN (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.02027
Wu, M., Quan, K., Liu, W., Yao, M. Z., & Chin, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.11115
Gordo, A., Gray, C. H., Rodríguez-Romero, A.-M., Said-Hung, E. M., & Tabarés, R. (2025) · Imaginations Journal of Cross-Cultural Image Studies · doi:10.17742/image29731
Heuer, H., Goller, S., & Buschek, D. (2026) · i-com · doi:10.1515/icom-2025-0024
What’s AI Got to Do with It?: An Analysis of GenAI Competency Frameworks
Leon, R. S. (2026) · The WAC Clearinghouse eBooks · doi:10.37514/pcw-b.2026.2883.2.07
Supporting Reviewing Reviews: How HCI Authors Handle Peer Reviews of Manuscripts
Yeung, C. A., Stark, J., Li, J., Chevalier, F., Park, J., Kim, Y., & Tang, A. (2025) · International Conference on Human-Engaged Computing (ICHEC) · doi:10.1145/3786995.3786998
What Makes an AI Writing Companion a Good Fit? A Personality-Informed Co-Design Study
Wu, M., Quan, K., Liu, W., Yao, M., & Chin, J. (2026) · Creativity and Cognition · doi:10.1145/3803784.3807536
Judgment-Grounded Expansion for Peer Review GenerationPreprint
Lu, S., Qu, L., & Gurevych, I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.23233
SLAI: AI Support for Multilingual Small Group Discussions in Science Classrooms
Karumbaiah, S., Guha, A., & Maravi, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29755-6_12
Scaffolded Support for Template Sentences
Barney, T. B. (2026) · The WAC Clearinghouse eBooks · doi:10.37514/twr-b.2026.2999.2.09
ReVoicer: Conversational Voice Annotation for Human-Centered, LLM-Assisted Peer ReviewPreprint
Gottsacker, M., Alwin, A., Furuya, H., Lindeman, R. W., Bruder, G., & Welch, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.00299
Kilat, R. V., Valle, L. C., Cruz, J. D., & Lim, J. B. (2026) · Discover Education · doi:10.1007/s44217-026-01963-3
Chen, C., Li, L., Ma, R., Alghofaili, R., Zhou, S., Zhang, B., Su, X., Zhu, W., Lisetti, C., & Sha, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.14639
A Governance Framework for Human–AI Collaboration in Academic Writing: The Scholarly HI–AI LoopPreprint
Anthuvan, T., Nagendra, L., Prabhuram, S., Lakhani, O., Kalra, S., Maheshwari, K., Srivathsan, S., & Ravi, S. (2026) · Research Square · doi:10.21203/rs.3.rs-10644052/v1
Rethinking Inline Citation Verification in Scholarly CommunicationPreprint
Fang, X., Fairchild, R., Wang, N., Xu, A., Hosio, S. J., Malacria, S., & Yatani, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.05355
Exploring factors that influence human peer reviewers' acceptance of AI peer review as a teammate
Zhou, J. (2026) · Responsible Enterprise Pedagogy · doi:10.1108/resep-07-2026-0023
Understanding How Paper Writers Use AI-Generated Captions in Figure Caption Writing
Yin, H., Ng, Hsu, T.-Y., Min, J., Kim, S., Rossi, R. A., Yu, T., Jung, H., & Huang, T.-H. '. (2025) · arXiv · doi:10.48550/arxiv.2501.06317
Metadata
- Authors
- Sun, L., Tao, S., Hu, J., & Dow, S. P.
- Affiliations
- University of California San Diego (US)
- University of Wisconsin–Madison (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2024-04-17
- Volume
- 8
- Issue
- CSCW1
- Pages
- 1-32
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4396232287
- Semantic Scholar
- 1e13c7a04a77a65ef1bae0748360c582a83bed91
- Cited by
- 37
- References
- 60
- Citations by year
- 2026: 12 · 2025: 19 · 2024: 6
- FWCI
- 55.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- large language models, open peer review, scientific peer review, trust in AI, overreliance on AI, writing efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.