GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responses
The DOI matches its DataCite record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
While LLMs hold significant potential to transform scientific research, we advocate for their use to augment and empower researchers rather than to automate research without human oversight. To this end, we study constructive feedback generation, the task of producing targeted, actionable feedback that helps authors improve both their research and its presentation. In this work, we operationalize the effectiveness of feedback along two author-centric axes-validity and author action. We first curate GoodPoint-ICLR, a dataset of 19K ICLR papers with reviewer feedback annotated along both dimensions using author responses. Building on this, we introduce GoodPoint, a training recipe that leverages success signals from author responses through fine-tuning on valid and actionable feedback, together with preference optimization on both real and synthetic preference pairs. Our evaluation on a benchmark of 1.2K ICLR papers shows that a GoodPoint-trained Qwen3-8B improves the predicted success rate by 83.7% over the base model and sets a new state-of-the-art among LLMs of similar size in feedback matching on a golden human feedback set, even surpassing Gemini-3-flash in precision. We further validate these findings through an expert human study, demonstrating that GoodPoint consistently delivers higher practical value as perceived by authors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“GoodPoint (Mun et al., 2026) also uses author responses to define constructive feedback as comments that are both valid and actionable.”
From Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Future (2026) · cites this paper as Mun et al., 2026
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Re2: A Consistency-ensured Dataset for Full-stage Peer Review and Multi-turn Rebuttal Discussions
Zhang, D., Bao, Z., Du, S., Zhao, Z., Zhang, K., Bao, D., & Yang, Y. (2025) · arXiv · doi:10.48550/arxiv.2505.07920 · Cited by 26
LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions
Liao, Z., Antoniak, M., Cheong, I., Cheng, E. Y.-Y., Lee, A.-H., Lo, K., Chang, J. C., & Zhang, A. X. (2024) · arXiv · doi:10.48550/arxiv.2411.05025 · Cited by 7 · cited 2×
“This is especially consequential for authors who lack access to timely, expert feedback (Liao et al., 2024).”
AI4Research: a survey of artificial intelligence for scientific research
Chen, Q., Yang, M., Qin, L., Liu, J., Yan, Z., Guan, J., Peng, D., Ji, Y., Li, H., Hu, M., et al. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-5000-y · Cited by 4 · cited 3×
“The growing use of LLMs across scientific research (Si et al., 2025; Huang et al., 2025; Chen et al., 2025; Ifargan et al., 2025; Schmidgall et al., 2025) has spurred proposals to automate core research processes, including peer review (Zhu et al., 2025; Zhou et al., 2024a; Liang et al., 2024).”
Deep Research Agents: A Systematic Examination And Roadmap
Huang, Y., Chen, Y., Zhang, H., Li, K., Zhou, H., Fang, M., Yang, L., Li, X., Shang, L., Xu, S., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.18096 · Cited by 3
The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for Authors
Sadallah, A., Baumgärtner, T., Gurevych, I., & Briscoe, T. (2025) · arXiv · doi:10.48550/arxiv.2509.04484 · cited 1×
“In addition to our targeted quality dimensions, validity and action, specificity and helpfulness are included for a more comprehensive evaluation, following previous work (Sadallah et al., 2025; Liang et al., 2024).”
Stop Automating Peer Review Without Rigorous Evaluation
Baumann, J., Pei, J., Koyejo, S., & Hovy, D. (2026) · arXiv · doi:10.48550/arxiv.2605.03202 · cited 2×
“Yet unchecked automation risks eroding the critical judgment of researchers and the broader scientific community, ultimately degrading the quality of science (Baumann et al., 2026; Wilder, 2025).”
Cited by
Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Future
Wu, S., Jiang, O., Zhao, Y., Hu, T., Ma, Y., Zhang, K., Patwardhan, M., & Cohan, A. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.1504 · Cited by 11
Metadata
- Authors
- Mun, J., Jung, C., Zhou, X., Kim, H., & Sap, M.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- arXiv
- 2604.11924
- References
- 6
- Type
- Preprint
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responses. https://app.cochat.ai/papers/10.48550/arxiv.2604.11924
- The paper
- Mun, J., Jung, C., Zhou, X., Kim, H., & Sap, M. (2026). GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responses. arXiv. https://doi.org/10.48550/arxiv.2604.11924
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.