Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 28

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

On the Use of ChatGPT for Code Review: Do Developers Like Reviews By ChatGPT?

Watanabe, Miku, Kashiwa, Yutaro, Lin, Bin, Hirao, Toshiki, Yamaguchi, Ken'Ichi, Iida, Hajimu·2024·Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering

Abstract

Code review is a critical but time-consuming process for ensuring code quality in modern software engineering. To alleviate the effort of reviewing source code, recent studies have investigated the possibility of automating the review process. Moreover, tools based on large language models such as ChatGPT are playing an increasingly important role in this vision. Understanding how these tools are used during code review can provide valuable insights for code review automation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3661167.3661183

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 28 references

Research works printed but not linked: 5

  1. 10.5555/3155562.3155579 · doi:10.5555/3155562.3155579
  2. Eman Abdullah AlOmar, Anushkrishna Venkatakrishnan, Mohamed Wiem Mkaouer, Christian D. Newman, and Ali Ouni. 2024. How to Refactor this Code? An Exploratory Study on Developer-ChatGPT Refactoring Conversations. CoRR abs/2402.06013 (2024). · arXiv
  3. Carolyn D. Egelman, Emerson R. Murphy-Hill, Elizabeth Kammer, Margaret Morrow Hodges, Collin Green, Ciera Jaspan, and James Lin. 2020. Predicting developers’ negative feelings about code review. In Proc. of the 42nd International Conference on Software Engineering (ICSE’20). 174–185.
  4. Samia Kabir, David N. Udo-Imeh, Bonan Kou, and Tianyi Zhang. 2023. Who Answers It Better? An In-Depth Analysis of ChatGPT and Stack Overflow Answers to Software Engineering Questions. CoRR abs/2308.02312 (2023). · arXiv
  5. Peter C. Rigby and Christian Bird. 2013. Convergent contemporary software peer review practices. In Proc. of the 2013 Joint Meeting of the European Software Engineering Conference (FSE’13). 202–212.

Cited by

See all 28

Metadata

Authors
Watanabe, M., Kashiwa, Y., Lin, B., Hirao, T., Yamaguchi, K., & Iida, H.
Affiliations
  • Nara Institute of Science and Technology, Japan
  • Radboud University, Netherlands
  • Nara College, National Institute of Technology, Japan
Venue
Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering
Publisher
ACM
Published
2024-06-18
Pages
375-380
Cited by
28
References
28
Funders
  • Japan Science and Technology Agency (JPMJPR22P3)
  • Japan Society for the Promotion of Science (P21H03416, JP24K02921, JPJSBP120239929)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: On the Use of ChatGPT for Code Review: Do Developers Like Reviews By ChatGPT? https://app.cochat.ai/papers/10.1145/3661167.3661183
The paper
Watanabe, M., Kashiwa, Y., Lin, B., Hirao, T., Yamaguchi, K., & Iida, H. (2024). On the Use of ChatGPT for Code Review: Do Developers Like Reviews By ChatGPT? Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering. https://doi.org/10.1145/3661167.3661183

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.