FIRA: fi ne-grained g ra ph-based code change representation for automated commit message generation
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Commit messages summarize code changes of each commit in natural language, which help developers understand code changes without digging into detailed implementations and play an essential role in comprehending software evolution. To alleviate human efforts in writing commit messages, researchers have proposed various automated techniques to generate commit messages, including template-based, information retrieval-based, and learning-based techniques. Although promising, previous techniques have limited effectiveness due to their coarse-grained code change representations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000 · cited 2×
“GCN [22] is a variant of the graph neural network (GNN) and it leverages the firstorder approximation of Chebyshev Spectral CNN (ChebNet) [7] to aggregate the feature information among all neighbor nodes [43].”
MethodProceedings of the 21st International Conference on Neural Information Processing Systems
Koller, D., Schuurmans, D., Bengio, Y., & Bottou, L. (2008) · Cited by 4,461
A new model for learning in graph domains
Gori, M., Monfardini, G., & Scarselli, F. (2006) · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · doi:10.1109/ijcnn.2005.1555942 · Cited by 2,075 · cited 1×
“In the encoder, we adopt graph neural networks (GNN) due to its strong capability of processing graphstructured data [12, 13, 22, 30, 34, 40, 43].”
MethodProceedings of the 40th Annual Meeting on Association for Computational Linguistics
Isabelle, P. (2002) · Cited by 1,635
Some Practical Guidelines for Effective Sample Size Determination
Lenth, R. V. (2001) · The American Statistician · doi:10.1198/000313001317098149 · Cited by 1,139
Lin, C.-Y., & Och, F. J. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1219032 · Cited by 737 · cited 1×
“ROUGE-L calculates the F-score of precision and recall based on the longest common sub-sequences (LCS) between the generated sequence and the ground truth [25].”
MethodMurray, G., Renals, S. J., Carletta, J., & Moore, J. D. (2005) · Meeting of the Association for Computational Linguistics · Cited by 716
Breakthroughs in Statistics: Foundations and Basic Theory
(1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5 · Cited by 714
Fine-grained and accurate source code differencing
Falleri, J.-R., Morandat, F., Blanc, X., Martinez, M., & Monperrus, M. (2014) · Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/2642937.2642982 · Cited by 549
Automatically generating commit messages from diffs using neural machine translation
Jiang, S., Armaly, A., & McMillan, C. (2017) · 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115626 · Cited by 255
Boa: A language and infrastructure for analyzing ultra-large-scale software repositories
Dyer, R., Nguyen, H. A., Rajan, H., & Nguyen, T. N. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606588 · Cited by 255
Neural-machine-translation-based commit message generation: how far are we?
Liu, Z., Xia, X., Hassan, A. E., Lo, D., Xing, Z., & Wang, X. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238190 · Cited by 247
Automatically documenting program changes
Buse, R. P. L., & Weimer, W. R. (2010) · Proceedings of the IEEE/ACM international conference on Automated software engineering · doi:10.1145/1858996.1859005 · Cited by 219
A syntax-guided edit decoder for neural program repair
Zhu, Q., Sun, Z., Xiao, Y.-A., Zhang, W., Yuan, K., Xiong, Y., & Zhang, L. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3468544 · Cited by 216
Self-citationCC2Vec: distributed representations of code changes
Hoang, T., Kang, H. J., Lo, D., & Lawall, J. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering · doi:10.1145/3377811.3380361 · Cited by 174
TreeGen: A Tree-Based Transformer Architecture for Code Generation
Sun, Z., Zhu, Q., Xiong, Y., Sun, Y., Mou, L., & Zhang, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6430 · Cited by 167
Self-citationOn Automatically Generating Commit Messages via Summarization of Source Code Changes
Cortes-Coy, L. F., Linares-Vasquez, M., Aponte, J., & Poshyvanyk, D. (2014) · 2014 IEEE 14th International Working Conference on Source Code Analysis and Manipulation · doi:10.1109/scam.2014.14 · Cited by 164
Boosting coverage-based fault localization via graph-based representation learning
Lou, Y., Zhu, Q., Dong, J., Li, X., Sun, Z., Hao, D., Zhang, L., & Zhang, L. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3468580 · Cited by 163
Self-citationCC2Vec: Distributed Representations of Code Changes
Hoang, T., Kang, H. J., Lawall, J., & Lo, D. (2020) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · doi:10.48550/arxiv.2003.05620 · Cited by 157
Discovering bug patterns in JavaScript
Hanam, Q., Brito, F. S. D. M., & Mesbah, A. (2016) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2950290.2950308 · Cited by 116
Reverse Engineering Method Stereotypes
Dragan, N., Collard, M. L., & Maletic, J. I. (2006) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2006.54 · Cited by 93
Context-aware Retrieval-based Deep Commit Message Generation
Wang, H., Xia, X., Lo, D., He, Q., Wang, X., & Grundy, J. (2021) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3464689 · Cited by 70
Generating Commit Messages from Diffs using Pointer-Generator Network
Liu, Q., Liu, Z., Zhu, H., Fan, H., Du, B., & Qian, Y. (2019) · 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2019.00056 · Cited by 64
A Closer Look at Real-World Patches
Liu, K., Kim, D., Koyuncu, A., Li, L., Bissyandé, T. F., & Traon, Y. L. (2018) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2018.00037 · Cited by 57
On Automatic Summarization of What and Why Information in Source Code Changes
Shen, J., Sun, X., Li, B., Yang, H., & Hu, J. (2016) · 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2016.162 · Cited by 55
Analyzing bug fix for automatic bug cause classification
Ni, Z., Li, B., Sun, X., Chen, T., Tang, B., & Shi, X. (2020) · Journal of Systems and Software · doi:10.1016/j.jss.2020.110538 · Cited by 50
Towards Automatic Generation of Short Summaries of Commits
Jiang, S., & McMillan, C. (2017) · 2017 IEEE/ACM 25th International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2017.12 · Cited by 48
Learning Human-Written Commit Messages to Document Code Changes
Huang, Y., Jia, N., Zhou, H.-J., Chen, X., Zheng, Z., & Tang, M. (2020) · Journal of Computer Science and Technology · doi:10.1007/s11390-020-0496-0 · Cited by 43
Using stereotypes to help characterize commits
Dragan, N., Collard, M. L., Hammad, M. M., & Maletic, J. I. (2011) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2011.6080822 · Cited by 42
Islam, M. R., & Zibran, M. F. (2020) · ACM Symposium on Applied Computing · doi:10.1145/3341105.3373880 · Cited by 22
Discovering common bug‐fix patterns: A large‐scale observational study
Campos, E. C., & Maia, M. D. A. (2019) · Journal of Software Evolution and Process · doi:10.1002/smr.2173 · Cited by 19
Logtracker: learning log revision behaviors proactively from software evolution history
Li, S., Niu, X., Jia, Z., Wang, J., He, H., & Wang, T. (2018) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3196321.3196328 · Cited by 17
Research works printed but not linked: 15
- Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. 2020. A transformer-based approach for source code summarization. arXiv preprint arXiv:2005.00653 (2020). · arXiv
- Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton. 2016. Layer normalization. arXiv preprint arXiv:1607.06450 (2016). · arXiv
- Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst. 2016. Convolutional neural networks on graphs with fast localized spectral filtering. arXiv preprint arXiv:1606.09375 (2016). · arXiv
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
- Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016). · arXiv
- Shangqing Liu, Cuiyun Gao, Sen Chen, Nie Lun Yiu, and Yang Liu. 2020. ATOM: Commit message generation based on abstract syntax tree and hybrid ranking. IEEE Transactions on Software Engineering (2020).
- Lun Yiu Nie, Cuiyun Gao, Zhicong Zhong, Wai Lam, Yang Liu, and Zenglin Xu. 2021. CoreGen: Contextualized Code Representation Learning for Commit Message Generation. Neurocomputing 459 (2021), 97--107.
- Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2008. The graph neural network model. IEEE transactions on neural networks 20, 1 (2008), 61--80.
- Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research 15, 1 (2014), 1929--1958.
- Wei Tao, Yanlin Wang, Ensheng Shi, Lun Du, Hongyu Zhang, Dongmei Zhang, and Wenqiang Zhang. 2021. On the Evaluation of Commit Message Generation Models: An Experimental Study. arXiv preprint arXiv:2107.05373 (2021). · arXiv
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. arXiv preprint arXiv:1706.03762 (2017). · arXiv
- Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903 (2017). · arXiv
- Frank Wilcoxon. 1992. Individual comparisons by ranking methods. In Breakthroughs in statistics. Springer, 196--202.
- Shengbin Xu Yuan Yao Feng Xu Tianxiao Gu Hanghang Tong and Jian Lu. 2019. Commit message generation for source code changes. In IJCAI.
- Pengcheng Yin, Graham Neubig, Miltiadis Allamanis, Marc Brockschmidt, and Alexander L Gaunt. 2018. Learning to represent edits. arXiv preprint arXiv:1810.13337 (2018). · arXiv
Cited by
Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code
Zhang, Z., Chen, C., Liu, B., Liao, C., Gong, Z., Yu, H., Li, J., & Wang, R. (2024) · Transactions on machine learning research · doi:10.13140/rg.2.2.32710.69440/1 · Cited by 194
Vulnerability Detection via Multiple-Graph-Based Code Representation
Qiu, F., Liu, Z., Hu, X., Xia, X., Chen, G., & Wang, X. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3427815 · Cited by 80
Automatic Commit Message Generation: A Critical Review and Directions for Future Work
Zhang, Y., Qiu, Z., Stol, K.-J., Zhu, W., Zhu, J., Tian, Y., & Liu, H. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3364675 · Cited by 42
CCT5: A Code-Change-Oriented Pre-trained Model
Lin, B., Wang, S., Liu, Z., Liu, Y., Xia, X., & Mao, X. (2023) · Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3611643.3616339 · Cited by 69
“We reuse the performance of FIRA reported by Dong et al. [11] to compare it with CCT5 .”
MethodChatGPT: A Study on its Utility for Ubiquitous Software Engineering Tasks
Sridhara, G., G., R. H., & Mazumdar, S. (2023) · arXiv · doi:10.48550/arxiv.2305.16837 · Cited by 68
Metadata
- Authors
- Dong, J., Lou, Y., Zhu, Q., Sun, Z., Li, Z., Zhang, W., & Hao, D.
- Affiliations
- Peking University (CN)
- Purdue University West Lafayette (US)
- Venue
- Proceedings of the 44th International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2022-05-21
- Pages
- 970-981
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W4284708426
- Cited by
- 61
- References
- 33
- Citations by year
- 2026: 10 · 2025: 17 · 2024: 23 · 2023: 11
- FWCI
- 11.40
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- Funders
- National Natural Science Foundation of China (61872008)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Software › Model-Driven Software Engineering Techniques
- Keywords
- commit message generation, software evolution, template-based generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.