Security and emotion: sentiment analysis of security discussions on GitHub
The DOI matches its Crossref record.
Abstract
Application security is becoming increasingly prevalent during software and especially web application development. Consequently, countermeasures are continuously being discussed and built into applications, with the goal of reducing the risk that unauthorized code will be able to access, steal, modify, or delete sensitive data. In this paper we gauged the presence and atmosphere surrounding security-related discussions on GitHub, as mined from discussions around commits and pull requests. First, we found that security related discussions account for approximately 10% of all discussions on GitHub. Second, we found that more negative emotions are expressed in security-related discussions than in other discussions. These findings confirm the importance of properly training developers to address security concerns in their applications as well as the need to test applications thoroughly for security vulnerabilities in order to reduce frustration and improve overall project atmosphere.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Sentiment Analysis for Software Engineering: How Far Can Pre-trained Transformer Models Go?
Zhang, T., Xu, B., Thung, F., Haryono, S. A., Lo, D., & Jiang, L. (2020) · 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsme46990.2020.00017 · Cited by 129
“Novielli et al. conducted an iterative extraction to obtain the annotated text units from the dataset provided by Pletea et al. [40].”
MethodCommitted to Trust: A Qualitative Study on Security & Trust in Open Source Software Projects
Wermke, D., Wöhler, N., Klemmer, J. H., Fourné, M., Acar, Y., & Fahl, S. (2022) · 2022 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46214.2022.9833686 · Cited by 42
“Issues and commits are important structural features in the open source community, enabling evaluations of general statistics [69], security tactics [70], and emotions [71].”
BackgroundThe Emotional Roller Coaster of Responding to Requirements Changes in Software Engineering
Madampe, K., Hoda, R., & Grundy, J. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3172925 · Cited by 33
“[41] conducted sentiment analysis of discussions and comments of commits and pull requests.”
BackgroundA Framework for Emotion-Oriented Requirements Change Handling in Agile Software Engineering
Madampe, K., Hoda, R., & Grundy, J. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3253145 · Cited by 32
Can GPT-4 Replicate Empirical Software Engineering Research?
Liang, J. T., Badea, C., Bird, C., DeLine, R., Ford, D., Forsgren, N., & Zimmermann, T. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3660767 · Cited by 19
“For instance, the first module in the Pletea et al. [48] analysis plan provided instructions to "[extract] the relevant tables containing comments on commits and pull requests" , which GPT-4 successfully did.”
Influential
Metadata
- Authors
- Pletea, D., Vasilescu, B., & Serebrenik, A.
- Venue
- Proceedings of the 11th Working Conference on Mining Software Repositories
- Publisher
- ACM
- Published
- 2014-05-31
- Pages
- 348-351
- OpenAlex
- W2146649871
- Cited by
- 169
- References
- 0
- FWCI
- 9.69
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Security and emotion: sentiment analysis of security discussions on GitHub. https://app.cochat.ai/papers/10.1145/2597073.2597117
- The paper
- Pletea, D., Vasilescu, B., & Serebrenik, A. (2014). Security and emotion: sentiment analysis of security discussions on GitHub. Proceedings of the 11th Working Conference on Mining Software Repositories. https://doi.org/10.1145/2597073.2597117
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.