The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista
Abstract
Many factors are believed to increase the vulnerability of software system; for example, the more widely deployed or popular is a software system the more likely it is to be attacked. Early identification of defects has been a widely investigated topic in software engineering research. Early identification of software vulnerabilities can help mitigate these attacks to a large degree by focusing better security verification efforts in these components. Predicting vulnerabilities is complicated by the fact that vulnerabilities are, most often, few in number and introduce significant bias by creating a sparse dataset in the population. As a result, vulnerability prediction can be thought of us preverbally “searching for a needle in a haystack.” In this paper, we present a large-scale empirical study on Windows Vista, where we empirically evaluate the efficacy of classical metrics like complexity, churn, coverage, dependency measures, and organizational structure of the company to predict vulnerabilities and assess how well these software measures correlate with vulnerabilities. We observed in our experiments that classical software measures predict vulnerabilities with a high precision but low recall values. The actual dependencies, however, predict vulnerabilities with a lower precision but substantially higher recall.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Use of relative code churn measures to predict system defect density
Nagappan, N., & Ball, T. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062514 · Cited by 775
Self-citation
Cited by
LineVul: a transformer-based line-level vulnerability prediction
Fu, M., & Tantithamthavorn, C. (2022) · Proceedings of the 19th International Conference on Mining Software Repositories · doi:10.1145/3524842.3528452 · Cited by 384
Ghaffarian, S. M., & Shahriari, H. R. (2018) · ACM Computing Surveys · doi:10.1145/3092566 · Cited by 353
Predicting Vulnerable Software Components via Text Mining
Scandariato, R., Walden, J., Hovsepyan, A., & Joosen, W. (2014) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2014.2340398 · Cited by 337
Connected and autonomous vehicles: A cyber-risk classification framework
Sheehan, B., Murphy, F., Mullins, M., & Ryan, C. (2019) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2018.06.033 · Cited by 170
Metadata
- Authors
- Zimmermann, T., Nagappan, N., & Williams, L.
- Venue
- 2010 Third International Conference on Software Testing, Verification and Validation
- Publisher
- IEEE
- Published
- 2010
- Pages
- 421-428
- OpenAlex
- W2154398797
- Cited by
- 205
- References
- 1
- FWCI
- 3.37
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista. https://app.cochat.ai/papers/10.1109/icst.2010.32
- The paper
- Zimmermann, T., Nagappan, N., & Williams, L. (2010). Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista. 2010 Third International Conference on Software Testing, Verification and Validation. https://doi.org/10.1109/icst.2010.32
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.