CoChat

One size does not fit all: a grounded theory and online survey study of developer preferences for security warning types

Open access
Danilova, Anastasia, Naiakshina, Alena, Smith, Matthew · 2020 · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering

The DOI matches its Crossref record; 65 of the 67 references it cites were found in a registry or an index.

Abstract

A wide range of tools exist to assist developers in creating secure software. Many of these tools, such as static analysis engines or security checkers included in compilers, use warnings to communicate security issues to developers. The effectiveness of these tools relies on developers heeding these warnings, and there are many ways in which these warnings could be displayed. Johnson et al. [46] conducted qualitative research and found that warning presentation and integration are main issues. We built on Johnson et al.'s work and examined what developers want from security warnings, including what form they should take and how they should integrate into their workflow and work context. To this end, we conducted a Grounded Theory study with 14 professional software developers and 12 computer science students as well as a focus group with 7 academic researchers to gather qualitative insights. To back up the theory developed from the qualitative research, we ran a quantitative survey with 50 professional software developers. Our results show that there is significant heterogeneity amongst developers and that no one warning type is preferred over all others. The context in which the warnings are shown is also highly relevant, indicating that it is likely to be beneficial if IDEs and other development tools become more flexible in their warning interactions with developers. Based on our findings, we provide concrete recommendations for both future research as well as how IDEs and other security tools can improve their interaction with developers.

Overview

Integrity signals

Registry

Crossref · 10.1145/3377811.3380387

Cites

65 of 65 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 65 references

Research works printed but not linked: 8

  1. [n.d.]. Amazon Mechanical Turk (MTurk). https://www.mturk.com/ Accessed: August 2019.
  2. [n.d.]. Qualtrics. https://www.qualtrics.com Accessed: August 2019.
  3. [n.d.]. XING. https://www.xing.com/ Accessed: August 2019.
  4. NK Denzin. 1970. The Research Act in Sociology (London, Croom Helm). Denzin The Research Act in Sociology 1970 (1970).
  5. Don A Dillman. 2011. Mail and Internet surveys: The tailored design method-2007 Update with new Internet, visual, and mixed-mode guide. John Wiley & Sons.
  6. 10.5555/2486788.2486877 · doi:10.5555/2486788.2486877
  7. 10.5555/3155562.3155681 · doi:10.5555/3155562.3155681
  8. David L Morgan. 1996. Focus groups. Annual review of sociology 22, 1 (1996), 129--152.

Cited by

See all 27

Metadata

Authors
Danilova, A., Naiakshina, A., & Smith, M.
Affiliations
University of Bonn (DE)
Venue
Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering
Publisher
ACM
Published
2020-06-27
Pages
136-148
ISSN
0270-5257 (ISSN-L)
OpenAlex
W3090957174
Cited by
25
References
67
Citations by year
2026: 3 · 2025: 1 · 2024: 2 · 2023: 6 · 2022: 6 · 2021: 7
FWCI
3.79
Type
conference paper
Language
en
Open access
Locations
  • ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion, cc-by)
  • Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) (submittedVersion, other-oa)
  • Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
Funders
ERC (678341)
Topics
  • Physical Sciences › Computer Science › Information Systems › Web Application Security Vulnerabilities
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
Keywords
security warnings, developer preferences, integrated development environment, static analysis, security tools, developer workflows, software security

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: One size does not fit all: a grounded theory and online survey study of developer preferences for security warning types. https://app.cochat.ai/papers/10.1145/3377811.3380387
The paper
Danilova, A., Naiakshina, A., & Smith, M. (2020). One size does not fit all: a grounded theory and online survey study of developer preferences for security warning types. Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering. https://doi.org/10.1145/3377811.3380387

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.