The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Experiences from using snowballing and database searches in systematic literature studies
Open accessAbstract
Background: Systematic literature studies are commonly used in software engineering. There are two main ways of conducting the searches for these type of studies; they are snowballing and database searches. In snowballing, the reference list (backward snowballing - BSB) and citations (forward snowballing - FSB) of relevant papers are reviewed to identify new papers whereas in a database search, different databases are searched using predefined search strings to identify new papers. Objective: Snowballing has not been in use as extensively as database search. Hence it is important to evaluate its efficiency and reliability when being used as a search strategy in literature studies. Moreover, it is important to compare it to database searches. Method: In this paper, we applied snowballing in a literature study, and reflected on the outcome. We also compared database search with backward and forward snowballing. Database search and snowballing were conducted independently by different researchers. The searches of our literature study were compared with respect to the efficiency and reliability of the findings. Results: Out of the total number of papers found, snowballing identified 83% of the papers in comparison to 46% of the papers for the database search. Snowballing failed to identify a few relevant papers, which potentially could have been addressed by identifying a more comprehensive start set. Conclusion: The efficiency of snowballing is comparable to database search. It can potentially be more reliable than a database search however, the reliability is highly dependent on the creation of a suitable start set.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · cited 7×
“More recently, in 2014, Wohlin conducted a replication study [12] to compare SB results including BSB and FSB and DB search.”
BackgroundMethodInfluentialSelf-citationGreenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045 · cited 2×
“An audit was conducted to find how the primary sources were originally identified by Greenhalgh and Peacock [2].”
Background(2004) · doi:10.5555/998675.999432 · Cited by 656
Analyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
How Reliable Are Systematic Reviews in Empirical Software Engineering?
MacDonell, S., Shepperd, M., Kitchenham, B., & Mendes, E. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.28 · Cited by 108
Cited by
Wohlin, C., Kalinowski, M., Romero Felizardo, K., & Mendes, E. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.106908 · Cited by 432
Self-citationNexus between nature-based solutions, ecosystem services and urban challenges
Babí Almenar, J., Elliot, T., Rugani, B., Philippe, B., Navarrete Gutierrez, T., Sonnemann, G., & Geneletti, D. (2021) · Land Use Policy · doi:10.1016/j.landusepol.2020.104898 · Cited by 378
The logistics of the short food supply chain: A literature review
Paciarotti, C., & Torregiani, F. (2021) · Sustainable Production and Consumption · doi:10.1016/j.spc.2020.10.002 · Cited by 262
Mourão, E., Pimentel, J. F., Murta, L., Kalinowski, M., Mendes, E., & Wohlin, C. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106294 · Cited by 191
Self-citationKhan, W., Kumar, T., Zhang, C., Raj, K., Roy, A. M., & Luo, B. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7020097 · Cited by 143
Metadata
- Authors
- Badampudi, D., Wohlin, C., & Petersen, K.
- Venue
- Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering
- Publisher
- ACM
- Published
- 2015-04-27
- Pages
- 1-10
- OpenAlex
- W2014079492
- Cited by
- 221
- References
- 5
- FWCI
- 10.23
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Experiences from using snowballing and database searches in systematic literature studies. https://app.cochat.ai/papers/10.1145/2745802.2745818
- The paper
- Badampudi, D., Wohlin, C., & Petersen, K. (2015). Experiences from using snowballing and database searches in systematic literature studies. Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering. https://doi.org/10.1145/2745802.2745818
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.