Guidelines for snowballing in systematic literature studies and a replication in software engineering
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index; 12 of the 23 sources its claims cite were checked for support.
Abstract
Background: Systematic literature studies have become common in software engineering, and hence it is important to understand how to conduct them efficiently and reliably.
Overview
CoChat Summary
TL;DR
The paper proposes a detailed snowballing procedure for systematic literature studies in software engineering and evaluates it by replicating a published systematic literature review. It concludes that snowballing can be a viable first search strategy and, in this case, found the same set of studies as the prior reviews.
Key findings
- The replication began with a tentative start set of 13 candidates; 3 were included in the start set.
- Across the study, 38 papers were evaluated and 11 papers were included in the final set.
- Efficiency varied sharply by step: start set 3/13 = 23%, iteration 1 7/25 = 28%, iteration 2 1/223 = 0.4%, and iteration 3 0%; overall efficiency was 3.7%.
- The paper states that the replication produced the same papers as the prior systematic literature reviews, and that 9 studies were in common with both reviews in [11].
Methods
- The paper develops a snowballing procedure based on experience from several systematic literature reviews and experimenting with different approaches; it specifies backward and forward snowballing, inclusion/exclusion handling, authors, and data extraction.
- For the replication, the author searched Google Scholar using the string “cross-company within-company software effort estimation” with time frame 1995–2005.
- The replication examined candidate papers through reference lists and citations, using title/publication-year screening, then abstracts, then full texts when needed.
Limitations
- The paper states a main validity threat: the researcher had read the original study 6–12 months earlier, which may have affected inclusion/exclusion decisions.
- The author notes that the identified start set was far from perfect, because the three start-set papers had one author in common, which could miss papers not linked to those papers.
- Evidence of limitations evident in the text: the efficiency results are based on a single replication case in one topic area, so generalizability beyond this case is not established (evident from the study design).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
10 Valid · 3 Not valid · 11 Not checked · 131 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“The same papers are identified.”
What the sources say
- Disputedcites [11] [11] MacDonell, S., Shepperd, M., Kitchenham, B. A. and Mendes, E. 2010. How reliable are systematic reviews in empirical software engineering?. IEEE Transactions on Software Engineering 36, 5, 676-687. - sourceExperimental — accuracy not yet measured
The Q1.6 ‘Papers included’ section and the text following Table 1 say the two reviews selected ten primary studies each, but only nine were common to both. The paper describes citation analysis within those reviews, not a snowballing replication that identified exactly the same papers. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“MacDonell et al. evaluated the reliability of systematic reviews through comparing the results of two studies with a common research question performed by two independent groups of researchers.”
What the sources say
- Supportedcites [11] [11] MacDonell, S., Shepperd, M., Kitchenham, B. A. and Mendes, E. 2010. How reliable are systematic reviews in empirical software engineering?. IEEE Transactions on Software Engineering 36, 5, 676-687. - source
The Introduction says the paper assesses systematic-review reliability by comparing two independent reviews addressing the same research question. Section 3.1 specifies that two teams undertook those reviews independently, and the Conclusions report that the teams' outcomes were compared. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Nine studies are in common with both previous systematic literature reviews presented in [11].”
What the sources say
- Supportedcites [11] [11] MacDonell, S., Shepperd, M., Kitchenham, B. A. and Mendes, E. 2010. How reliable are systematic reviews in empirical software engineering?. IEEE Transactions on Software Engineering 36, 5, 676-687. - source
The passage following Table 1 states that both systematic literature reviews selected 10 primary studies, with nine in common. This directly supports the citing sentence. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“If using the papers studied in detail as a efficiency measure, then the different approaches requires about the same effort.”
What the sources say
- Supportedcites [11] [11] MacDonell, S., Shepperd, M., Kitchenham, B. A. and Mendes, E. 2010. How reliable are systematic reviews in empirical software engineering?. IEEE Transactions on Software Engineering 36, 5, 676-687. - source
The Table 1 discussion says both reviews selected 10 primary studies, and §4.2 describes their data-extraction work on those studies. Thus, if the number of papers studied in detail is used as the efficiency measure, the two approaches are comparable on that measure; this does not establish equal time spent. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The guidelines for using snowballing as a way to search for relevant literature was successfully applied to a systematic literature review.”
plainstates a causeSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 155 claims and every source verdict.
- Probably not a substantial claim. 111
- It may state two separate claims as one. 60
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“we applied forward and backward snowballing based on the guidelines by Wohlin et al. [26]”
From A Multivocal Review of MLOps Practices, Challenges and Open Issues (2026) · cites this paper as Wohlin et al. [26]
The cited source says what the claim attributes to it.
In the citing paper
“As a guideline, this study was performed following well-known principles of systematic studies: References [193, 196, 207, 220].”
From Quantum Combinatorial Optimization in the NISQ Era: A Systematic Mapping Study (2024) · cites this paper as [220]
The cited source says what the claim attributes to it.
In the citing paper
“To minimize the variables that could compromise our study, we (i) conducted our study following accepted guidelines of systematic studies [181, 193, 207, 220], (ii) carefully designed our study in advance, and (iii) assessed, validated, and discussed the potential threats in each phase of the study.”
From Quantum Combinatorial Optimization in the NISQ Era: A Systematic Mapping Study (2024) · cites this paper as [220]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“HDFS logs describe operations on the storage block pool [22].”
From Practitioners’ expectations on log anomaly detection (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“only 4 papers [19], [20], [22], [36] evaluate their techniques across different domains, training on a source domain and testing on a different target domain.”
From Practitioners’ expectations on log anomaly detection (2025) · cites this paper as [22]
Experimental — accuracy not yet measured
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449 · cited 7×
“Similar ideas have been brought into information systems research, e.g. by Webster and Watson [2].”
BackgroundMethodInfluentialSystematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537 · cited 2×
“[13, 14] gives the impression that automation is better than manual search.”
BackgroundSystematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239 · cited 1×
“Systematic mapping studies have been highlighted as a complement to systematic literature reviews [8].”
BackgroundGreenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045 · cited 4×
“Greenhalgh and Peacock [15] applied three different search methods in their research, and concluded that protocol-driven search approaches by themselves are not necessarily the most efficient method regardless of the number of databases used, since some sources may be found through personal knowledge/contacts (e.”
BackgroundResultInfluentialSystematic literature reviews in software engineering – A tertiary study
Kitchenham, B., Pretorius, R., Budgen, D., Pearl Brereton, O., Turner, M., Niazi, M., & Linkman, S. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.03.006 · Cited by 1,230 · cited 2×
“[13, 14] gives the impression that automation is better than manual search.”
BackgroundMethodGLOBAL ECONOMIC PROSPECTS: THE RECESSION MAY BE OVER BUT WHERE NEXT?
(2013) · The Financial Crisis and the Global South · doi:10.2307/j.ctt183pb3w.5 · Cited by 908
Building knowledge through families of experiments
Basili, V. R., Shull, F., & Lanubile, F. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.799939 · Cited by 852
Rodrik, D., & Velasco, A. (1999) · National Bureau of Economic Research · doi:10.3386/w7364 · Cited by 711
Leading issues in economic development
(2000) · Choice Reviews Online · doi:10.5860/choice.38-2269 · Cited by 710
Systematic literature studies: database searches vs. backward snowballing
Jalali, S., & Wohlin, C. (2012) · Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement · doi:10.1145/2372251.2372257 · Cited by 659 · cited 11×
“Other complementary searches were not done either since the objective is to compare snowballing with a database-firstapproach in a similar way as in [19], although with a better specified procedure for using snowballing.”
BackgroundResultInfluentialSelf-citation
Cited by
Items 3,601–3,700 of 3,934
Martínez-Álvarez, P., Rivero, E., & Cheru, S. (2025) · Studies in Psychology Estudios de Psicología · doi:10.1177/02109395251397557
“…trabajo para la meta-síntesis continuó identificando trabajos de investigación adicionales mediante el método de bola de nieve hacia atrás y hacia adelante (Wohlin, 2014), lo que dio como resultado 61 estudios con 50 artículos y 11 tesis doctorales que cumplían los criterios de la meta-síntesis.”
Developing an Accessible Survey Completion Tool for People with Disabilities
Modesto, C., Pereira, L. S., & Duarte, C. (2025) · Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais (IHC) · doi:10.5753/ihc_estendido.2025.12992
“To gather requirements for accessible surveys, we adopted a snowballing research methodology [Wohlin 2014].”
Gamification Empowered by LLM-Based Agents: A Systematic Literature Review
Boubakri, M., & Nafil, K. (2025) · International Conference on Intelligent Systems: Theories and Applications · doi:10.1109/sita67914.2025.11273696
“A backward snowballing strategy was used to increase the breadth of studies identified in the current review which involved reviewing references from studies eligible for inclusion [47].”
Anticipating bugs: Ticket-level bug prediction and temporal proximity effects
Prova, D. L., Gentili, E., & Falessi, D. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10771-6 · Cited by 4
“We adopted a snowballing strategy [94] to expand the initial set of sources and further incorporated findings from requirements engineering research to identify text-and ticket-based indicators.”
Madani, F. S. H., Horne, A., & John, A. (2025) · Wiley Interdisciplinary Reviews Water · doi:10.1002/wat2.70045
“Simultaneously, forward snowballing is employed through citation databases such as Web of Science and Google Scholar, enabling the identification of more recent studies that have cited the key papers (Wohlin 2014).”
dos Santos, A. A., & Silva, P. S. M. (2026) · Artificial Intelligence and Law · doi:10.1007/s10506-026-09532-7 · Cited by 1
Ghatak, A., & Nagraj, P. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6587-9.ch002
Bisceglia, L. (2025) · Revista Internacional de Cooperación y Desarrollo · doi:10.21500/23825014.7914
Failler, P., Tambari, I., & Yuan, H. (2025) · Springer eBooks · doi:10.1007/978-3-031-93760-6_3
Alzubaidi, A. N. O., Ibrahim, A. A., & Abdulrazzaq, M. M. (2025) · doi:10.1109/satc65530.2025.11137233
Chloride distribution in the Brazilian marine atmosphere
Marvila, P. D. S., & Mounzer, E. C. (2025) · Multidisciplinary Reviews · doi:10.31893/multirev.2026055
Identification of critical soft cost elements in BIM-based construction projects: a Delphi survey
Farouk, A. M., Rahman, R. A., Haron, A. T., & Papadonikolaki, E. (2025) · Built Environment Project and Asset Management · doi:10.1108/bepam-12-2024-0289
Challenges and Solutions for Organizational Change in the Software Industry: A Tertiary Study
Lima, R. R., Oran, A. C., Marques, L., & França, C. (2025) · Journal of Software Engineering Research and Development · doi:10.5753/jserd.2025.6116
“Future work could expand this research by applying the snowballing technique (Wohlin, 2014) to the selected sec-Challenges ondary studies, potentially uncovering additional relevant studies.”
Exploring the Security Landscape of NFT Transactions
Hasan, M., Chowdhury, M. J. M., Biswas, K., Hasan, M., & Islam, S. (2025) · IEEE Access · doi:10.1109/access.2025.3641962 · Cited by 1
“We employed the snowballing method [31] to identify and select relevant papers.”
a systematic review on the visual analytics of legal corpora
Mentzingen, H., António, N., & Bação, F. (2026) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Outcomes of the Deloyers procedure: A systematic review and meta‐analysis of proportions
Delgado, L. M., Barone, G. L., Garcia, G., da Mota, H. V., PILON, G. B., Guedes, L. S. D. S. P., de Figueiredo, S. M. P., Pompeu, B. F., & Formiga, F. B. (2025) · Colorectal Disease · doi:10.1111/codi.70346
Rocha, R. D. L., & dos Santos, C. G. R. (2025) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2025.3646992
“We employed the systematic snowballing method [13], which identifies relevant literature by applying forward and back-ward citation tracking from an initial set of articles, following predefined inclusion criteria until no new relevant studies were identified.”
Classifying design-related uncertainties in LCA-based building optimization : A systematic review
Bi, X., Li, J., Iannaccone, G., et al. (2025) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1554/1/012130
Araújo, L., Santos, E. S. D., Cruz, R. D. J., Leal, I. A. F., & Santos, A. M. D. S. (2025) · Escola Regional de Computação Bahia, Alagoas e Sergipe (ERBASE) · doi:10.5753/erbase.2025.12976
War in Ukraine: Educating Journalists for Crisis Reporting
Kowalik, K., Liashenko, I., & Bondarenko, O. (2025) · Obraz · doi:10.21272/obraz.2025.3(49)-6-17
Effort Estimation in Agile Software Development Context: A Systematic Mapping Study
Khan, S., Saeed, S. A., Nisa, H. U., Javed, M., & Manzer, K. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-08977-9_19
Methodological Framework for a Climate-Agriculture Review in Venezuela
Hernández, A. R., Campos, B. O. O., Rendón, J. V., Nahas, L. I., & Montero, P. G. (2025) · The Latin American studies book series · doi:10.1007/978-3-032-06368-7_2
HBS Algorithmic Database Construction: A Chain-of-Thought-Driven Approach
Dou, K., Han, Y., Li, X., Zhu, Q., Zhang, D., & He, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6209-1_10
de Aquino, N. C., Reichert, C. O., Callefi, V. D. C., Ramos, V. S. D., Sznajder, Y., Lage, L. A. D. P. C., Culler, H. F., Rocha, V., Freitas, M. S., & Pereira, J. W. (2025) · doi:10.2196/preprints.89644
Silva, R. A. P., Ferreira, W., Pacitti, E., Frota, Y. A. R., & de Oliveira, D. (2026) · SN Computer Science · doi:10.1007/s42979-025-04582-1
“In this section, we present a simplified systematic mapping using the snowballing technique proposed by Wohlin [ 29].”
Deep Learning Methods for Thyroid Imaging Segmentation: a Systematic Review
Li, Y., Wang, Z., Yuan, Y., Guan, Y., & Zhang, Z. (2025) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa66321.2025.00055
“To ensure completeness, a snowballing process following Wohlin’s guidelines [18] was applied, identifying one additional relevant study.”
Assessing Refactoring in Education: A Systematic Literature Review on Evaluation, Goals, and Impact
Alanqari, S., Mkaouer, M. W., & Newman, C. D. (2025) · 2022 IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328472
“According to established guidelines [24], [25], we conducted the SLR in three principal stages: Planning , Reviewing , and Reporting .”
Improving Computing Education with 360-Degree Videos: A Tertiary Study
Mehboob, A., & Fronza, I. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328617
“…SLRs, systematic mapping studies (scoping reviews), or meta-analyses IC2 Articles published from Jan 1, 2020 to Dec 12, 2024 IC3 Studies focusing on the usage of 360-degree videos across various domains Additionally, we applied backward snowballing [25] starting from the studies we retrieved.”
Lesson Study por não-japoneses
Souza, M. A. V. F. D. S. (2025) · Revista Paranaense de Educação matemática · doi:10.33871/rpem.2025.14.34.10314
An Integrative Review for Developing the Research Question Formulation Meta-framework
Moser, E. (2026) · Octopus · doi:10.57874/kh3m-3s54
Catalog, Impact, and Evaluation of Microservice Bad Smells: A Systematic Literature Review
Xing, Y., Tu, Z., Chu, D., Yang, W., & Lv, Y. (2026) · Software Practice and Experience · doi:10.1002/spe.70053
Comparative Analysis of Generative AI Performance in University Programming Courses
Suomalainen, E., Vanhala, E., & Ikonen, J. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-14518-5_16
Wake boats and lakes: physical, ecological, and policy implications
Ortíz, D., Blackburn, S. R., Daulton, T., Kovar, B., Meyer, M. W., Pralle, C. E., & Stanley, E. H. (2026) · Lake and Reservoir Management · doi:10.1080/10402381.2025.2578757 · Cited by 1
“We performed a literature search complemented by using the snowball method (Wohlin 2014) to assess the current state of peer-reviewed literature that directly evaluated wake boat effects on inland waters.”
León, P. M. S., Farroñán, E. V. R., Chilicaus, G. C. F., Salinas, L. E. C., Aguinaga, D. A. L., & Cumpa, R. O. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-14706-6_15 · Cited by 1
Human-Centered Evaluation of REST API Fuzzing Tools: Bridging Academia and Industry
Susilo, F. F. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00395
“Additionally, backward and forward snow-balling [35] will ensure search comprehensiveness.”
Taxonomy of human-system interaction challenges for metaverse integration in industrial maintenance
Khanna, P., Karim, R., & Tretten, P. (2026) · Frontiers in Virtual Reality · doi:10.3389/frvir.2026.1718280
“This included the Backward citation tracking, which is a part of the snowballing method, by examining the reference lists of the shortlisted articles (Greenhalgh and Peacock, 2005; Wohlin, 2014).”
Reframing m-payment continuance: a communication-based systematic review
Feng, K., Zheng, L., Déjean, S., & Filieri, R. (2026) · Journal of Enterprise Information Management · doi:10.1108/jeim-06-2025-0444
Hong, K., Alvarez-Rodriguez, R., & Villodas, M. T. (2026) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-026-00556-8
Caban, S., Hinton, C., Pool, K., Wicke, R., & Garcia, G. M. (2026) · Journal of Aging and Physical Activity · doi:10.1123/japa.2024-0254
User Interface Design Strategies for Promoting Engagement: A Systematic Literature Review
Lezama-López, C. E., Pérez-Arriaga, J. C., Ocharán-Hernández, J. O., & Sanchéz-García, Á. J. (2025) · International Conference in Software Engineering Research and Innovation (CONISOFT) · doi:10.1109/conisoft66928.2025.00029
“Applying Wohlin's [20] snowballing procedure (one iteration backward and forward) identified 63 primary studies.”
Theory Use in Software Engineering: A Systematic Mapping StudyPreprint
de Queiroz, J. P. D. B., Ledo, C., Spinola, R. O., Mendes, E., & Maciel, R. S. P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6182208
Abhishek, K. C., Senaratne, S., Perera, S., & Nanayakkara, S. (2026) · Buildings · doi:10.3390/buildings16030658 · Cited by 5
“The backward snowballing technique has been adopted to select further relevant studies as observed during the detailed review of the literature obtained in the initial search [34].”
Design of Video Game Mechanics: A Systematic Literature Review
Vázquez-Villa, C., Ocharán-Hernández, J. O., Pérez-Arriaga, J. C., et al. (2025) · International Conference in Software Engineering Research and Innovation (CONISOFT) · doi:10.1109/conisoft66928.2025.00021
“To mitigate this limitation, a backward and forward snow-balling process was conducted [9] on the studies selected after applying all inclusion and exclusion criteria.”
Dutta, M., Saha, S., & Bosu, A. (2026) · Future Postharvest and Food · doi:10.1002/fpf2.70039
Evolving Text Matching: A Systematic Review of Classical and Modern Approaches in the Neural Network
Elmobark, N., Saad, A., Al-Khazaali, A. A. T., & Badouch, M. (2026) · Engineering headway · doi:10.4028/p-6ohowe · Cited by 1
“[35] Based on the guidelines, we established clear limits for excluding certain items from our analysis.”
Shuib, L. M., Eke, C. I., Azmi, N., Balakrishnan, V., & Rasak, H. A. (2026) · Neural Processing Letters · doi:10.1007/s11063-025-11807-0
Data visualization recommendation: Literature review and future perspectives
Rollwagen, A. F., & Manssour, I. H. (2026) · Information Visualization · doi:10.1177/14738716251409351
A Catalog of Participatory Reuse Challenges, Solutions, and Lessons Learned
Chen, X., Usman, M., & Badampudi, D. (2025) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec66846.2025.00112
“We followed the snowballing guidelines from Wohlin [15].”
Quayson, F. (2026) · Research Square · doi:10.21203/rs.3.rs-8913300/v1
Cerebral venous thrombosis in non-bacterial infections: a systematic review
Medeiros, M. D. C., Martins, E. B., Guaraldo, L., & Calvet, G. A. (2026) · BMC Neurology · doi:10.1186/s12883-026-04721-y
“Furthermore, a snowball search [12] was performed by screening the reference lists of all included studies to assess their eligibility for inclusion.”
Qayum, A., Qureshi, A. U. H., & Razzaq, A. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108091
Framework for Front-End planning of a small-scale project
Machado, E. V., & Pedron, C. D. (2026) · Revista de Gestão e Projetos · doi:10.5585/2026.29922
Fayez, H., Johansen, D., & Schneider-Marin, P. (2026) · Journal of Building Engineering · doi:10.1016/j.jobe.2026.115645 · Cited by 1
State of the Art of the Security of Code Generated by LLMs: A Multivocal Literature Review
Ramírez, L. C., Limón, X., Sanchéz-García, Á. J., & Pérez-Arriaga, J. C. (2025) · Programming and Computer Software · doi:10.1134/s0361768825700446 · Cited by 3
“To augment the automated search and ensure comprehensive coverage of the literature, we employed both backward and forward snowballing, following the methodology described by Wohlin [19].”
Understanding Gender Diversity in Software Teams: Insights from a Systematic Literature Review
Pérez-Arriaga, J. C., Sanchéz-García, Á. J., Alarcón-Alarcón, J., & Hernández-González, L. A. (2025) · Programming and Computer Software · doi:10.1134/s0361768825700562
“Additionally, snowballing based on [15] helped identify relevant studies omitted during initial searches, strengthening the comprehensiveness of the review.”
Bello-Trejo, S., Limón, X., Ocharán-Hernández, J. O., & Hernández-González, L. A. (2025) · Programming and Computer Software · doi:10.1134/s0361768825700422 · Cited by 1
“To broaden our research selection, we implemented the search approach proposed by [26], known as snowballing.”
Sandria, D., Mezura, C., & Benitez, E. (2025) · Programming and Computer Software · doi:10.1134/s0361768825700586
“To complement the initial results and mitigate potential omission bias, the snowballing technique was also applied [25], allowing us to explore references cited within the selected documents.”
Torres-Igartua, M. J., Sanchéz-García, Á. J., Ocharán-Hernández, J. O., et al. (2025) · Programming and Computer Software · doi:10.1134/s0361768825700604
“Since the initial set of 10 studies was considered insufficient, snowballing techniques [23] were employed, involving backward snowballing to review references and forward snowballing via Google Scholar to identify citing works, resulting in two iterations that expanded the corpus to 15 studies, as…”
Fitriyah, I. J., Muqoyyidin, A. W., Erlangga, S. Y., & Himmah, R. (2026) · Psychological Science and Education · doi:10.17759/pse.2026310105
In silico neuronal morphology classification: A systematic review
Lobato, F. M. F., Leite, J. B. P., Jacob, A. C., & Santana, R. (2026) · Neuroscience · doi:10.1016/j.neuroscience.2026.02.044 · Cited by 1
Silveira, R. A., Mamede, H. S., & Santos, A. (2026) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/13548565261426105 · Cited by 2
“In the fi rst stage, the search string was determined by deriving relevant keywords from the following research question: The review searched ACM, Scopus, IEEE Xplore, ScienceDirect, SpringerLink, Wiley, EBSCO, and JSTOR, with the results screened against the criteria, and Snowballing (Wohlin, 2014) supplemented the li…”
Inteligência Artificial na Educação: Proposta de um Framework para Adoção Ética
de Almeida, E. M., & Relli, C. D. S. (2025) · doi:10.5753/weriaedu.2025.16203
Nyandoro, K., Pham, D. H., & Ahn, Y. (2026) · Advances in Science, Technology & Innovation/Advances in science, technology & innovation · doi:10.1007/978-3-032-00545-8_10 · Cited by 1
Sustainability indicators in the bicycle industry: Mapping evidence and exposing research gaps
Triane, B. P., Coelho, M. C., Rafael, S. I. M., Khalaj, M., Pires, L., & Miranda, A. I. (2026) · Environmental and Sustainability Indicators · doi:10.1016/j.indic.2026.101210
Alakkas, N., & Mahmood, S. (2026) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2026.2635506
Policy prioritization in participatory planning: Which approach to use, when and why?
Iannaccone, G., Gatta, V., & Marcucci, E. (2026) · Transport Policy · doi:10.1016/j.tranpol.2026.104090
Lima, J. G., Espinola, T. V., Palmeira, E. G. Q., et al. (2025) · doi:10.5753/svr_estendido.2025.15787
“Subsequently, a supplementary snowballing (backward and forward citation analysis) [Wohlin 2014, Badampudi et al. 2015] added 3 more studies, totaling 11 studies for qualitative synthesis.”
Quality-Driven Edge-to-Cloud Architecture for Crowd Monitoring with Wi-Fi Sensing
Abreu, F. B. E., Marinheiro, R. N., Oliveira, J., et al. (2025) · doi:10.1109/aiot66900.2025.00143
“Using snowball sampling per [16], the only matching study is Kumar et al. [15], which addresses both auto-healing and vertical handover in WSNs for landslide monitoring.”
Large language models in portuguese for healthcare: a systematic review
Shimaoka, A. M., Junior, A. C. D. S., Duarte, J. M., Costa, T. B. D. S., Pisa, I. T., Lopes, L. R., & Bandiera‐Paiva, P. (2026) · Research on Biomedical Engineering · doi:10.1007/s42600-026-00465-3 · Cited by 4
Silva, W. K., Nascimento, B. R., Duarte, R. B., et al. (2025) · doi:10.1109/clei67442.2025.11420758
“An additional step was incorporated using the Backward Snowballing approach [11].”
Bolaji, P., Babalola, A. E., & Fletcher, S. (2026) · Research Square · doi:10.21203/rs.3.rs-7687461/v1
Jayasiri, G., Herat, S., & Kaparaju, P. (2026) · Circular Economy and Sustainability · doi:10.1007/s43615-026-00861-y · Cited by 1
“Subsequently, using a snowballing technique [27 ] further 8 documents were identified, resulting in 12 documents related to eco-modulation.”
Computer Support to Well-Being Based on Emotions: A Systematic Mapping and Snowballing
Ancioto, A. S. R., de Oliveira, F. C. J., & Néris, V. P. D. A. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2640459
Delgado, L. M., Oliveira, R. E. N. D. N., Machado, G. F., et al. (2026) · Annals of Surgical Oncology · doi:10.1245/s10434-026-19376-9
Parker, C. H., Ferretti, A., Yaramada, L., et al. (2026) · Surgical Endoscopy · doi:10.1007/s00464-026-12634-7
Upcycling Motivation Internalization: A Self-Determination Theory Perspective
Zhu, Q. (2026) · Circular Economy and Sustainability · doi:10.1007/s43615-026-00902-6 · Cited by 4
“Therefore, we utilized snowball sampling to identify information-rich cases among upcycling practitioners—a group often considered “hard-to-reach” in broad surveys [14].”
Tradition meets transformation: the rise of women’s football in the Kingdom of Saudi Arabia
Reeves, M. J., Alkilani, L. F., & Blundell, M. (2026) · Managing Sport and Leisure · doi:10.1080/23750472.2026.2644941
Alves, L. G. F., Baer, M. F., Laato, S., Klonner, C., & Fagerholm, N. (2026) · International GamiFIN Conference (GamiFIN) · doi:10.1145/3789624.3789645 · Cited by 1
“We performed manuscript screening and selection processes based on the PRISMA workflow [70] complemented with snowballing [117].”
Literature Discovery and Synthesis With AI: Narrative, Scoping, and Systematic Reviews
(2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9340-7.ch003
Akinwalere, S. N., & Chang, K. (2026) · Journal of Industry Competition and Trade · doi:10.1007/s10842-026-00463-2
Brustad, T. F. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1794564 · Cited by 1
News media coverage of gun violence: a scoping review
Topaz, C. M., Jae, G., & Higdon, J. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-06998-3 · Cited by 1
Henes, M., Bitsch, G., & Louw, L. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.02.229
Caetano, S. P., & Lee, S.-W. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.113066
The NS 3420 As Traceability Barrier in Norwegian Construction
Lohne, J., & Mohn, K. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.03.171
Aruleba, K., & Esenogho, E. (2026) · Sustainability · doi:10.3390/su18073170 · Cited by 4
Chica-Contreras, G., Carvallo, J. P., & Naranjo‐Gil, D. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.03.039
Khattra, A. K., Hildebrandt, I. M., & Jeong, S. (2026) · Journal of Food Protection · doi:10.1016/j.jfp.2026.100766 · Cited by 1
A Literature Survey on Software Component Selection in Component-Based Software Engineering
Ansari, M. J., & Barcomb, A. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3801965
Demirci, F. S., Okudan, O., & Işık, Z. (2026) · Engineering Construction & Architectural Management · doi:10.1108/ecam-11-2024-1508
Ribeiro, J. A. D. S., & Giacomini, L. A. (2026) · Exploration of Musculoskeletal Diseases · doi:10.37349/emd.2026.1007122 · Cited by 2
Agent-based modeling and life cycle assessment: A systematic review
Carrey, P., Jouannais, P., Hélias, A., & Loiseau, E. (2026) · Cleaner Environmental Systems · doi:10.1016/j.cesys.2026.100433
A Review of Honeypots: Fingerprinting Techniques, Detection, and Evasion Mechanisms
Chaudhry, A., Andersen, C., Choudhary, G., & Dragoni, N. (2026) · Future Internet · doi:10.3390/fi18040190
Supporting architectural design of acknowledged Software-intensive Systems- of-Systems
Gonçalves, M. B. (2016) · theses.fr (ABES) · doi:10.70675/c906d7e9zdf28z4a6cza5c5ze1f68dcb6f37 · Cited by 2
Chan, B. (2026) · European Journal of Engineering Education · doi:10.1080/03043797.2026.2651421
Neural Network Tools in the Arsenal of a University Teacher
Fedorov, A. O., Vakku, G. V., & Lebedeva, S. E. (2026) · Galactica Media Journal of Media Studies · doi:10.46539/gmd.v8i2.669
An Evidence-Based Roadmap to Support the Internet of Things Software Systems Engineering
Motta, R. C. (2021) · theses.fr (ABES) · doi:10.70675/b06e03e7z349dz408dza755zaedeec70b862 · Cited by 3
Personnalisation dans les systèmes Cyber-Sociaux Physiques
Yilma, B. A. (2021) · theses.fr (ABES) · doi:10.70675/014bae07z0d7dz4319z9a69z31eb2563ac5b
Chen, W. (2021) · theses.fr (ABES) · doi:10.70675/142c7118zd2c3z452fz8095zf253290feb45
Metadata
- Authors
- Wohlin, C.
- Affiliations
- Blekinge Institute of Technology (SE)
- Corresponding author
- Wohlin, Claes
- ORCID
- Wohlin, Claes
- Venue
- Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering
- Publisher
- ACM
- Published
- 2014-05-13
- Pages
- 1-10
- OpenAlex
- W1975675278
- Cited by
- 4,234
- References
- 31
- Citations by year
- 2026: 433 · 2025: 552 · 2024: 651 · 2023: 594 · 2022: 566 · 2021: 477 · 2020: 356 · 2019: 250 · 2018: 175 · 2017: 98 · 2016: 60 · 2015: 17 · 2014: 4
- FWCI
- 50.91
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Evaluation and Assessment in Software Engineering (EASE) (publishedVersion)
- Funders
- Lunds Universitet
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- snowballing, systematic reviews, research guidelines, software engineering literature, replication study, literature search strategies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.