The DOI matches its Crossref record, with a small difference in title or year; 84 of the 90 references it cites were found in a registry or an index; 4 of the 58 sources its claims cite were checked for support.
Grounded theory in software engineering research: a critical review and guidelines
Open accessAbstract
Grounded Theory (GT) has proved an extremely useful research approach in several fields including medical sociology, nursing, education and management theory. However, GT is a complex method based on an inductive paradigm that is fundamentally different from the traditional hypothetico-deductive research model. As there are at least three variants of GT, some ostensibly GT research suffers from method slurring, where researchers adopt an arbitrary subset of GT practices that are not recognizable as GT. In this paper, we describe the variants of GT and identify the core set of GT practices. We then analyze the use of grounded theory in software engineering. We carefully and systematically selected 98 articles that mention GT, of which 52 explicitly claim to use GT, with the other 46 using GT techniques only. Only 16 articles provide detailed accounts of their research procedures. We offer guidelines to improve the quality of both conducting and reporting GT studies. The latter is an important extension since current GT guidelines in software engineering do not cover the reporting process, despite good reporting being necessary for evaluating a study and informing subsequent research.
Overview
CoChat Summary
TL;DR
This critical review analyzes 98 software engineering articles mentioning grounded theory and finds widespread ambiguity and method slurring: 52 explicitly claim GT, 46 borrow GT techniques only, and only 16 provide detailed accounts of their research procedures. It compares three GT variants and offers guidelines for conducting and reporting GT studies in SE.
Key findings
- Of 98 articles mentioning GT, 52 explicitly claim to use GT and 46 use GT techniques only; only 16 provide detailed accounts of their research procedures.
- Among the 52 articles claiming GT, 39 did not acknowledge different GT variants; 13 acknowledged variants (5 classic, 8 Straussian, 0 constructivist), and only 5 stated an epistemological position, all interpretivist.
- Among 30 articles with significant methodological details, fewer than half reported key practices: simultaneous data collection and analysis n=13, memoing n=12, memo sorting n=4, constant comparison n=13, theoretical sampling n=12; 15 confirmed theoretical saturation.
- Few GT studies generated theory: 8 presented cohesive theories and a ninth presented hypotheses; other outputs included conceptual frameworks/models, sets of factors, themes/categories, or mere description (10 articles).
Methods
- Automated search of Scopus, IEEE Xplore, ACM Digital Library, and ScienceDirect using “grounded theory” AND “software engineering”; after duplicate removal, 1,763 papers; focused on nine peer-reviewed SE journals, excluding conference papers, magazines, specialist journals, editorials, secondary studies, and methodological reflections, yielding 98 papers.
- Read all 98 papers to extract claims about GT use, GT variants and epistemology, specific GT techniques, data collection/analysis, outputs, and role of literature; data recorded in a spreadsheet, with extraction and coding done by the primary author and reviewed by the remaining authors.
Limitations
- Stated in the paper: limited to nine well-known SE journals; excluded conference papers; possible sampling bias from the search string/strategy or publication bias; analysis can only assess how studies are reported, not how they were done; missing methodological details do not necessarily mean poor research.
- Evident from the text: the exact count of 52 GT claims is ambiguous and should be interpreted with caution, which the paper itself notes as a potential threat to validity; data extraction and coding were done by the primary author and reviewed by others, not independently double-coded.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 11 Not valid · 38 Not checked · 88 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“However, this guidance does not extend to reporting GT studies.”
What the sources say
- Not checked — no full text of the sourcecites [1] [1] Adolph, S., Hall, W. and Kruchten, P. 2011. Using grounded theory to study the experience of software development. Empirical Software Engineering , 16, 4, 487-513. - source
- Could not verifycites [17] [17] Coleman, G. and O'Connor, R. 2008. Investigating software process in practice: A grounded theory perspective. Journal of Systems and Software , 81, 772-784. - sourceExperimental — accuracy not yet measured
The Methodology section (p. 4) says grounded theory has established guidelines for conducting inductive research. It does not say whether those guidelines cover reporting grounded theory studies; searches for reporting guidance found no passage addressing that point. (LLM, conf=0.70)
- Not checked — no full text of the sourcecites [44] [44] Hoda, R., Noble, J. and Marshall, S. 2011. Grounded theory for geeks. In Proc. 18th Conference on Pattern Languages of Programs . - source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“We removed editorials, secondary studies (systematic reviews), and articles that present methodological reflections on the use of GT, rather than a specific GT study (e.g. [1, 12, 18, 46, 59]), resulting in a final set of 98 papers (available in an appendix [67]).”
What the sources say
- Supportedcites [67] [67] Stol, K.J., Ralph, P. and Fitzgerald, B. 2016. Appendix to "Grounded Theory Research in Software Engineering". University of Limerick. - source
Section 3.1 (p. 6) states that the authors removed editorials, systematic reviews, and methodological reflections on GT, leaving a final set of 98 papers. (LLM, conf=0.95)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fourteen other articles provided details on the coding process only (Box 2.3.3).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, many authors use GT techniques à la carte .”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Some articles present 'theory' in alternative forms instead of a set of concepts and relationships.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
45 more claims
Create a free account to see all 140 claims and to verify the 3 references still open.
- Probably not a substantial claim. 77
- It may state two separate claims as one. 37
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“has recently been adopted to study phenomena in software engineering [Stol et al. 2016] and programming languages [Lubin and Chasins 2021].”
From Grounded Copilot: How Programmers Interact with Code-Generating Models (2023) · cites this paper as [Stol et al. 2016]
The cited source says what the claim attributes to it.
In the citing paper
“We follow the framework laid out by Strauss and Corbin [Strauss and Corbin 1990], commonly called Straussian Grounded Theory [Stol et al. 2016].”
From Grounded Copilot: How Programmers Interact with Code-Generating Models (2023) · cites this paper as [Stol et al. 2016]
The cited source says what the claim attributes to it.
In the citing paper
“We follow the framework laid out by Strauss and Corbin [Strauss and Corbin 1990], commonly called Straussian Grounded Theory [Stol et al. 2016].”
From Grounded Copilot: How Programmers Interact with Code-Generating Models (2023) · cites this paper as Stol et al. 2016
The cited source says what the claim attributes to it.
In the citing paper
“We removed editorials, secondary studies (systematic reviews), and articles that present methodological reflections on the use of GT, rather than a specific GT study (e.g. [1, 12, 18, 46, 59]), resulting in a final set of 98 papers (available in an appendix [67]).”
From Grounded theory in software engineering research: a critical review and guidelines (2016) · cites this paper as [67]
In the citing paper
“Düllmann et al. [24] and some other researchers [69], [78], [81] considered neglecting change control in security most challenging factor of DevOps.”
From Prioritization based taxonomy of DevOps security challenges using PROMETHEE (2020) · cites this paper as [24]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4.1 Grounded Theory 'Use' is Ambiguous · p. 7
“four studies (Box 2.1) deviated so sharply from GT that they have not used grounded theory at all.”
§ 4.2 Many Studies Present Little to No Detail · p. 7
“18 (Box 2.1 in Fig. 3) present no details at all beyond claims such as: '[we] used a grounded theory approach for data gathering and data analysis.'”
Citations
Cites
(1984) · Cited by 81,983
The Discovery of Grounded Theory: Strategies for Qualitative Research.
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,361
Case Study Research: Design and Methods
Chaiklin, H. (1991) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199102000-00025 · Cited by 39,535
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
(1998) · Sage eBooks · Cited by 38,631
Building Theories from Case Study Research
Eisenhardt, K. M. (1989) · The Academy of Management Review · doi:10.2307/258557 · Cited by 17,455
(2014) · Cited by 15,747
(1994) · Cited by 13,126
Qualitative Analysis for Social Scientists
Strauss, A. L. (1987) · doi:10.1017/cbo9780511557842 · Cited by 12,277
(2013) · Cited by 12,072
Research works printed but not linked: 7
- Bogdan R. and Taylor S. 1975. Introduction to Qualitative Reseach Methods. Wiley & Sons New York. Bogdan R. and Taylor S. 1975. Introduction to Qualitative Reseach Methods . Wiley & Sons New York.
- Denzin , N. 1983. Interpretive interactionism . In: G. Morgan (Ed.) Beyond Method . Sage , California . Denzin, N. 1983. Interpretive interactionism. In: G. Morgan (Ed.) Beyond Method. Sage, California.
- Duchscher , J. E. B. and Morgan , D. 2004 . Grounded theory: reflections on the emergence vs. forcing debate . Journal of Advanced Nursing , 48 , 6 . Duchscher, J. E. B. and Morgan, D. 2004. Grounded theory: reflections on the emergence vs. forcing debate. Journal of Advanced Nursing, 48, 6.
- Glaser B. G. 1978. Theoretical Sensitivity. Sociology Press. Glaser B. G. 1978. Theoretical Sensitivity . Sociology Press.
- Morgan G. (Ed.). 1983. Beyond Method. Sage CA USA. Morgan G. (Ed.). 1983. Beyond Method. Sage CA USA.
- Strauss , A. and Corbin , J . 1994 . Grounded Theory Methodology: An Overview . In: N . Denzin and Y. Lincoln (Eds.) Handbook of Qualitative Research. Sage . Strauss, A. and Corbin, J. 1994. Grounded Theory Methodology: An Overview. In: N. Denzin and Y. Lincoln (Eds.) Handbook of Qualitative Research. Sage.
- Trochim , W. 2001. Research Methods Knowledge Base . Atomic Dog Publishing , Cincinnati, OH, USA . Trochim, W. 2001. Research Methods Knowledge Base. Atomic Dog Publishing, Cincinnati, OH, USA.
Cited by
Grounded Copilot: How Programmers Interact with Code-Generating Models
Barke, S., James, M. B., & Polikarpova, N. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3586030 · Cited by 436
“[Stol et al. 2016] provide a survey and a critical evaluation of 93 GT studies in software engineering.”
BackgroundMethodA Survey of DevOps Concepts and Challenges
Leite, L., Rocha, C., Kon, F., Milojicic, D., & Meirelles, P. (2020) · ACM Computing Surveys · doi:10.1145/3359981 · Cited by 484
“ual maps was based on Grounded Theory, which is a recognized method for conducting emergent qualitative research [66] and whose adoption in software engineering has grown considerably in recent years [117]. According to Charmaz, it reduces preconceived ideas about the research problem and helps researchers remain amen…”
BackgroundMethodInfluentialSampling in software engineering research: a critical review and guidelines
Baltes, S., & Ralph, P. (2022) · Empirical Software Engineering · doi:10.1007/s10664-021-10072-8 · Cited by 382
“Critical reviews in software engineering often investigate methodological topics; for example, how grounded theory and ethnography are reported (Stol et al. 2016; Zhang et al. 2019) or how qualitative research is synthesized (Huang et al. 2018).”
BackgroundMethodInfluentialSelf-citationAmpatzoglou, A., Bibi, S., Avgeriou, P., Verbeek, M., & Chatzigeorgiou, A. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.10.006 · Cited by 305
The ABC of Software Engineering Research
Stol, K.-J., & Fitzgerald, B. (2018) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3241743 · Cited by 245
“[202] 2016 Grounded theory Discusses different variants of grounded theory, GT use in SE studies, and guidelines for reporting GT.”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Stol, K.-J., Ralph, P., & Fitzgerald, B.
- Affiliations
- University of Limerick (IE)
- University of Auckland (NZ)
- Venue
- Proceedings of the 38th International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2016-05-14
- Pages
- 120-131
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W2353739181
- Cited by
- 470
- References
- 90
- Citations by year
- 2026: 34 · 2025: 37 · 2024: 52 · 2023: 50 · 2022: 46 · 2021: 63 · 2020: 53 · 2019: 56 · 2018: 49 · 2017: 23 · 2016: 7
- FWCI
- 359.37
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- Cork Open Research Archive (University College Cork, Ireland) (submittedVersion)
- ResearchSpace (University of Auckland) (submittedVersion)
- University of Limerick Institutional Repository (University of Limerick) (submittedVersion, cc-by-nc-sa)
- Funders
- ITEA
- Enterprise Ireland (IR/2013/0021)
- Royal Irish Academy
- Science Foundation Ireland (13/RC/2094)
- Irish Research Council
- Topics
- Social Sciences › Education › Qualitative Research Methods and Applications
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Keywords
- grounded theory, software engineering research, methodological quality, inductive research, reporting guidelines, research quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-12, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-12 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Grounded theory in software engineering research: a critical review and guidelines. https://app.cochat.ai/papers/10.1145/2884781.2884833
- The paper
- Stol, K.-J., Ralph, P., & Fitzgerald, B. (2016). Grounded theory in software engineering research: a critical review and guidelines. Proceedings of the 38th International Conference on Software Engineering. https://doi.org/10.1145/2884781.2884833
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.