The DOI matches its Crossref record; 0 of the 3 references it cites were found in a registry or an index.
DevOps Metrics: Your biggest mistake might be collecting the wrong data.
Open accessAbstract
Delivering value to the business through software requires processes and coordination that often span multiple teams across complex systems, and involves developing and delivering software with both quality and resiliency. As practitioners and professionals, we know that software development and delivery is an increasingly difficult art and practice, and that managing and improving any process or system requires insights into that system. Therefore, measurement is paramount to creating an effective software value stream. Yet accurate measurement is no easy feat.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
System data may not be complete with respect to the required DevOps aspects, such as cultural measures.
“However, these data may not be complete with respect to the required DevOps aspects (e.g., cultural measures) [7].”
From Measuring Software Delivery Performance Using the Four Key Metrics of DevOps (2021) · cites this paper as [7]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Azzarello , D. , Debruyne , F. , Mottura , L. 2012. The chemistry of enthusiasm . Bain and Company ; http://www.bain.com/publications/articles/the-chemistry-of-enthusiasm.aspx. Azzarello, D., Debruyne, F., Mottura, L. 2012. The chemistry of enthusiasm. Bain and Company; http://www.bain.com/publicati
Azzarello, D. (n.d.)
UnresolvedDevOps Research and Assessment . 2014 , 2015 , 2016 , and 2017 State of DevOps Reports; https://devops-research.com/research.html. DevOps Research and Assessment. 2014, 2015, 2016, and 2017 State of DevOps Reports; https://devops-research.com/research.html.
(2014) · DevOps Research and Assessment
UnresolvedStroud R. Klavens E. Oehrlich E. Kinch A. Lynch D. 2017. A dangerous disconnect: executives overestimate DevOps maturity. Forrester. Stroud R. Klavens E. Oehrlich E. Kinch A. Lynch D. 2017. A dangerous disconnect: executives overestimate DevOps maturity. Forrester.
(n.d.)
Unresolved
Flagged first, then by citations
3 of the 3 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
DevOps Metrics and KPIs: A Multivocal Literature Review
Amaro, R., Pereira, R., & da Silva, M. M. (2024) · ACM Computing Surveys · doi:10.1145/3652508 · Cited by 37
Measuring Software Delivery Performance Using the Four Key Metrics of DevOps
Sallin, M., Kropp, M., Anslow, C., Quilty, J. W., & Meier, A. (2021) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-030-78098-2_7 · Cited by 20
“However, these data may not be complete with respect to the required DevOps aspects (e.g., cultural measures) [7].”
BackgroundFully Automated DORA Metrics Measurement for Continuous Improvement
Rüegger, J., Kropp, M., Graf, S., & Anslow, C. (2024) · doi:10.1145/3666015.3666020 · Cited by 18
Kyriazis, D. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.09.035 · Cited by 3
Friedman, A., Dhupelia, R., & Jackson, B. (2023) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr59073.2023.00045 · Cited by 3
Metadata
- Authors
- Forsgren, N., & Kersten, M.
- Affiliations
- DORA
- Tasktop Technologies (Canada) (CA)
- ORCID
- Forsgren, Nicole
- Venue
- Queue
- Published
- 2017-12
- Volume
- 15
- Issue
- 6
- Pages
- 19-34
- ISSN
- 1542-7730 (ISSN-L)
- 1542-7749
- OpenAlex
- W3139420243
- Cited by
- 5
- References
- 3
- Citations by year
- 2024: 2 · 2023: 1 · 2021: 1 · 2018: 1
- FWCI
- 0.51
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Queue (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- software delivery, measurement, software quality, system resilience, software development process, software delivery pipelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
