The SPACE of developer productivity
Open accessThe DOI matches its Crossref record; 22 of the 23 references it cites were found in a registry or an index.
Abstract
There's more to it than you think.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Commits are a natural discrete unit of coding work, are widely tracked as a developer-activity measure in the software-engineering literature (Forsgren et al., 2021;DORA, 2024), and are observed at high frequency in our data.”
From Writing Code vs. Shipping Code: Productivity Effects Across Generations of AI Coding Tools (2026) · cites this paper as Forsgren et al., 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Flow: The Psychology of Optimal Experience
Mirvis, P. H., & Csikszentmihalyi, M. (1991) · The Academy of Management Review · doi:10.2307/258925 · Cited by 3,611
Awareness and coordination in shared workspaces
Dourish, P., & Bellotti, V. (1992) · Proceedings of the 1992 ACM conference on Computer-supported cooperative work - CSCW '92 · doi:10.1145/143457.143468 · Cited by 2,550
Early predictors of job burnout and engagement.
Maslach, C., & Leiter, M. P. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.3.498 · Cited by 2,397 · cited 1×
“The SPACE framework provides a way to logically and systematically think about productivity in a much bigger space and to carefully choose balanced metrics linked to goals— and how they may be limited if used alone or in the wrong context.”
BackgroundTaking CSCW seriously: Supporting articulation work
Schmidt, K., & Bannon, L. (1992) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/bf00752449 · Cited by 1,043 · cited 1×
“Understanding and measuring team productivity and team member expectations are, however, complicated because of items that are difficult to measure such as invisible work(21) and articulation work for coordinating and planning team tasks.(18) That said, the following are examples of metrics that may be used as proxies…”
BackgroundSocial coding in GitHub: transparency and collaboration in an open software repository
Dabbish, L., Stuart, C., Tsay, J., & Herbsleb, J. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145396 · Cited by 999
Suchman, L. (1995) · Communications of the ACM · doi:10.1145/223248.223263 · Cited by 991
Taking CSCW Seriously: Supporting Articulation Work (1992)
Schmidt, K. (2008) · Computer Supported Cooperative Work · doi:10.1007/978-1-84800-068-1_3 · Cited by 800
Gender and Tenure Diversity in GitHub Teams
Vasilescu, B., Posnett, D., Ray, B., van den Brand, M. G. J., Serebrenik, A., Devanbu, P., & Filkov, V. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702549 · Cited by 354 · cited 1×
“Teams that are diverse and inclusive are higher performing.(22) More effective teams work on the right problems, are more likely to be successful at brainstorming new ideas and will choose better solutions from all the alternatives.”
BackgroundPandemic programming: How COVID-19 affects software developers and how their organizations can help
Ralph, P., Baltes, S., Adisaputri, G., Torkar, R., Kovalenko, V., Kalinowski, M., Novielli, N., Yoo, S., Devroey, X., Tan, X., et al. (2020) · Empirical Software Engineering · doi:10.1007/s10664-020-09875-y · Cited by 269
A Tale of Two Cities: Software Developers Working from Home during the COVID-19 Pandemic
Ford, D., Storey, M.-A., Zimmermann, T., Bird, C., Jaffe, S., Maddila, C., Butler, J. L., Houck, B., & Nagappan, N. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3487567 · Cited by 217 · cited 1×
“By remembering that developer productivity is personal, 7 developers can leverage it to gain insights into their work so they can take control of their time, energy, and days.”
BackgroundSelf-citation
Research works printed but not linked: 3
- Butler , J.L. , Jaffe , S. Challenges and gratitude: a diary study of software engineers working from home during Covid-19 pandemic (Aug . 2020 ). Microsoft ; https://www.microsoft.com/en-us/research/publication/challenges-and-gratitude-a-diary-study-of-software-engineers-working-from-home-during-covid-19-pandemic/. Butler, J.L., Jaffe, S. Challenges and gratitude: a diary study of software engineers working from home during Covid-19 pandemic (Aug. 2020). Microsoft; https://www.microsoft.com/en-us/research/publication/challenges-and-gratitude-a-diary-study-of-software-engineers-working-from-home-during-covid-19-pandemic/.
- Forsgren , N. , Humble , J. Kim , G. Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations . IT Revolution Press , 2018 . Forsgren, N., Humble, J. Kim, G. Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations. IT Revolution Press, 2018.
- Fuks , H. , Raposo , A. , Gerosa , M. A. , Pimental , M. The 3C collaboration model. Encyclopedia of E-Collaboration . Ned Kock, ed. IGI Global, 2008 , 637--644. https://www.researchgate.net/publication/292220266_The_3C_collaboration_model. Fuks, H., Raposo, A., Gerosa, M. A., Pimental, M. The 3C collaboration model. Encyclopedia of E-Collaboration. Ned Kock, ed. IGI Global, 2008, 637--644. https://www.researchgate.net/publication/292220266_The_3C_collaboration_model.
Cited by
Productivity Assessment of Neural Code Completion
Ziegler, A., Kalliamvakou, E., Li, X. A., Rice, A., Rifkin, D., Simister, S., Sittampalam, G., & Aftandilian, E. (2022) · Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming · doi:10.1145/3520312.3534864 · Cited by 200
“In our investigation we used the SPACE framework [6] to design a survey that captures self-reported productivity, and paired the self-reported data with usage telemetry.”
BackgroundMethodInfluentialMeasuring GitHub Copilot's Impact on Productivity
Ziegler, A., Kalliamvakou, E., Li, X. A., Rice, A., Rifkin, D., Simister, S., Sittampalam, G., & Aftandilian, E. (2024) · Communications of the ACM · doi:10.1145/3633453 · Cited by 124
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Mozannar, H., Bansal, G., Fourney, A., & Horvitz, E. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641936 · Cited by 114
“We recognize that this approach is incomplete: the costs associated with solving programming tasks are multi-dimensional, and it can be challenging to assign a single real-valued number to cover all facets of the task [12].”
Sustainable Environment to Prevent Burnout and Attrition in Project Management
Govindaras, B., Wern, T. S., Kaur, S., Haslin, I. A., & Ramasamy, R. K. (2023) · Sustainability · doi:10.3390/su15032364 · Cited by 68
Impostor Phenomenon in Software Engineers
Guenes, P., Tomaz, R., Kalinowski, M., Baldassarre, M. T., & Storey, M. (2024) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1145/3639475.3640114 · Cited by 35
“Forsgren et al. recently created the SPACE of Developer Productivity framework [9, 10].”
BackgroundMethodInfluentialSelf-citationWriting Code vs. Shipping Code: Productivity Effects Across Generations of AI Coding Tools
Demirer, M., Musolff, L., & Yang, L. (2026) · doi:10.3386/w35275 · Cited by 22
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Mozannar, H., Bansal, G., Fourney, A., & Horvitz, E. (2022) · arXiv · doi:10.48550/arxiv.2210.14306 · Cited by 114
“We recognize that this approach is incomplete: the costs associated with solving programming tasks are multi-dimensional and it can be challenging to assign a single real-valued number to cover all facets of the task Forsgren et al. [2021a]. Nevertheless, we argue that, like accuracy, efficiency-capturing measures of…”
BackgroundMethodHow Much Does AI Impact Development Speed? an Enterprise-Based Randomized Controlled Trial
Paradis, E., Grey, K., Madison, Q., Nam, D., Macvean, A., Meimand, V., Zhang, N., Ferrari-Church, B., & Chandra, S. (2025) · 2025 IEEE/ACM 47th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip66354.2025.00060 · Cited by 20
Innovation in Large-scale agile - Benefits and Challenges of Hackathons when Hacking from Home
Ulfsnes, R., Stray, V. G., Moe, N. B., & Šmite, D. (2021) · NORA - Norwegian Open Research Archives · Cited by 9
Restrepo-Tamayo, L. M., Gasca‐Hurtado, G. P., & Valencia-Calvo, J. (2024) · IEEE Access · doi:10.1109/access.2024.3388505 · Cited by 9
Stray, V., Barbala, A., & Wivestad, V. T. (2025) · Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering · doi:10.1145/3696630.3730566 · Cited by 19
Developers’ Dilemma: Opportunities and Pitfalls of Generative AI for Software Development
Zacharias, J., Popova, A., von Zahn, M., Chen, J., & Hinz, O. F. (2026) · Business & Information Systems Engineering · doi:10.1007/s12599-026-00998-y · Cited by 10
Impostor Phenomenon Among Software Engineers: Investigating Gender Differences and Well-Being
Guenes, P., Tomaz, R., Trinkenreich, B., Baldassarre, M. T., Storey, M., & Kalinowski, M. (2025) · doi:10.1109/geicse66911.2025.00009 · Cited by 10
Self-citationWork Patterns of Software Engineers in the Forced Working-From-Home ModePreprint
Šmite, D., Moe, N. B., Klotins, E., & González‐Huerta, J. (2021) · arXiv (Cornell University) · Cited by 2
What Could Possibly Go Wrong: Undesirable Patterns in Collective Development
Evtikhiev, M., Koshchenko, E., & Kovalenko, V. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3707451 · Cited by 3
“Frameworks like SPACE [42] can be seen as a blend between organizational strategies and models.”
A Systematic Approach to Measuring Developer Productivity: The Prismetrix Method
Kawalerowicz, M., & Pietranik, M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09318-9_23 · Cited by 2
Both personality and social identity predict perceived software team productivity: A survey study
Abdeldayem, K., Khatib, K., & Gren, L. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108196 · Cited by 1
“Productivity was self-assessed, which is an established but imperfect measure [1].”
InfluentialRamírez, C. D., Garcés, K., Vizcaíno, A., Rolón, E., Soto, J. P., García, F. O., & Aranda, G. N. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5406287
Fair Developer Score: Build-Adjusted Measurement of Effort and Impact
Wang, X., Zhu, J., Feng, J., Zhang, Z., Rauvola, J., Delgado, D., Antar, A., & Ali, A. (2025) · IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW) · doi:10.1109/asew67777.2025.00054
Liu, C., Lin, Y., Chang, J., Liu, J., Qi, B., Jiang, B., Huang, Z., & Dong, J. S. (2026) · Proceedings of the ACM on Programming Languages · doi:10.1145/3798249 · Cited by 4
Udrescu, E. S., Suduc, A.-M., Udrescu, A., & Bîzoi, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6826891
Adaptive AI Productivity Assistant for Developers in Visual Studio Code
Ranasinghe, R. A. N. D., Veenath, G. D. T., Silva, K. C. R., Beligolla, B. G. D. N., Wijendra, D., & Krishara, J. (2026) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn70047.2026.11594203
Keeping Humans in the Driver’s Seat: A Conceptual Framework for GenAI and Competence Debt
Lüders, C. M., Krużycki, O., & Brandt, C. (2026) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3803437.3806707
“Existing metric frameworks, like the DX AI measurement framework by Noda and Tacho [1], or the SPACE framework for developer productivity by Forsgren et al. [15], could serve as inspiration.”
WeaveXR: Bridging the XR Authoring Gap with Execution-Faithful In-Situ Development
Giovanopoulos, N., Leonidis, A., & Stephanidis, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33500-5_8
Kawalerowicz, M., & Pietranik, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36871-3_27
Unpacking AI Agent Participation in Issue-Centered Collaboration in Open-Source Software Development
Zhi, K., Fan, G., & Chen, W. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832206
“Drawing on the SPACE framework [10], we treat productivity in AI-assisted OSS development as a multi-dimensional construct.”
Schoeman, M., Scholtz, C., Smuts, H., Louw, P., & Smit, D. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-38498-0_29
Metadata
- Authors
- Forsgren, N., Storey, M.-A., Maddila, C., Zimmermann, T., Houck, B., & Butler, J.
- Affiliations
- GitHub
- University of Victoria (CA)
- Microsoft (United States) (US)
- Bellevue College (US)
- ORCID
- Venue
- Communications of the ACM
- Published
- 2021-05-24
- Volume
- 64
- Issue
- 6
- Pages
- 46-53
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W3164546521
- Cited by
- 21
- References
- 23
- Citations by year
- 2026: 10 · 2025: 4 · 2024: 4 · 2023: 1 · 2021: 2
- FWCI
- 1.58
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Communications of the ACM (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Social Sciences › Decision Sciences › Information Systems and Management › Personal Information Management and User Behavior
- Keywords
- developer productivity, software development, software engineering
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
