The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Learning from Experience in Software Development: A Multilevel Analysis
Abstract
This study examines whether individuals, groups, and organizational units learn from experience in software development and whether this learning improves productivity. Although prior research has found the existence of learning curves in manufacturing and service industries, it is not clear whether learning curves also apply to knowledge work like software development. We evaluate the relative productivity impacts from accumulating specialized experience in a system, diversified experience in related and unrelated systems, and experience from working with others on modification requests (MRs) in a telecommunications firm, which uses an incremental software development methodology. Using multilevel modeling, we analyze extensive data archives covering more than 14 years of systems development work on a major telecommunications product dating from the beginning of its development process. Our findings reveal that the relative importance of the different types of experience differs across levels of analysis. Specialized experience has the greatest impact on productivity for MRs completed by individual developers, whereas diverse experience in related systems plays a larger role in improving productivity for MRs and system releases completed by groups and organizational units. Diverse experience in unrelated systems has the least influence on productivity at all three levels of analysis. Our findings support the existence of learning curves in software development and provide insights into when specialized or diverse experience may be more valuable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Absorptive Capacity: A New Perspective on Learning and Innovation
Cohen, W. M., & Levinthal, D. A. (1990) · Administrative Science Quarterly · doi:10.2307/2393553 · Cited by 35,728
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Littell, R. C. (1996) · Medical Entomology and Zoology · Cited by 10,547
Levitt, B., & March, J. G. (1988) · Annual Review of Sociology · doi:10.1146/annurev.so.14.080188.001535 · Cited by 6,447
A metrics suite for object oriented design
Chidamber, S. R., & Kemerer, C. F. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.295895 · Cited by 5,669
An organizational learning framework: From intuition to institution
Crossan, M. M., Lane, H. W., & White, R. E. (1999) · The Academy of Management Review · doi:10.2307/259140 · Cited by 4,544 · cited 4×
“Further, learning processes can differ across levels (Crossan et al. 1999), and the types of experience and their impacts on productivity can also differ at different levels.”
BackgroundInfluentialProduct development: Past research, present findings and future directions
Brown, S. L., & Eisenhardt, K. M. (1995) · The Academy of Management Review · doi:10.2307/258850 · Cited by 3,777
Hierarchical Linear Models: Applications and Data Analysis Methods.
Goldstein, H., Bryk, A. S., & Raudenbush, S. W. (1993) · Journal of the American Statistical Association · doi:10.2307/2290750 · Cited by 3,321
Zander, U., & Kogut, B. (1995) · Organization Science · doi:10.1287/orsc.6.1.76 · Cited by 3,266
The Interplay Between Exploration and Exploitation
Gupta, A. K., Smith, K. G., & Shalley, C. E. (2006) · Academy of Management Journal · doi:10.5465/amj.2006.22083026 · Cited by 3,226
Brooks, F. P. (1975) · ACM SIGPLAN Notices · doi:10.1145/390016.808439 · Cited by 3,224
A schema theory of discrete motor skill learning.
Schmidt, R. A. (1975) · Psychological Review · doi:10.1037/h0076770 · Cited by 3,220
Transactive Memory: A Contemporary Analysis of the Group Mind
Wegner, D. M. (1987) · Theories of Group Behavior · doi:10.1007/978-1-4612-4634-3_9 · Cited by 2,700
The mythical man-month: essays on software engineering
(1996) · Choice Reviews Online · doi:10.5860/choice.33-5142 · Cited by 2,452
Swift Trust and Temporary Groups
Meyerson, D., Weick, K. E., & Kramer, R. M. (1996) · Trust in Organizations: Frontiers of Theory and Research · doi:10.4135/9781452243610.n9 · Cited by 1,982 · cited 1×
“Each development group is thus a temporary group (Meyerson et al. 1996), consisting of a set of developers working jointly on a task over a limited time period.”
BackgroundCoordinating Expertise in Software Development Teams
Faraj, S., & Sproull, L. (2000) · Management Science · doi:10.1287/mnsc.46.12.1554.12072 · Cited by 1,689
An Overview of the Logic and Rationale of Hierarchical Linear Models
Hofmann, D. A. (1997) · Journal of Management · doi:10.1016/s0149-2063(97)90026-x · Cited by 1,582
THE LEARNING CURVE: HISTORICAL REVIEW AND COMPREHENSIVE SURVEY
Yelle, L. E. (1979) · Decision Sciences · doi:10.1111/j.1540-5915.1979.tb00026.x · Cited by 1,541
Darr, E. D., Argote, L., & Epple, D. (1995) · Management Science · doi:10.1287/mnsc.41.11.1750 · Cited by 1,455
What Differences Make a Difference?: The Promise and Reality of Diverse Teams in Organizations
Mannix, E., & Neale, M. A. (2005) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2005.00022.x · Cited by 1,276
The Persistence and Transfer of Learning in Industrial Settings
Argote, L., Beckman, S. L., & Epple, D. (1990) · Management Science · doi:10.1287/mnsc.36.2.140 · Cited by 1,111
The Effects of Group Longevity on Project Communication and Performance
Katz, R. (1982) · Administrative Science Quarterly · doi:10.2307/2392547 · Cited by 1,102
Coordination in software development
Kraut, R. E., & Streeter, L. A. (1995) · Communications of the ACM · doi:10.1145/203330.203345 · Cited by 1,080
Bunderson, J. S., & Sutcliffe, K. M. (2002) · Academy of Management Journal · doi:10.2307/3069319 · Cited by 1,018
Group Versus Individual Training and Group Performance: The Mediating Role of Transactive Memory
Liang, D. W., Moreland, R., & Argote, L. (1995) · Personality and Social Psychology Bulletin · doi:10.1177/0146167295214009 · Cited by 1,010
An empirical study of speed and communication in globally distributed software development
Herbsleb, J. D., & Mockus, A. (2003) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2003.1205177 · Cited by 997
(1987) · Springer eBooks · doi:10.1007/978-1-4612-4634-3 · Cited by 968
Newton—Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data
Lindstrom, M. J., & Bates, D. M. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478693 · Cited by 862
The Assimilation of Software Process Innovations: An Organizational Learning Perspective
Fichman, R. G., & Kemerer, C. F. (1997) · Management Science · doi:10.1287/mnsc.43.10.1345 · Cited by 811
Reagans, R., Argote, L., & Brooks, D. (2005) · Management Science · doi:10.1287/mnsc.1050.0366 · Cited by 792
The Persistence and Transfer of Learning in Industrial Settings
ARGOTE, L. (1998) · The Strategic Management of Intellectual Capital · doi:10.1016/b978-0-7506-9850-4.50014-2 · Cited by 783
Holmqvist, M. (2004) · Organization Science · doi:10.1287/orsc.1030.0056 · Cited by 754
Cultural Conflict and Merger Failure: An Experimental Approach
Weber, R. A., & Camerer, C. F. (2003) · Management Science · doi:10.1287/mnsc.49.4.400.14430 · Cited by 601
Pisano, G. P., Bohmer, R. M. J., & Edmondson, A. C. (2001) · Management Science · doi:10.1287/mnsc.47.6.752.9811 · Cited by 565
The Situated Nature of Adaptive Learning in Organizations
Tyre, M. J., & von Hippel, E. (1997) · Organization Science · doi:10.1287/orsc.8.1.71 · Cited by 544
Organizational Learning: Creating, Retaining and Transferring Knowledge
Argote, L. (2013) · Springer eBooks · doi:10.1007/978-1-4614-5251-5 · Cited by 493
Learning by Doing Something Else: Variation, Relatedness, and the Learning Curve
Schilling, M. A., Vidal, P., Ployhart, R. E., & Marangoni, A. (2003) · Management Science · doi:10.1287/mnsc.49.1.39.12750 · Cited by 454
Ellis, H. C. (1965) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 398
Learning failure in information systems development
Lyytinen, K., & Robey, D. (1999) · Information Systems Journal · doi:10.1046/j.1365-2575.1999.00051.x · Cited by 366
Distribution of Knowledge, Group Network Structure, and Group Performance
Rulke, D. L., & Galaskiewicz, J. (2000) · Management Science · doi:10.1287/mnsc.46.5.612.12052 · Cited by 364
Vicious and Virtuous Circles in the Management of Knowledge: The Case of Infosys Technologies1
Garud, R., & Kumaraswamy, A. (2005) · MIS Quarterly · doi:10.2307/25148666 · Cited by 321
The role of knowledge in software development
Robillard, P. N. (1999) · Communications of the ACM · doi:10.1145/291469.291476 · Cited by 296
(1999) · Psychological Inquiry · doi:10.1207/s15327965pli1004_4 · Cited by 277
Banker, R. D., Davis, G. B., & Slaughter, S. A. (1998) · Management Science · doi:10.1287/mnsc.44.4.433 · Cited by 269
Self-citationMatusik, S. F., & Heeley, M. B. (2005) · Journal of Management · doi:10.1177/0149206304272293 · Cited by 260
Thornton, R. A., & Thompson, P. (2001) · American Economic Review · doi:10.1257/aer.91.5.1350 · Cited by 229
Ang, S., Slaughter, S., & Yee Ng, K. (2002) · Management Science · doi:10.1287/mnsc.48.11.1427.264 · Cited by 221
Self-citationChanging the paradigm of software engineering
Rajlich, V. (2006) · Communications of the ACM · doi:10.1145/1145287.1145289 · Cited by 191
A Field Study of Scale Economies in Software Maintenance
Banker, R. D., & Slaughter, S. A. (1997) · Management Science · doi:10.1287/mnsc.43.12.1709 · Cited by 171
Self-citationWastell, D. G. (1999) · MIS Quarterly · doi:10.2307/249490 · Cited by 163
Improve Software Quality by Reusing Knowledge and Experience
Basili, V. R., & Caldiera, G. (2005) · Springer eBooks · doi:10.1007/3-540-27662-9_16 · Cited by 137
Shared mental models and coordination in large-scale, distributed software development
Kraut, R. E., & Espinosa, J. A. (2002) · International Conference on Information Systems · Cited by 89
Self-citationAtkins, D. L., Ball, T., Graves, T., & Mockus, A. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1019478 · Cited by 85
Fitting Individual Growth Models Using SAS PROC MIXED
Hershberger, S. L., & Moskowitz, D. S. (2013) · Psychology Press eBooks · doi:10.4324/9781410604477-11 · Cited by 74
Inferring change effort from configuration management databases
Graves, T., & Mockus, A. (2002) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metric.1998.731253 · Cited by 65
Ramanujan, S., Scamell, R. W., & Shah, J. R. (2000) · Journal of Systems and Software · doi:10.1016/s0164-1212(00)00033-9 · Cited by 30
Huckman, R. S., & Staats, B. R. (2008) · RePEc: Research Papers in Economics · Cited by 2
Cited by
Organizational Learning: From Experience to Knowledge
Argote, L., & Miron-Spektor, E. (2011) · Organization Science · doi:10.1287/orsc.1100.0621 · Cited by 1,917
Research Commentary —Too Big to Fail: Large Samples and the p -Value Problem
Lin, M., Lucas, H. C., & Shmueli, G. (2013) · Information Systems Research · doi:10.1287/isre.2013.0480 · Cited by 972
Ren, Y., & Argote, L. (2011) · The Academy of Management Annals · doi:10.1080/19416520.2011.590300 · Cited by 542
Organizational Learning Processes and Outcomes: Major Findings and Future Research Directions
Argote, L., Lee, S., & Park, J. (2021) · Management Science · doi:10.1287/mnsc.2020.3693 · Cited by 401
Don't touch my code!: examining the effects of ownership on software quality
Bird, C., Nagappan, N., Murphy, B., Gall, H., & Devanbu, P. (2011) · Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering · doi:10.1145/2025113.2025119 · Cited by 340
Metadata
- Authors
- Fong Boh, W., Slaughter, S. A., & Espinosa, J. A.
- Venue
- Management Science
- Published
- 2007-08
- Volume
- 53
- Issue
- 8
- Pages
- 1315-1331
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W2115918232
- Cited by
- 341
- References
- 58
- FWCI
- 34.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.