Cited by 141Open Source Software InnovationsSoftware Engineering Techniques and PracticesSoftware Engineering Research

Who Will Stay in the FLOSS Community? Modeling Participant’s Initial Behavior

Open access
Zhou, Minghui, Mockus, Audris·2015·IEEE Transactions on Software Engineering

Abstract

Motivation: To survive and succeed, FLOSS projects need contributors able to accomplish critical project tasks. However, such tasks require extensive project experience of long term contributors (LTCs). Aim: We measure, understand, and predict how the newcomers' involvement and environment in the issue tracking system (ITS) affect their odds of becoming an LTC. Method: ITS data of Mozilla and Gnome, literature, interviews, and online documents were used to design measures of involvement and environment. A logistic regression model was used to explain and predict contributor's odds of becoming an LTC. We also reproduced the results on new data provided by Mozilla. Results: We constructed nine measures of involvement and environment based on events recorded in an ITS. Macro-climate is the overall project environment while micro-climate is person-specific and varies among the participants. Newcomers who are able to get at least one issue reported in the first month to be fixed, doubled their odds of becoming an LTC. The macro-climate with high project popularity and the micro-climate with low attention from peers reduced the odds. The precision of LTC prediction was 38 times higher than for a random predictor. We were able to reproduce the results with new Mozilla data without losing the significance or predictive power of the previously published model. We encountered unexpected changes in some attributes and suggest ways to make analysis of ITS data more reproducible. Conclusions: The findings suggest the importance of initial behaviors and experiences of new participants and outline empirically-based approaches to help the communities with the recruitment of contributors for long-term participation and to help the participants contribute more effectively. To facilitate the reproduction of the study and of the proposed measures in other contexts, we provide the data we retrieved and the scripts we wrote at https://www.passion-lab.org/projects/developerfluency.html.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tse.2014.2349496

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Contributors rarely assume authority immediately; they progress from peripheral participation to more central involvement through learning, recognition, and sustained interaction.

    “Contributors rarely assume authority immediately. They progress from peripheral participation to more central forms of involvement through a combination of learning, recognition, and sustained interaction [48, 53, 58].”

    From Governance in Practice: How Open Source Projects Define and Document Roles (2026) · cites this paper as [58]

    The Introduction describes newcomers learning project norms and experienced contributors building rapport and taking on more important tasks. Section 4.1 describes learning through interaction with established members and small tasks, while Section 4.2.2 discusses attention from peers. The paper does not establish that contributors generally progress from peripheral participation to central involvement or gain authority through that particular combination of factors. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Contributors' trajectories are shaped not only by technical expertise but also by social and communicative engagement.

    “These trajectories are shaped not only by technical expertise, but also by social and communicative engagement, as contributors' progress depends on their ability to build relationships, exchange feedback, and gain recognition within the community [3, 49, 53, 58].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 38

  1. A. Mockus, R. T. Fielding, and J. Herbsleb, "Two case studies of open source software development: Apache and Mozilla," ACM Trans. Softw. Eng. Methodol., vol. 11, no. 3, pp. 1-38, Jul. 2002.
  2. K. R. Lakhani and E. von Hippel, "How open source software works: Free user-to-user assistance," Res. Policy, vol. 32, no. 6, pp. 923-943, 2003.
  3. E. von Hippel and G. von Krogh, "Open source software and the private-collective innovation model: Issues for organization scien- ce," Org. Sci., vol. 14, no. 2, pp. 209-223, Mar./Apr. 2003.
  4. J. Anvik and G. C. Murphy, "Reducing the effort of bug report tri- age: Recommenders for development-oriented decisions," ACM Trans. Softw. Eng. Methodol., vol. 20, no. 3, pp. 10:1-10:35, Aug. 2011.
  5. J. Xie, M. Zhou, and A. Mockus, "Impact of triage: A study of Mozilla and Gnome," in Proc. ACM/IEEE Int. Symp. Empirical Softw. Eng. Meas., Baltimore, Maryland, USA, Oct. 10-11, 2013, pp. 247-250.
  6. W. Scacchi, "Understanding the requirements for developing open source software systems," IEEE Softw., vol. 149, no. 1, pp. 24-39, Feb. 2002.
  7. C. R. Reis and R. P. de Mattos Fortes, "An overview of the software engineering process and tools in the Mozilla project," in Proc. Open Source Softw. Develop. Workshop, 2002, pp. 155- 175.
  8. M. Zhou and A. Mockus, "Does the initial environment impact the future of developers?" in Proc. 33rd Int. Conf. Softw. Eng., Honolulu, HI, USA, May 21-28, 2011, pp. 271-280.
  9. M. S. Zanetti, I. Scholtes, C. J. Tessone, and F. Schweitzer, "The rise and fall of a central contributor: Dynamics of social organiza- tion and performance in the gentoo community," CoRR, vol. abs/ 1302.7191, 2013.
  10. I. Steinmacher, I. Wiese, A. Chaves, and M. Gerosa, "Why do new- comers abandon open source software projects?" in Proc. 6th Int. Workshop Cooperative Human Aspects Softw. Eng., May 2013, pp. 25- 32.
  11. S. K. Shah, "Motivation, governance, and the viability of hybrid forms in open source software development," Manage. Sci., vol. 52, no. 7, pp. 1000-1014, Jul. 2006.
  12. M. Zhou and A. Mockus, "Developer fluency: Achieving true mastery in software projects," in Proc. 18th ACM SIGSOFT Int. Symp. Found. Softw. Eng., Santa Fe, NM, USA, Nov. 7-11, 2010, pp. 137-146.
  13. M. Blumberg and C. D. Pringle, "The missing opportunity in orga- nizational research: Some implications for a theory of work per- formance," Acad. Manage. Rev., vol. 7, no. 4, pp. pp. 560-569, 1982.
  14. R. H. Rasch and H. L. Tosi, "Factors affecting software developers' performance: An integrated approach," MIS Quart., vol. 16, no. 3, pp. 395-413, Sep. 1992.
  15. G. Hertel, S. Niedner, and S. Herrmann, "Motivation of software developers in open source projects: An internet-based survey of contributors to the Linux kernel," Res. Policy, vol. 32, no. 7, pp. 1159-1177, 2003.
  16. J. A. Roberts, I.-H. Hann, and S. A. Slaughter, "Understanding the motivations, participation, and performance of open source soft- ware developers: A longitudinal study of the apache projects," Manage. Sci., vol. 52, no. 7, pp. 984-999, Jul. 2006.
  17. J. Koh, Y.-G. Kim, B. Butler, and G.-W. Bock, "Encouraging partic- ipation in virtual communities," Commun. ACM, vol. 50, no. 2, pp. 68-73, Feb. 2007.
  18. J. Hahn, J. Y. Moon, and C. Zhang, "Emergence of new project teams from open source software developer networks: Impact of prior collaboration ties," Inf. Syst. Res., vol. 19, no. 3, pp. 369-391, Sep. 2008.
  19. K. J. Stewart and S. Gosain, "The impact of ideology on effective- ness in open source software development teams," MIS Quart., vol. 30, no. 2, pp. pp. 291-314, 2006.
  20. S. Daniel, L. Maruping, M. Cataldo, and J. Herbsleb, "When cultures clash: Participation in open source communities and its implications for organizational commitment," presented at the Int. Conf. Information Systems, Shanghai, China, Dec. 7 2011, p. 7.
  21. W. F. Boh, S. A. Slaughter, and J. A. Espinosa, "Learning from experience in software development: A multilevel analysis," Man- age. Sci., vol. 53, no. 8, pp. 1315-1331, Aug. 2007.
  22. R. E. Kraut and P. Resnick, Building Successful Online Communities: Evidence-Based Social Design. Cambridge, MA, USA: MIT Press, 2012.
  23. N. Ducheneaut, "Socialization in an open source software com- munity: A socio-technical analysis," J. Comput. Supported Collabora- tive Work, vol. 32, pp. 323-368, 2005.
  24. B. J. Hoffman and D. J. Woehr, "A quantitative review of the rela- tionship between personorganization fit and behavioral out- comes," J. Vocational Behav., vol. 68, no. 3, pp. 389-399, 2006.
  25. A. Mockus, "Software support tools and experimental work," in Proc. Int. Workshop Empirical Softw. Eng. Issues: Critical Assessments Future Directions, 2007, pp. 91-99.
  26. J. Xie, Q. Zheng, M. Zhou, and A. Mockus, "Product assignment recommender," in Proc. 36th Int. Conf. Softw. Eng., Hyderabad, India, Jun. 1-6, 2014, pp. 556-559.
  27. D. M. German, "The Gnome project: A case study of open source, global software development," Softw. Process: Improvement Prac- tice, vol. 8, no. 4, pp. 201-215, 2003.
  28. P. A. Wagstrom, "Vertical interaction in open software engineer- ing communities," Ph.D. dissertation, Carnegie Institute of Tech- nology and School of Computer Science, Carnegie Mellon Univ., Pittsburgh, PA, USA, vol. CMU-ISR-09-103, Mar. 2009.
  29. K. Nakakoji, Y. Yamamoto, Y. Nishinaka, K. Kishida, and Y. Ye, "Evolution patterns of open-source software systems and communities," in Proc. Int. Workshop Principles Softw. Evolution, Orlando, FL, USA, May 19-20, 2002, pp. 76-85.
  30. A. L. Kristof-Brown, R. D. Zimmerman, and E. C. Johnson, "Consequences of individuals' fit at work: A meta-analysis of per- son job, person organization, person group, and person supervi- sor fit," Personnel Psychol., vol. 58, no. 2, pp. 281-342, 2005.
  31. M. L. Verquer, T. A. Beehr, and S. H. Wagner, "A meta-analysis of relations between person organization fit and work attitudes," J. Vocational Behav., vol. 63, no. 3, pp. 473-489, 2003.
  32. A. Mockus, "Succession: Measuring transfer of code and devel- oper productivity," in Proc. Int. Conf. Softw. Eng., May 12-22, 2009, pp. 67-77.
  33. B. C. Anda, D. I. Sjøberg, and A. Mockus, "Variability and repro- ducibility in software engineering: A study of four companies that developed the same system," IEEE Trans. Softw. Eng., vol. 35, no. 3, pp. 407-429, May/Jun. 2009.
  34. V. E. Johnson, "Revised standards for statistical evidence," Proc. Nat. Acad. Sci. USA, vol. 110, no. 48, pp. 19313-19317, 2013.
  35. A. Mockus, "Engineering big data solutions," in Proc. Future Softw. Eng., Hyderabad, India, Jun. 1-6, 2014.
  36. D. A. Dillman, J. D. Smyth, and L. M. Christian, Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 3rd ed. New York, NY, USA: Wiley, 2009.
  37. R. Tourangeau, L. J. Rips, and K. Rasinski, The Psychology of Survey Response. Cambridge, U.K.: Cambridge Univ. Press, 2000.
  38. Minghui Zhou received the BS, MS, and PhD degrees in computer science from National Uni- versity of Defense Technology in 1995, 1999, and 2002, respectively. She is an associate pro- fessor in Software Institute, School of Electronics Engineering and Computer Science, Peking Uni- versity. She is interested in digital sociology, i.e., understanding the relationships among people, project culture, and software product through mining the repositories of software projects. She is a member of the ACM.

Cited by

Sorted by citations

Authors
Zhou, M., & Mockus, A.
Affiliations
  • Peking University (CN)
  • University of Tennessee at Knoxville (US)
Venue
IEEE Transactions on Software Engineering
Published
2015-01-01
Volume
41
Issue
1
Pages
82-99
ISSN
  • 0098-5589 (ISSN-L)
  • 1939-3520
OpenAlex
W1989862714
Cited by
141
References
8
Citations by year
2026: 6 · 2025: 13 · 2024: 5 · 2023: 16 · 2022: 12 · 2021: 22 · 2020: 12 · 2019: 12 · 2018: 17 · 2017: 12 · 2016: 11 · 2015: 3
FWCI
12.00
Type
journal article
Language
en
Open access
Locations
IEEE Transactions on Software Engineering (publishedVersion)
Funders
  • National Basic Research Program of China (2015CB352200)
  • National Natural Science Foundation of China (91118004, 61432001)
  • National Hi-Tech Research and Development Program of China (2012AA011202)
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Open Source Software Innovations
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
Keywords
free and open source software, contributor retention, issue tracking systems, contributor onboarding, project popularity, peer attention, Mozilla, gnomes, reproducibility

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review