Women’s Participation in Open Source Software: A Survey of the Literature
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Women are underrepresented in Open Source Software (OSS) projects, as a result of which, not only do women lose career and skill development opportunities, but the projects themselves suffer from a lack of diversity of perspectives. Practitioners and researchers need to understand more about the phenomenon; however, studies about women in open source are spread across multiple fields, including information systems, software engineering, and social science. This article systematically maps, aggregates, and synthesizes the state-of-the-art on women’s participation in OSS. It focuses on women contributors’ representation and demographics, how they contribute, their motivations and challenges, and strategies employed by communities to attract and retain women. We identified 51 articles (published between 2000 and 2021) that investigated women’s participation in OSS. We found evidence in these papers about who are the women who contribute, what motivates them to contribute, what types of contributions they make, challenges they face, and strategies proposed to support their participation. According to these studies, only about 5% of projects were reported to have women as core developers, and women authored less than 5% of pull-requests, but had similar or even higher rates of pull-request acceptances than men. Women make both code and non-code contributions, and their motivations to contribute include learning new skills, altruism, reciprocity, and kinship. Challenges that women face in OSS are mainly social, including lack of peer parity and non-inclusive communication from a toxic culture. We found 10 strategies reported in the literature, which we mapped to the reported challenges. Based on these results, we provide guidelines for future research and practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
Implicit social cognition: Attitudes, self-esteem, and stereotypes
Greenwald, A. G., & Banaji, M. R. (1995) · Psychological Review · doi:10.1037/0033-295x.102.1.4 · Cited by 6,682 · cited 1×
“People’s attitudes, beliefs, and behavior are often shaped by factors that lie outside their awareness [7, 45].”
BackgroundThe support of autonomy and the control of behavior.
Deci, E. L., & Ryan, R. M. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.6.1024 · Cited by 3,242 · cited 1×
“Contributors can also internalize extrinsic motivators (Learning, Own-Use, Reciprocity, and Reputation) as self-regulating behavior, rather than as an external imposition [26, 89].”
BackgroundSystematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239 · cited 1×
“The systematic mapping of the literature is suitable in such circumstances because it maps the available evidence [85, 86], categorizing and aggregating knowledge dispersed across disconnected studies.”
BackgroundGuidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669
Empirical studies of agile software development: A systematic review
Dybå, T., & Dingsøyr, T. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.01.006 · Cited by 2,668 · cited 1×
“The GRADE approach is widely used by secondary studies in software engineering to evaluate the strength of evidence found in the primary studies [1, 2, 30, 47, 48, 96].”
MethodHeilman, M. E. (2001) · Journal of Social Issues · doi:10.1111/0022-4537.00234 · Cited by 2,482 · cited 1×
“Both descriptive (how women are) and prescriptive (how women should be) gender stereotypes and the expectations they produce can compromise a woman’s career progress [53, 54].”
BackgroundLakhani, K. R., & Wolf, R. G. (2003) · doi:10.2139/ssrn.443040 · Cited by 1,531
Lakhani, K. R., & Wolf, R. G. (2005) · Perspectives on Free and Open Source Software · doi:10.7551/mitpress/5326.003.0005 · Cited by 1,530
Hertel, G., Niedner, S., & Herrmann, S. (2003) · Research Policy · doi:10.1016/s0048-7333(03)00047-7 · Cited by 1,262
Systematic literature reviews in software engineering – A tertiary study
Kitchenham, B., Pretorius, R., Budgen, D., Pearl Brereton, O., Turner, M., Niazi, M., & Linkman, S. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.03.006 · Cited by 1,230 · cited 1×
“This section details our method, which is based on established guidelines [61, 86].”
MethodCommunity, joining, and specialization in open source software innovation: a case study
von Krogh, G., Spaeth, S., & Lakhani, K. R. (2003) · Research Policy · doi:10.1016/s0048-7333(03)00050-7 · Cited by 1,025 · cited 1×
“There is attrition of women contributors as they move through the different stages of the “joining script” [115]—where people start outside the project as readers and passive users; then move to the project periphery as bug fixers, bug reporters, peripheral developers, and active developers”
BackgroundRoberts, J. A., Hann, I.-H., & Slaughter, S. A. (2006) · Management Science · doi:10.1287/mnsc.1060.0554 · Cited by 1,024
Carrots and Rainbows: Motivation and Social Practice in Open Source Software Development1
von Krogh, G., Haefliger, S., Spaeth, S., & Wallin, M. W. (2012) · MIS Quarterly · doi:10.2307/41703471 · Cited by 698 · cited 4×
“[114] surveyed the literature and identified ten categories of motivation, grouping them as intrinsic, internalized-extrinsic, and extrinsic.”
BackgroundMethodInfluentialExpectations, outcomes, and challenges of modern code review
Bacchelli, A., & Bird, C. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606617 · Cited by 650 · cited 1×
“A code developer submits the code produced to another person (peer) to evaluate and find possible errors before merging the code to the project codebase [5].”
MethodUnequal Representation and Gender Stereotypes in Image Search Results for Occupations
Kay, M., Matuszek, C., & Munson, S. A. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702520 · Cited by 509 · cited 1×
“Considering that this media exposure can include women’s posts and pictures, this action also helps with the strategy of de-stereotype the OSS contributor, which has been associated with images of men in technical textbooks [66, 68] and search results [58].”
BackgroundMotivation in software engineering: A systematic literature review
Beecham, S., Baddoo, N., Hall, T., Robinson, H., & Sharp, H. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2007.09.004 · Cited by 506
Dasgupta, N., & Stout, J. G. (2014) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732214549471 · Cited by 471 · cited 1×
“Implicit stereotypes about gender and STEM have profound effects on girls’ and women’s interest, confidence, and persistence in STEM education and careers [23, 24].”
BackgroundDasgupta, N. (2011) · Psychological Inquiry · doi:10.1080/1047840x.2011.607313 · Cited by 466
(2013) · doi:10.5555/2486788.2486882 · Cited by 437
Ampatzoglou, A., Bibi, S., Avgeriou, P., Verbeek, M., & Chatzigeorgiou, A. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.10.006 · Cited by 305 · cited 1×
“[3] to identify and categorize threats to validity and corresponding mitigation actions.”
BackgroundGender differences and bias in open source: pull request acceptance of women versus men
Terrell, J., Kofink, A., Middleton, J., Rainear, C., Murphy-Hill, E., Parnin, C., & Stallings, J. (2017) · PeerJ Computer Science · doi:10.7717/peerj-cs.111 · Cited by 287
‘Patches don’t have gender’: What is not open in open source software
Nafus, D. (2012) · New Media & Society · doi:10.1177/1461444811422887 · Cited by 204
Mourão, E., Pimentel, J. F., Murta, L., Kalinowski, M., Mendes, E., & Wohlin, C. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106294 · Cited by 191 · cited 1×
“We used a hybrid strategy [76] to collect primary studies, including database search (IEEE Xplore, Scopus, and ACM Digital Library) [86], snowballing, and contact with the most prolific authors.”
MethodCode of conduct in open source projects
Tourani, P., Adams, B., & Serebrenik, A. (2017) · 2017 IEEE 24th International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2017.7884606 · Cited by 131 · cited 1×
“A gender-diverse team has been shown to increase innovation and productivity in software engineering [81, 107, 113].”
BackgroundGender representation in Japanese EFL textbooks–a corpus study
Lee, J. F. K. (2018) · Gender and Education · doi:10.1080/09540253.2016.1214690 · Cited by 118 · cited 1×
“Considering that this media exposure can include women’s posts and pictures, this action also helps with the strategy of de-stereotype the OSS contributor, which has been associated with images of men in technical textbooks [66, 68] and search results [58].”
BackgroundOpen source barriers to entry, revisited: a sociotechnical perspective
Mendez, C., Padala, H. S., Steine-Hanson, Z., Hilderbrand, C., Horvath, A., Hill, C., Simpson, L., Patil, N., Sarma, A., & Burnett, M. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180241 · Cited by 118 · cited 2×
“Gender biases can represent a “glass floor” and a persistent barrier to entry [72, 83].”
BackgroundSelf-citationModel-based testing for software safety: a systematic mapping study
Gurbuz, H. G., & Tekinerdogan, B. (2018) · Software Quality Journal · doi:10.1007/s11219-017-9386-2 · Cited by 78 · cited 1×
“The GRADE approach is widely used by secondary studies in software engineering to evaluate the strength of evidence found in the primary studies [1, 2, 30, 47, 48, 96].”
MethodThe Signals that Potential Contributors Look for When Choosing Open-source Projects
Qiu, H. S., Li, Y. L., Padala, S., Sarma, A., & Vasilescu, B. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359224 · Cited by 75
Self-citationHidden Figures: Roles and Pathways of Successful OSS Contributors
Trinkenreich, B., Guizani, M., Wiese, I., Sarma, A., & Steinmacher, I. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415251 · Cited by 67
Self-citationPrana, G. A. A., Ford, D., Rastogi, A., Lo, D., Purandare, R., & Nagappan, N. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3092813 · Cited by 66
FLOSS Participants' Perceptions About Gender and Inclusiveness: A Survey
Lee, A., & Carver, J. C. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00077 · Cited by 59
Evolution patterns of open-source software systems and communities
Nakakoji, K., Yamamoto, Y., Nishinaka, Y., Kishida, K., & Ye, Y. (2002) · Proceedings of the international workshop on Principles of software evolution - IWPSE '02 · doi:10.1145/512054.512055 · Cited by 52
Gender Differences in Early Free and Open Source Software Joining Process
Kuechler, V., Gilbertson, C., & Jensen, C. (2012) · IFIP Advances in Information and Communication Technology · doi:10.1007/978-3-642-33442-9_6 · Cited by 41
Open Source Software Community Inclusion Initiatives to Support Women Participation
Singh, V., & Brandon, W. (2019) · IFIP Advances in Information and Communication Technology · doi:10.1007/978-3-030-20883-7_7 · Cited by 29
The (in)visible barriers to free software: Inequalities in online communities in Spain
Calvo, D. (2021) · Studies in Communication Sciences · doi:10.24434/j.scoms.2021.01.011 · Cited by 12
Cited by
Evaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436
“This could increase open-source developers’ incentive to maintain backward compatibility, which could pose challenges given that open-source projects are often under-resourced (Eghbal, 2020; Trinkenreich et al., 2021).”
BackgroundDo I Belong? Modeling Sense of Virtual Community Among Linux Kernel Contributors
Trinkenreich, B., Stol, K.-J., Sarma, A., German, D. M., Gerosa, M. A., & Steinmacher, I. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00038 · Cited by 25
Self-citationParadoxes of Openness: Trans Experiences in Open Source Software
Frluckaj, H., Stevens, N., Howison, J., & Dabbish, L. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687047 · Cited by 5
“Yet both open source—and open collaboration in general—is surprisingly lacking in diversity, with poor representation of non-male and non-white participants [33, 73, 95, 109].”
Background
Metadata
- Authors
- Trinkenreich, B., Wiese, I., Sarma, A., Gerosa, M., & Steinmacher, I.
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 2022-08-22
- Volume
- 31
- Issue
- 4
- Pages
- 1-37
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W3162948197
- Cited by
- 100
- References
- 36
- FWCI
- 16.54
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.