The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Opt-in surveys are the most widespread method used to study participation in online communities, but produce biased results in the absence of adjustments for non-response. A 2008 survey conducted by the Wikimedia Foundation and United Nations University at Maastricht is the source of a frequently cited statistic that less than 13% of Wikipedia contributors are female. However, the same study suggested that only 39.9% of Wikipedia readers in the US were female - a finding contradicted by a representative survey of American adults by the Pew Research Center conducted less than two months later. Combining these two datasets through an application and extension of a propensity score estimation technique used to model survey non-response bias, we construct revised estimates, contingent on explicit assumptions, for several of the Wikimedia Foundation and United Nations University at Maastricht claims about Wikipedia editors. We estimate that the proportion of female US adult editors was 27.5% higher than the original study reported (22.7%, versus 17.8%), and that the total proportion of female editors was 26.8% higher (16.1%, versus 12.7%).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Statistical Abstract of the United States
(2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2527 · Cited by 8,785
Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2008) · Cited by 7,000
The Wealth of Networks: How Social Production Transforms Markets and Freedom
Benkler, Y. (2017) · Yale University Press eBooks · doi:10.12987/9780300127232 · Cited by 3,680
National Surveys Via Rdd Telephone Interviewing Versus the Internet
Chang, L., & Krosnick, J. A. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp075 · Cited by 955
THE PARTICIPATION DIVIDE: Content creation and sharing in the digital age1
Hargittai, E., & Walejko, G. (2008) · Information, Communication & Society · doi:10.1080/13691180801946150 · Cited by 806
Highly confident but wrong: Gender differences and similarities in confidence judgments.
Lundeberg, M. A., Fox, P. W., & Punccohar, J. (1994) · Journal of Educational Psychology · doi:10.1037//0022-0663.86.1.114 · Cited by 678
Gender, Internet and computer attitudes and experiences
Schumacher, P., & Morahan-Martin, J. (2001) · Computers in Human Behavior · doi:10.1016/s0747-5632(00)00032-7 · Cited by 592 · cited 1×
“Additionally, there is a extensive history of results in psychology that suggests that there are consistent gender differences in self-confidence – both in general and, especially, in regards to attitudes toward computers [20–22].”
Gender Differences in Self-Efficacy and Attitudes toward Computers
Busch, T. (1995) · Journal of Educational Computing Research · doi:10.2190/h7e1-xmm7-gu9b-3hwr · Cited by 575
Selection Bias in Web Surveys and the Use of Propensity Scores
Schonlau, M., van Soest, A., Kapteyn, A., & Couper, M. (2009) · Sociological Methods & Research · doi:10.1177/0049124108327128 · Cited by 268
Cited by
D'Ignazio, C., & Klein, L. F. (2020) · doi:10.7551/mitpress/11805.001.0001 · Cited by 1,738
Hargittai, E., & Shaw, A. (2015) · Information, Communication & Society · doi:10.1080/1369118x.2014.957711 · Cited by 257
“Recent analyses taking into account sampling bias introduced by the fact that said survey allowed opt-in participation suggest that these estimates likely overstated the extent of the gender gap whereby 16% of editors globally and 23% in the United States are female (Hill & Shaw, 2013).”
BackgroundSelf-citationThe Cambridge Handbook of Language Standardization
(2021) · Cambridge University Press eBooks · doi:10.1017/9781108559249 · Cited by 254
Closing for the Benefit of Openness? The case of Wikimedia’s open strategy process
Dobusch, L., Dobusch, L., & Müller-Seitz, G. (2019) · Organization Studies · doi:10.1177/0170840617736930 · Cited by 215
“…US or EU context and proficient in English; dominance by Wikimedia officials and consultants), this specific conception of openness seemingly did not counteract but rather reinforced participation biases already present in Wikipedia’s community of volunteers (Hill & Shaw, 2013; Suh et al., 2009).”
BackgroundIt's a Man's Wikipedia? Assessing Gender Inequality in an Online Encyclopedia
Wagner, C., Garcia, D., Jadidi, M., & Strohmaier, M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v9i1.14628 · Cited by 197
The Heart Work of Wikipedia: Gendered, Emotional Labor in the World's Largest Online Encyclopedia
Menking, A., & Erickson, I. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702514 · Cited by 107
“Unlike user distribution reports on social media platforms, which trend more toward representative parity or even a greater number of female users [7], surveys of Wikipedia users indicate the overwhelming majority of contributors are male [14].”
BackgroundWays of Knowing When Research Subjects Care
Howard, D., & Irani, L. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300327 · Cited by 70
“The ‘gender gap’ research that emerged after this 2010 study most often approached systemic bias and diversity in two ways, sometimes proposing forms of causality between them [47, 77, 94].”
BackgroundSingh, V. K., Chayko, M., Inamdar, R., & Floegel, D. (2020) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24335 · Cited by 69
“A dearth of female editors on Wikipedia, for example, may lead to less frequent and more stereotypically charged coverage of women across its content (Hill & Shaw, 2013).”
BackgroundWikimedia movement governance: the limits of a-hierarchical organization.
Jemielniak, D. (2016) · Journal of Organizational Change Management · doi:10.1108/jocm-07-2013-0138 · Cited by 51
“This may very well be one of the reasons for the extreme gender gap on Wikipedia (according to different estimates, as little as 16 percent of editors may be females, although the methods of measurement may partly affect the results, see: Lam et al., 2011; Hill and Shaw, 2013), which is common in the free culture move…”
BackgroundThe (in)visible barriers to free software: Inequalities in online communities in Spain
Calvo, D. (2021) · Studies in Communication Sciences · doi:10.24434/j.scoms.2021.01.011 · Cited by 12
Metadata
- Authors
- Hill, B. M., & Shaw, A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-06-26
- Volume
- 8
- Issue
- 6
- Pages
- e65782
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2038012469
- Cited by
- 300
- References
- 16
- FWCI
- 96.86
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.