The Success and Failure of Quality Improvement Projects in Peer Production Communities
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Peer production communities have been proven to be successful at creating valuable artefacts, with Wikipedia as a prime example. However, a number of studies have shown that work in these communities tends to be of uneven quality and certain content areas receive more attention than others. In this paper, we examine the efficacy of a range of targeted strategies to increase the quality of under-attended content areas in peer production communities. Mining data from five quality improvement projects in the English Wikipedia, the largest peer production community in the world, we show that certain types of strategies (e.g. creating artefacts from scratch) have better quality outcomes than others (e.g. improving existing artefacts), even if both are done by a similar cohort of participants. We discuss the implications of our findings for Wikipedia as well as other peer production communities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324
Rational choice and the structure of the environment.
Simon, H. A. (1956) · Psychological Review · doi:10.1037/h0042769 · Cited by 5,919 · cited 1×
“This could be due to a lack of experience with writing Wikipedia articles, but it could also be due to satisficing [35], they are doing just enough for a reasonable grade but nothing more.”
BackgroundThe class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
(1975) · doi:10.1145/800027.808439 · Cited by 3,227
Social loafing: a meta-analytic review and theoretical integration.
Karau, S. J., & Williams, K. D. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.65.4.681 · Cited by 2,196
SuggestBot: using intelligent task routing to help people find work in wikipedia
Cosley, D., Frankowski, D., Terveen, L., & Riedl, J. (2007) · Proceedings of the 12th international conference on Intelligent user interfaces · doi:10.1145/1216295.1216309 · Cited by 245 · cited 1×
“ITR has also been implemented in an article recommender for Wikipedia called SuggestBot [8]; in this case, three personalised strategies were about four times more successful than a random baseline at eliciting article edits.”
MethodSelf-citationHot Off the Wiki: Structures and Dynamics of Wikipedia’s Coverage of Breaking News Events
Keegan, B., Gergle, D., & Contractor, N. (2013) · American Behavioral Scientist · doi:10.1177/0002764212469367 · Cited by 120
Cited by
Value-Sensitive Algorithm Design: Method, Case Study, and Lessons
Zhu, H., Yu, B., Halfaker, A., & Terveen, L. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274463 · Cited by 220
Self-citationQuarantined! Examining the Effects of a Community-Wide Moderation Intervention on Reddit
Chandrasekharan, E., Jhaver, S., Bruckman, A., & Gilbert, E. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3490499 · Cited by 129
“Several studies have investigated the efficacy of using automated tools to help users make successful contributions on Wikipedia [3, 67, 97, 102].”
BackgroundA Joint Model for Multimodal Document Quality Assessment
Shen, A., Salehi, B., Baldwin, T., & Qi, J. (2019) · 2019 ACM/IEEE Joint Conference on Digital Libraries (JCDL) · doi:10.1109/jcdl.2019.00024 · Cited by 24
“[22, 23] explore the number of headings, images, and references.”
BackgroundMethodInfluential
Metadata
- Authors
- Warncke-Wang, M., Ayukaev, V. R., Hecht, B., & Terveen, L. G.
- Venue
- Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing
- Publisher
- ACM
- Published
- 2015-02-28
- Pages
- 743-756
- OpenAlex
- W1989304522
- Cited by
- 49
- References
- 7
- FWCI
- 15.96
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.