Towards an integrated crowdsourcing definition
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
‘Crowdsourcing’ is a relatively recent concept that encompasses many practices. This diversity leads to the blurring of the limits of crowdsourcing that may be identified virtually with any type of internet-based collaborative activity, such as co-creation or user innovation. Varying definitions of crowdsourcing exist, and therefore some authors present certain specific examples of crowdsourcing as paradigmatic, while others present the same examples as the opposite. In this article, existing definitions of crowdsourcing are analysed to extract common elements and to establish the basic characteristics of any crowdsourcing initiative. Based on these existing definitions, an exhaustive and consistent definition for crowdsourcing is presented and contrasted in 11 cases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maslow, A. H. (1943) · Psychological Review · doi:10.1037/h0054346 · Cited by 21,563
(2017) · Defining and Classifying Children in Need · doi:10.4324/9781315258324-16 · Cited by 11,320
Dahlander, L., & Gann, D. M. (2010) · Research Policy · doi:10.1016/j.respol.2010.01.013 · Cited by 2,435
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Service-Oriented Computing: State of the Art and Research Challenges
Papazoglou, M. P., Traverso, P., Dustdar, S., & Leymann, F. (2007) · Computer · doi:10.1109/mc.2007.400 · Cited by 1,950
Crowdsourcing as a Model for Problem Solving: An Introduction and Cases
Brabham, D. C. (2008) · Convergence: The International Journal of Research into New Media Technologies · doi:10.1177/1354856507084420 · Cited by 1,943
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
(2008) · Cited by 1,657
Crowdsourcing systems on the World-Wide Web
Doan, A., Ramakrishnan, R., & Halevy, A. Y. (2011) · Communications of the ACM · doi:10.1145/1924421.1924442 · Cited by 1,338
Poetz, M. K., & Schreier, M. (2012) · Journal of Product Innovation Management · doi:10.1111/j.1540-5885.2011.00893.x · Cited by 1,244
Developing design propositions through research synthesis
Denyer, D., Tranfield, D., & van Aken, J. E. (2008) · Organization Studies · doi:10.1177/0170840607088020 · Cited by 1,057
Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis
Petitti, D. B. (1999) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195133646.001.0001 · Cited by 925
Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business
(2009) · Journal of Consumer Marketing · doi:10.1108/07363760910965918 · Cited by 882
Crowdsourcing graphical perception: using mechanical turk to assess visualization design
Heer, J., & Bostock, M. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753357 · Cited by 816
Un(der)paid Innovators: The Commercial Utiliza- tion of Consumer Work through Crowdsourcing
Kleemann, F., Voß, G. G., & Rieder, K. (2008) · OPUS (Aalen University) · Cited by 792
Crowdsourcing the Public Participation Process for Planning Projects
Brabham, D. C. (2009) · Planning Theory · doi:10.1177/1473095209104824 · Cited by 673
MOVING THE CROWD AT THREADLESS: Motivations for participation in a crowdsourcing application
Brabham, D. C. (2010) · Information, Communication & Society · doi:10.1080/13691181003624090 · Cited by 560
Interaktive Wertschöpfung kompakt
Piller, F., Möslein, K., Ihl, C., & Reichwald, R. (2017) · Springer eBooks · doi:10.1007/978-3-658-17514-6 · Cited by 465
Heizer, J. H., Render, B., & Munson, C. (1988) · Cited by 387
Business impact of Web 2.0 technologies
Andriole, S. J. (2010) · Communications of the ACM · doi:10.1145/1859204.1859225 · Cited by 343
Crowdsourcing and Its Application in Marketing Activities
Whitla, P. (2009) · Contemporary Management Research · doi:10.7903/cmr.1145 · Cited by 342
Brabham, D. C. (2008) · First Monday · doi:10.5210/fm.v13i6.2159 · Cited by 292
Crowdsourcing and all-pay auctions
DiPalantino, D., & Vojnovic, M. (2009) · Proceedings of the 10th ACM conference on Electronic commerce · doi:10.1145/1566374.1566392 · Cited by 292
Managing the Crowd: Towards a Taxonomy of Crowdsourcing Processes
Geiger, D., Seedorf, S., Schulze, T., Nickerson, R. C., & Schader, M. (2011) · MADOC (University of Mannheim) · Cited by 279
Crowdsourcing, attention and productivity
Huberman, B. A., Romero, D. M., & Wu, F. (2009) · Journal of Information Science · doi:10.1177/0165551509346786 · Cited by 261
The rise of crowdsourcing, Wired
Howe, J. L. (2006) · Medical Entomology and Zoology · Cited by 259
Crowdsourcing: What can be Outsourced to the Crowd, and Why ?
Schenk, É., & Guittard, C. (2009) · Cited by 244
Crowdsourcing and knowledge sharing: strategic user behavior on taskcn
Yang, J., Adamic, L. A., & Ackerman, M. S. (2008) · Proceedings of the 9th ACM conference on Electronic commerce · doi:10.1145/1386790.1386829 · Cited by 190
Reconfiguring the sociology of the crowd: exploring crowdsourcing
Wexler, M. N. (2011) · International Journal of Sociology and Social Policy · doi:10.1108/01443331111104779 · Cited by 189
Towards a Definition of Source-Code Plagiarism
Cosma, G., & Joy, M. (2008) · IEEE Transactions on Education · doi:10.1109/te.2007.906776 · Cited by 146
Decision Analysis and Cost-Effectiveness Analysis
Ryder, H. F., McDonough, C. M., Tosteson, A. N. A., & Lurie, J. D. (2009) · Seminars in Spine Surgery · doi:10.1053/j.semss.2009.08.003 · Cited by 141
Towards a Research Agenda for Enterprise Crowdsourcing
Vuković, M., & Bartolini, C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16558-0_36 · Cited by 108
Web workers unite! addressing challenges of online laborers
Bederson, B. B., & Quinn, A. J. (2011) · CHI '11 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1979742.1979606 · Cited by 106
Crowdsourcing: A Model for Leveraging Online Communities
della Porta, D., & Mattoni, A. (2012) · Routledge eBooks · doi:10.4324/9780203117927-23 · Cited by 104
How to invent a new business model based on crowdsourcing: The crowdspirit ® case
Chanal, V., & Caron-Fasan, M.-L. (2008) · HAL · Cited by 82
Crowdsourcing credibility: The impact of audience feedback on Web page credibility
Giudice, K. D. (2010) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504701099 · Cited by 42
An Empirical Study of Social Capital in Participation in Online Crowdsourcing
Peng, L., & Zhang, M. (2010) · International Conference on E-Product E-Service and E-Entertainment · doi:10.1109/iceee.2010.5660804 · Cited by 26
Liu, E., & Porter, T. (2010) · VINE · doi:10.1108/03055721011071449 · Cited by 17
Cited by
Using Mechanical Turk to Study Clinical Populations
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013) · Clinical Psychological Science · doi:10.1177/2167702612469015 · Cited by 1,139
“For a discussion on the definition of crowdsourcing, see Estellés-Arolas & Ladrün-de-Guevara, 2012.”
Geospatial big data handling theory and methods: A review and research challenges
Li, S., Dragicevic, S., Castro, F. A., Sester, M., Winter, S., Coltekin, A., Pettit, C., Jiang, B., Haworth, J., Stein, A., et al. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.10.012 · Cited by 749
AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images
Albarqouni, S., Baur, C., Achilles, F., Belagiannis, V., Demirci, S., & Navab, N. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528120 · Cited by 606
“C ROWDSOURCING is a type of participative online activity in which an individual, an institution, a non-profit organization or a company proposes to a group of individuals of varying knowledge, heterogeneity, and number, via flexible open call, the voluntary undertaking of a task [1].”
BackgroundModelling with stakeholders – Next generation
Voinov, A., Kolagani, N., McCall, M. K., Glynn, P. D., Kragt, M. E., Ostermann, F. O., Pierce, S. A., & Ramu, P. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2015.11.016 · Cited by 595
A Survey on Mobile Crowdsensing Systems: Challenges, Solutions, and Opportunities
Capponi, A., Fiandrino, C., Kantarci, B., Foschini, L., Kliazovich, D., & Bouvry, P. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2914030 · Cited by 594
Metadata
- Authors
- Estellés-Arolas, E., & González-Ladrón-de-Guevara, F.
- Venue
- Journal of Information Science
- Publisher
- SAGE Publications
- Published
- 2012-03-09
- Volume
- 38
- Issue
- 2
- Pages
- 189-200
- ISSN
- 0165-5515 (ISSN-L)
- 1741-6485
- OpenAlex
- W2171913066
- Cited by
- 1,858
- References
- 38
- FWCI
- 203.99
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.