How to Solve Problems with Crowds: A Computer‐Based Simulation Model
Abstract
Organizations rely on crowds for a variety of reasons, e.g. in order to evaluate (Amazon), create content (Threadless) but also to solve given problems (InnoCentive and OpenIDEO). Several studies have examined how to organize problem‐solving activities. However, most papers have examined the crowdsourcing process using a partial perspective and a wide‐ranging outlook has been missing. This study uses a computer‐based simulation model and anecdotal case studies of InnoCentive and OpenIDEO, in order to study the underlying drivers of collective problem solving behavior. Results suggest that dynamics between the number of users, number of iterations and different selection mechanisms impact the ability to find an optimal solution to the given problem.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Adaptation in Natural and Artificial Systems
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,340 · see citing works
An Introduction to Genetic Algorithms
Mitchell, M. (1996) · doi:10.7551/mitpress/3927.001.0001 · Cited by 11,340 · see citing works
The Origins of Order: Self-Organization and Selection in Evolution
Kauffman, S. A. (1993) · doi:10.1093/oso/9780195079517.001.0001 · Cited by 7,855 · see citing works
The Search-Transfer Problem: The Role of Weak Ties in Sharing Knowledge across Organization Subunits
Hansen, M. T. (1999) · Administrative Science Quarterly · doi:10.2307/2667032 · Cited by 5,809 · see citing works
Raymond, E. S. (1998) · Knowledge, technology & policy/Knowledge in society/Knowledge, technology, & policy · doi:10.1007/s12130-999-1026-0 · Cited by 3,083 · see citing works
(2006) · doi:10.1093/oso/9780199290727.001.0001 · Cited by 2,688 · see citing works
Mitchell, M. (2009) · doi:10.1093/oso/9780195124415.001.0001 · Cited by 2,310 · see citing works
The difference: how the power of diversity creates better groups, firms, schools, and societies
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1534 · Cited by 2,280 · see citing works
Towards an integrated crowdsourcing definition
Estellés-Arolas, E., & González-Ladrón-de-Guevara, F. (2012) · Journal of Information Science · doi:10.1177/0165551512437638 · Cited by 1,859 · see citing works
Coase's penguin, or, linux and “the nature of the firm”
Benkler, Y. (2002) · The Yale Law Journal · doi:10.2307/1562247 · Cited by 1,572 · see citing works
A knowledge-based theory of the firm—The problem-solving perspective
Nickerson, J. A., & Zenger, T. R. (2004) · Organization Science · doi:10.1287/orsc.1040.0093 · Cited by 1,342 · see citing works
Modeling a Paradigm Shift: From Producer Innovation to User and Open Collaborative Innovation
Baldwin, C. Y., & von Hippel, E. (2010) · Organization Science · doi:10.1287/orsc.1100.0618 · Cited by 1,318 · see citing works
Hertel, G., Niedner, S., & Herrmann, S. (2003) · Research Policy · doi:10.1016/s0048-7333(03)00047-7 · Cited by 1,262 · see citing works
Genetic Algorithms and the Optimal Allocation of Trials
Holland, J. H. (1973) · SIAM Journal on Computing · doi:10.1137/0202009 · Cited by 1,257 · see citing works
Poetz, M. K., & Schreier, M. (2012) · Journal of Product Innovation Management · doi:10.1111/j.1540-5885.2011.00893.x · Cited by 1,241 · see citing works
Crowdsourcing As a Solution to Distant Search
Afuah, A., & Tucci, C. L. (2012) · Academy of Management Review · doi:10.5465/amr.2010.0146 · Cited by 1,212 · see citing works
Marginality and Problem-Solving Effectiveness in Broadcast Search
Jeppesen, L. B., & Lakhani, K. R. (2010) · Organization Science · doi:10.1287/orsc.1090.0491 · Cited by 1,178 · see citing works
Developing Theory Through Simulation Methods
Davis, J., Eisenhardt, K. M., & Bingham, C. B. (2007) · Academy of Management Review · doi:10.5465/amr.2007.24351453 · Cited by 1,168 · see citing works
Jeppesen, L. B., & Frederiksen, L. (2006) · Organization Science · doi:10.1287/orsc.1050.0156 · Cited by 981 · see citing works
Innovation Contests, Open Innovation, and Multiagent Problem Solving
Terwiesch, C., & Xu, Y. (2008) · Management Science · doi:10.1287/mnsc.1080.0884 · Cited by 946 · see citing works
Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community
Bayus, B. L. (2012) · Management Science · doi:10.1287/mnsc.1120.1599 · Cited by 908 · see citing works
Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition
Leimeister, J. M., Huber, M., Bretschneider, U., & Krcmar, H. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222260108 · Cited by 745 · see citing works
AN INTRODUCTION TO RESEARCH METHODS
Bland, M. (2000) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789812813060_0002 · Cited by 722 · see citing works
The Network Structure of Exploration and Exploitation
Lazer, D., & Friedman, A. (2007) · Administrative Science Quarterly · doi:10.2189/asqu.52.4.667 · Cited by 696 · see citing works
Boudreau, K. J. (2012) · Organization Science · doi:10.1287/orsc.1110.0678 · Cited by 676 · see citing works
Algorithm discovery by protein folding game players
Khatib, F., Cooper, S., Tyka, M. D., Xu, K., Makedon, I., Popović, Z., Baker, D. A., & Players, F. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1115898108 · Cited by 583 · see citing works
Are Two Heads Better Than One? Team versus Individual Play in Signaling Games
Cooper, D. J., & Kagel, J. H. (2005) · American Economic Review · doi:10.1257/0002828054201431 · Cited by 487 · see citing works
Auctionin Entry into Tournaments
Fullerton, R. L., & McAfee, R. P. (1999) · Journal of Political Economy · doi:10.1086/250072 · Cited by 479 · see citing works
Goldberg, D. E. (2002) · Genetic algorithms and evolutionary computation · doi:10.1007/978-1-4757-3643-4 · Cited by 472 · see citing works
Optimizing the Stage-Gate Process: What Best-Practice Companies Do—I
Cooper, R. G., Edgett, S. J., & Kleinschmidt, E. J. (2002) · Research-Technology Management · doi:10.1080/08956308.2002.11671518 · Cited by 459 · see citing works
Decisions 2.0: the power of collective intelligence
Bonabeau, E. W. (2009) · Dialnet (Universidad de la Rioja) · Cited by 446 · see citing works
Collaborative learning in networks
Mason, W., & Watts, D. J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1110069108 · Cited by 356 · see citing works
Community‐Based Innovation Contests: Where Competition Meets Cooperation
Bullinger, A. C., Neyer, A., Rass, M., & Moeslein, K. M. (2010) · Creativity and Innovation Management · doi:10.1111/j.1467-8691.2010.00565.x · Cited by 336 · see citing works
A genetic approach to the quadratic assignment problem
Tate, D. M., & Smith, A. E. (1995) · Computers & Operations Research · doi:10.1016/0305-0548(93)e0020-t · Cited by 335 · see citing works
Communitition: The Tension between Competition and Collaboration in Community‐Based Design Contests
Hutter, K., Hautz, J., Füller, J., Mueller, J., & Matzler, K. (2011) · Creativity and Innovation Management · doi:10.1111/j.1467-8691.2011.00589.x · Cited by 305 · see citing works
Innovation Contests: A Review, Classification and Outlook
Adamczyk, S., Bullinger, A. C., & Möslein, K. M. (2012) · Creativity and Innovation Management · doi:10.1111/caim.12003 · Cited by 231 · see citing works
Open to suggestions: How organizations elicit suggestions through proactive and reactive attention
Dahlander, L., & Piezunka, H. (2013) · Research Policy · doi:10.1016/j.respol.2013.06.006 · Cited by 229 · see citing works
Search on Rugged Landscapes: An Experimental Study
Billinger, S., Stieglitz, N., & Schumacher, T. R. (2013) · Organization Science · doi:10.1287/orsc.2013.0829 · Cited by 179 · see citing works
Agent-Based Simulation Models in Organization Science
Fioretti, G., & Lomi, A. (2012) · Organizational Research Methods · doi:10.1177/1094428112470006 · Cited by 163 · see citing works
An Adaptive Process Model to Support Product Development Project Management
Lévárdy, V., & Browning, T. R. (2009) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2009.2033144 · Cited by 149 · see citing works
Prize-based contests can provide solutions to computational biology problems
Lakhani, K. R., Boudreau, K. J., Loh, P., Bäckström, L., Baldwin, C. Y., Lonstein, E., Lydon, M., MacCormack, A., Arnaout, R., & Guinan, E. C. (2013) · Nature Biotechnology · doi:10.1038/nbt.2495 · Cited by 130 · see citing works
Lakhani, K. R., Lifshitz‐Assaf, H., & Tushman, M. L. (2013) · doi:10.4337/9781782548225.00030 · Cited by 89 · see citing works
Crowdsourcing: Leveraging Innovation through Online Idea Competitions
Schweitzer, F. M., Buchinger, W., Gassmann, O., et al. (2012) · Research-Technology Management · doi:10.5437/08956308x5503055 · Cited by 88 · see citing works
Managing Unsolicited Ideas for R&D
Alexy, O. T., Criscuolo, P., & Salter, A. J. (2012) · California Management Review · doi:10.1525/cmr.2012.54.3.116 · Cited by 75 · see citing works
Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business
Schee, B. A. V. (2010) · Human Resource Management International Digest · doi:10.1108/hrmid.2010.04418cae.002 · Cited by 65 · see citing works
Does sustainability change the talent equation
(2009) · Cited by 45 · see citing works
Villarroel, J. A., Taylor, J. E., & Tucci, C. L. (2012) · Computational and Mathematical Organization Theory · doi:10.1007/s10588-012-9137-7 · Cited by 33 · see citing works
Schweitzer, F. M., Buchinger, W., Gassmann, O., et al. (2012) · Research-Technology Management · Cited by 24 · see citing works
Open or Closed Innovation? Problem Solving and Governance ChoicePreprint
Felin, T., & Zenger, T. R. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2156951 · Cited by 15 · see citing works
Sendero: An Extended, Agent-Based Implementation of Kauffman's NKCS Model
Padget, R. V. A. J. (2009) · Journal of Artificial Societies and Social Simulation · Cited by 14 · see citing works
Sendero: An Extended, Agent-Based Implementation of Kauffman's NKCS Model
Padget, J. A., Vidgen, R. T., Mitchell, J., et al. (n.d.) · RePEc: Research Papers in Economics · Cited by 12 · see citing works
Re-thinking Kauffman's NK fitness landscape: From artifact & groupthink to weak-tie effects
McKelvey, B., Li, M., Xu, H., et al. (2013) · Human Systems Management · doi:10.3233/hsm-130782 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Akhmad, M., Chang, S., & Deguchi, H. (2021) · Journal of Computational Social Science · doi:10.1007/s42001-020-00083-8 · Cited by 18 · see citing works
- Authors
- Vuculescu, O., & Bergenholtz, C.
- Affiliations
- Aarhus University (DK)
- Venue
- Creativity and Innovation Management
- Publisher
- Wiley
- Published
- 2014-04
- Volume
- 23
- Issue
- 2
- Pages
- 121-136
- ISSN
- 0963-1690 (ISSN-L)
- 1467-8691
- OpenAlex
- W2111178907
- Cited by
- 22
- References
- 52
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 2 · 2022: 3 · 2021: 1 · 2020: 3 · 2019: 1 · 2018: 4 · 2017: 1 · 2016: 3 · 2015: 2
- FWCI
- 2.98
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Creativity and Innovation Management (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Open Source Software Innovations
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Keywords
- crowdsourcing, collective problem solving, computer simulation model, InnoCentive, selection mechanisms, user participation, optimal solution
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review