The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Wisdom or Madness? Comparing Crowds with Expert Evaluation in Funding the Arts
Open accessAbstract
In fields as diverse as technology entrepreneurship and the arts, crowds of interested stakeholders are increasingly responsible for deciding which innovations to fund, a privilege that was previously reserved for a few experts, such as venture capitalists and grant-making bodies. Little is known about the degree to which the crowd differs from experts in judging which ideas to fund, and, indeed, whether the crowd is even rational in making funding decisions. Drawing on a panel of national experts and comprehensive data from the largest crowdfunding site, we examine funding decisions for proposed theater projects, a category where expert and crowd preferences might be expected to differ greatly. We instead find significant agreement between the funding decisions of crowds and experts. Where crowds and experts disagree, it is far more likely to be a case where the crowd is willing to fund projects that experts may not. Examining the outcomes of these projects, we find no quantitative or qualitative differences between projects funded by the crowd alone and those that were selected by both the crowd and experts. Our findings suggest that crowdfunding can play an important role in complementing expert decisions, particularly in sectors where the crowds are end users, by allowing projects the option to receive multiple evaluations and thereby lowering the incidence of “false negatives.” This paper was accepted by Lee Fleming, entrepreneurship and innovation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
A Simple Model of Herd Behavior
Banerjee, A. V. (1992) · The Quarterly Journal of Economics · doi:10.2307/2118364 · Cited by 6,556
Lead Users: A Source of Novel Product Concepts
von Hippel, E. (1986) · Management Science · doi:10.1287/mnsc.32.7.791 · Cited by 4,650
The dynamics of crowdfunding: An exploratory study
Mollick, E. (2014) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2013.06.005 · Cited by 4,221
Self-citationThe ripple effect: emotional contagion and its influence on group behavior
Barsade, S. G. (2002) · Administrative Science Quarterly · doi:10.2307/3094912 · Cited by 3,361
The Simple Economics of Basic Scientific Research
Nelson, R. R. (1959) · Journal of Political Economy · doi:10.1086/258177 · Cited by 2,941
Venture Capital and the Professionalization of Start‐Up Firms: Empirical Evidence
Hellmann, T., & Puri, M. (2002) · The Journal of Finance · doi:10.1111/1540-6261.00419 · Cited by 2,425
Changing Highbrow Taste: From Snob to Omnivore
Peterson, R. A., & Kern, R. M. (1996) · American Sociological Review · doi:10.2307/2096460 · Cited by 2,418
Many Hands Make Light the Work: The Causes and Consequences of Social Loafing
Latané, B., Williams, K., & Harkins, S. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.6.822 · Cited by 2,216
The Categorical Imperative: Securities Analysts and the Illegitimacy Discount
Zuckerman, E. W. (1999) · American Journal of Sociology · doi:10.1086/210178 · Cited by 2,143
Assessing the Contribution of Venture Capital to Innovation
Kortum, S., & Lerner, J. (2000) · The RAND Journal of Economics · doi:10.2307/2696354 · Cited by 2,094
Internet encyclopaedias go head to head
Giles, J. (2005) · Nature · doi:10.1038/438900a · Cited by 1,978
The specificity of the scientific field and the social conditions of the progress of reason
Bourdieu, P. (1975) · Social Science Information · doi:10.1177/053901847501400602 · Cited by 1,483 · cited 1×
“Other scholars have shown that the opinions of funding authorities similarly affect the direction of innovation in other critical fields, including scientific research (Bourdieu, 1975; Goldfarb, 2008; Nelson, 1959) and creative industries (Caves, 2000, 2003).”
Baum, J. A. C., & Silverman, B. S. (2004) · Journal of Business Venturing · doi:10.1016/s0883-9026(03)00038-7 · Cited by 1,418
Rational herding in financial economics
Devenow, A., & Welch, I. (1996) · European Economic Review · doi:10.1016/0014-2921(95)00073-9 · Cited by 1,263
Expert political judgment: how good is it? how can we know?
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3634 · Cited by 1,260 · cited 4×
“For example, studies on forecasting have supported the idea that experts are no more accurate than informed amateurs (Tetlock, 2005), while examination of Wikipedia has shown that it compares favorably on many dimensions to expert-created content (Clauson, Polen, Boulos, & Dzenowagis, 2008; Giles,…”
InfluentialPoetz, M. K., & Schreier, M. (2012) · Journal of Product Innovation Management · doi:10.1111/j.1540-5885.2011.00893.x · Cited by 1,244
Crowdsourcing As a Solution to Distant Search
Afuah, A., & Tucci, C. L. (2012) · Academy of Management Review · doi:10.5465/amr.2010.0146 · Cited by 1,234
Does a different view create something new? The effect of employee diversity on innovation
Østergaard, C. R., Timmermans, B., & Kristinsson, K. (2011) · Research Policy · doi:10.1016/j.respol.2010.11.004 · Cited by 1,016
Jeppesen, L. B., & Frederiksen, L. (2006) · Organization Science · doi:10.1287/orsc.1050.0156 · Cited by 999
Mechanisms of Social Cognition
Frith, C. D., & Frith, U. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100449 · Cited by 973
Innovation Contests, Open Innovation, and Multiagent Problem Solving
Terwiesch, C., & Xu, Y. (2008) · Management Science · doi:10.1287/mnsc.1080.0884 · Cited by 923
Earley, P. C. (1989) · Administrative Science Quarterly · doi:10.2307/2393567 · Cited by 900
Wolfers, J., & Zitzewitz, E. (2004) · Journal of Economic Perspectives · doi:10.1257/0895330041371321 · Cited by 889
Film Critics: Influencers or Predictors?
Eliashberg, J., & Shugan, S. M. (1997) · Journal of Marketing · doi:10.1177/002224299706100205 · Cited by 882
Rational Herding in Microloan Markets
Zhang, J., & Liu, P. (2012) · Management Science · doi:10.1287/mnsc.1110.1459 · Cited by 853
Users as Innovators: A Review, Critique, and Future Research Directions
Bogers, M., Afuah, A., & Bastian, B. (2010) · Journal of Management · doi:10.1177/0149206309353944 · Cited by 853
Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis
Boudreau, K. J., Lacetera, N., & Lakhani, K. R. (2011) · Management Science · doi:10.1287/mnsc.1110.1322 · Cited by 830
Agrawal, A., Catalini, C., & Goldfarb, A. (2011) · National Bureau of Economic Research · doi:10.3386/w16820 · Cited by 720
Entrepreneurship as Experimentation
Kerr, W. R., Nanda, R., & Rhodes-Kropf, M. (2014) · Journal of Economic Perspectives · doi:10.1257/jep.28.3.25 · Cited by 704
Self-citationAverages of Forecasts: Some Empirical Results
Makridakis, S., & Winkler, R. L. (1983) · Management Science · doi:10.1287/mnsc.29.9.987 · Cited by 621
Crowdfunding Creative Ideas: The Dynamics of Project Backers in Kickstarter
Kuppuswamy, V., & Bayus, B. L. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2234765 · Cited by 528
Reinstein, D. A., & Snyder, C. M. (2005) · Journal of Industrial Economics · doi:10.1111/j.0022-1821.2005.00244.x · Cited by 513
Crowd science: The organization of scientific research in open collaborative projects
Franzoni, C., & Sauermann, H. (2014) · Research Policy · doi:10.1016/j.respol.2013.07.005 · Cited by 505
Raafat, R. M., Chater, N., & Frith, C. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.08.002 · Cited by 479
Guarding the commons: how community managed software projects protect their work
O’Mahony, S. (2003) · Research Policy · doi:10.1016/s0048-7333(03)00048-9 · Cited by 475
The role of venture capital firms in Silicon Valley's complex innovation network
Ferrary, M., & Granovetter, M. (2009) · Economy and Society · doi:10.1080/03085140902786827 · Cited by 432
Group decision making in hidden profile situations: Dissent as a facilitator for decision quality.
Schulz-Hardt, S., Brodbeck, F. C., Mojzisch, A., Kerschreiter, R., & Frey, D. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.91.6.1080 · Cited by 414
Intuitions about combining opinions: misappreciation of the averaging principle
Larrick, R. P., & Soll, J. B. (2006) · Management Science · doi:10.1287/mnsc.1050.0459 · Cited by 410
Identifying Expertise to Extract the Wisdom of Crowds
Budescu, D. V., & Chen, E. (2015) · Management Science · doi:10.1287/mnsc.2014.1909 · Cited by 360
Recognizing text genres with simple metrics using discriminant analysis
Karlgren, J., & Cutting, D. (1994) · Proceedings of the 15th conference on Computational linguistics - · doi:10.3115/991250.991324 · Cited by 293
Herd Behavior in a Laboratory Financial Market
Cipriani, M., & Guarino, A. (2005) · American Economic Review · doi:10.1257/000282805775014443 · Cited by 232
Scope, Completeness, and Accuracy of Drug Information in Wikipedia
Clauson, K. A., Polen, H. H., Boulos, M. N. K., & Dzenowagis, J. H. (2008) · Annals of Pharmacotherapy · doi:10.1345/aph.1l474 · Cited by 222
Wijnberg, N. M., & Gemser, G. (2000) · Organization Science · doi:10.1287/orsc.11.3.323.12499 · Cited by 222
Awards, Success and Aesthetic Quality in the Arts
Ginsburgh, V. (2003) · Journal of Economic Perspectives · doi:10.1257/089533003765888458 · Cited by 195
Goldfarb, B. D. (2008) · Research Policy · doi:10.1016/j.respol.2007.07.011 · Cited by 182
Guest editors’ introduction to the special issue on technology entrepreneurship
Shane, S., & Venkataraman, S. (2003) · Research Policy · doi:10.1016/s0048-7333(02)00104-x · Cited by 180
Opportunity Spaces in Innovation: Empirical Analysis of Large Samples of Ideas
Kornish, L. J., & Ulrich, K. T. (2011) · Management Science · doi:10.1287/mnsc.1100.1247 · Cited by 177
Critics and Publics: Cultural Mediation in Highbrow and Popular Performing Arts
Shrum, W. (1991) · American Journal of Sociology · doi:10.1086/229782 · Cited by 175
Intuitive Biases in Choice versus Estimation: Implications for the Wisdom of Crowds
Simmons, J. P., Nelson, L. D., Galak, J., & Frederick, S. (2010) · Journal of Consumer Research · doi:10.1086/658070 · Cited by 163
Kriaučiūnas, A., Parmigiani, A., & Rivera-Santos, M. (2011) · Strategic Management Journal · doi:10.1002/smj.921 · Cited by 132
What failure in collective decision-making tells us about metacognition
Bahrami, B., Olsen, K., Bang, D., Roepstorff, A., Rees, G., & Frith, C. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0420 · Cited by 118
Greenstein, S., & Zhu, F. (2012) · American Economic Review · doi:10.1257/aer.102.3.343 · Cited by 118
Balaratnasingam, S., & Janča, A. (2006) · Current Opinion in Psychiatry · doi:10.1097/01.yco.0000214343.59872.7a · Cited by 116
Rajagopalan, M. S., Khanna, V. K., Leiter, Y., Stott, M., Showalter, T. N., Dicker, A. P., & Lawrence, Y. R. (2011) · Journal of Oncology Practice · doi:10.1200/jop.2010.000209 · Cited by 103
How Product Order Affects Market Identity: Repertoire Ordering in the U.S. Opera Market
Kim, B. K., & Jensen, M. C. (2011) · Administrative Science Quarterly · doi:10.1177/0001839211427535 · Cited by 103
Prediction Markets and the Financial "Wisdom of Crowds"
Ray, R. (2006) · Journal of Behavioral Finance · doi:10.1207/s15427579jpfm0701_1 · Cited by 67
Modeling a Presidential Prediction Market
Chen, M. K., Ingersoll, J. E., & Kaplan, E. H. (2008) · Management Science · doi:10.1287/mnsc.1080.0872 · Cited by 33
Boudreau, K. J., Lacetera, N., & Lakhani, K. R. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1531368 · Cited by 20
Cited by
Resolving Information Asymmetry: Signaling, Endorsement, and Crowdfunding Success
Courtney, C., Dutta, S., & Li, Y. (2017) · Entrepreneurship Theory and Practice · doi:10.1111/etap.12267 · Cited by 760
Activist Choice Homophily and the Crowdfunding of Female Founders
Greenberg, J., & Mollick, E. (2017) · Administrative Science Quarterly · doi:10.1177/0001839216678847 · Cited by 528
Self-citationBoudreau, K. J., Guinan, E. C., Lakhani, K. R., & Riedl, C. (2016) · Management Science · doi:10.1287/mnsc.2015.2285 · Cited by 481
Does my contribution to your crowdfunding project matter?
Kuppuswamy, V., & Bayus, B. L. (2017) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2016.10.004 · Cited by 457
Anglin, A. H., Short, J. C., Drover, W., Stevenson, R. M., McKenny, A. F., & Allison, T. H. (2018) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2018.03.003 · Cited by 451
Metadata
- Authors
- Mollick, E., & Nanda, R.
- Venue
- Management Science
- Published
- 2016-06
- Volume
- 62
- Issue
- 6
- Pages
- 1533-1553
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W3121312468
- Cited by
- 515
- References
- 59
- FWCI
- 101.63
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.