Optimal incentives for collective intelligence
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Significance: Diversity of information and expertise among group members has been identified as a crucial ingredient of collective intelligence. However, many factors tend to reduce the diversity of groups, such as herding, groupthink, and conformity. We show why the individual incentives in financial and prediction markets and the scientific community reduce diversity of information and how these incentives can be changed to improve the accuracy of collective forecasting. Our results, therefore, suggest ways to improve the poor performance of collective forecasting seen in recent political events and how to change career rewards to make scientific research more successful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An introduction to probability theory and its applications
(1958) · Journal of the Franklin Institute · doi:10.1016/0016-0032(58)90688-4 · Cited by 29,269
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
An Introduction to Probability Theory and its Applications.
Kingman, J. F. C., & Feller, W. (1972) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344620 · Cited by 4,938
Evidence for a Collective Intelligence Factor in the Performance of Human Groups
Woolley, A. W., Chabris, C. F., Pentland, A., Hashmi, N., & Malone, T. W. (2010) · Science · doi:10.1126/science.1193147 · Cited by 2,685
Evolutionary Dynamics: Exploring the Equations of Life
NOWAK, M. A. (2006) · doi:10.2307/j.ctvjghw98 · Cited by 2,438
The difference: how the power of diversity creates better groups, firms, schools, and societies
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1534 · Cited by 2,280
The robust beauty of improper linear models in decision making.
Dawes, R. M. (1979) · American Psychologist · doi:10.1037/0003-066x.34.7.571 · Cited by 1,966
Solving Differential Equations in R: Package deSolve
Soetaert, K., Petzoldt, T., & Setzer, R. W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i09 · Cited by 1,595
An Introduction to Probability Theory and Its Applications, Vol. 1
Feller, W. (1968) · Cited by 1,446
Hofbauer, J., & Sigmund, K. (2003) · Bulletin of the American Mathematical Society · doi:10.1090/s0273-0979-03-00988-1 · Cited by 1,354
GALTON, F. (1907) · Nature · doi:10.1038/075450a0 · Cited by 1,080
How social influence can undermine the wisdom of crowd effect
Lorenz, J., Rauhut, H., Schweitzer, F., & Helbing, D. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1008636108 · Cited by 1,017 · cited 1×
“However, as highlighted by the inability of financial and prediction markets to foresee the results of recent elections in the UK and USA, collective wisdom is not a guaranteed property of a distributed system [2], in part due to herding effects [22, 23].”
BackgroundSelf-citationInverse Modelling, Sensitivity and Monte Carlo Analysis in R Using Package FME
Soetaert, K., & Petzoldt, T. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i03 · Cited by 983
Collective cognition in animal groups
Couzin, I. D. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.10.002 · Cited by 911 · cited 1×
“While most previous research has focused on explaining how the phenomena of collective intelligence emerge [13], less is known about how to optimise collective wisdom in a quantitative sense.”
BackgroundPage, S. (2008) · Princeton University Press eBooks · doi:10.1515/9781400830282 · Cited by 881
Extraordinary popular delusions and the madness of crowds.
Mackay, C. (1932) · Noonday Press eBooks · doi:10.1037/14716-000 · Cited by 763
Lessons from the Netflix prize challenge
Bell, R. M., & Koren, Y. (2007) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1345448.1345465 · Cited by 727 · cited 1×
“In machine-learning, researchers have found that diverse ensembles of models maximise prediction accuracy [16].”
BackgroundUse (and abuse) of expert elicitation in support of decision making for public policy
Morgan, M. G. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319946111 · Cited by 702 · cited 2×
“, the forecasts of prediction markets [17, 18] are now commonly reported alongside opinion polls during elections. Scientists are also turning to crowd-sourcing collective wisdom as a validation tool [19, 20, 21]. However, as highlighted by the inability of nancial and prediction markets to foresee the results of rece…”
BackgroundSaving Human Lives: What Complexity Science and Information Systems can Contribute
Helbing, D., Brockmann, D., Chadefaux, T., Donnay, K., Blanke, U., Woolley-Meza, O., Moussaid, M., Johansson, A., Krause, J., Schutte, S., et al. (2015) · Journal of Statistical Physics · doi:10.1007/s10955-014-1024-9 · Cited by 615 · cited 1×
“V ] ; [ 0 0 ] , [ Sψ,ψ Sψ, V Sψ, V SV , V ]) , [16]”
Self-citationSchuster, P., & Sigmund, K. (1983) · Journal of Theoretical Biology · doi:10.1016/0022-5193(83)90445-9 · Cited by 577
Political diversity will improve social psychological science
Duarte, J. L., Crawford, J. T., Stern, C., Haidt, J., Jussim, L., & Tetlock, P. E. (2015) · Behavioral and Brain Sciences · doi:10.1017/s0140525x14000430 · Cited by 563 · cited 1×
“Rewards for conformity with institutional cultures can severely limit useful diversity as well [26].”
BackgroundA Bayesian Truth Serum for Subjective Data
Prelec, D. (2004) · Science · doi:10.1126/science.1102081 · Cited by 530 · cited 1×
“Previous work [27] has investigated mechanisms to elicit truthful, existing minority views to counter herding effects in expressed opinion.”
BackgroundWhy Current Publication Practices May Distort Science
Young, N. S., Ioannidis, J. P. A., & Al-Ubaydli, O. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050201 · Cited by 502 · cited 1×
“In science as well, the incentive structure undervalues diversity: low-risk projects with assured outcomes are more likely to be funded than highly novel or interdisciplinary work [24, 25].”
BackgroundManifesto of computational social science
Conte, R., Gilbert, N., Bonelli, G., Cioffi-Revilla, C., Deffuant, G., Kertesz, J., Loreto, V., Moat, S., Nadal, J. P., Sanchez, A., et al. (2012) · The European Physical Journal Special Topics · doi:10.1140/epjst/e2012-01697-8 · Cited by 426 · cited 1×
“Future work should investigate how such a reward system could be implemented in practice, to improve career progression, funding and reputation systems [31], prediction markets, and democratic procedures [32].”
BackgroundSelf-citation(2008) · doi:10.1126/science.1157679 · Cited by 406 · cited 1×
“In politics, the forecasts of prediction markets [17, 18] are now commonly reported alongside opinion polls during elections.”
BackgroundSelf-control of traffic lights and vehicle flows in urban road networks
Lämmer, S., & Helbing, D. (2008) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/2008/04/p04019 · Cited by 334
Self-citationIndividual-level personality influences social foraging and collective behaviour in wild birds
Aplin, L. M., Farine, D. R., Mann, R. P., & Sheldon, B. C. (2014) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2014.1016 · Cited by 253
Self-citationTime-Critical Social Mobilization
Pickard, G., Pan, W., Rahwan, I., Cebrian, M., Crane, R., Madan, A., & Pentland, A. (2011) · Science · doi:10.1126/science.1205869 · Cited by 235 · cited 2×
“Attention is therefore shifting towards decentralised systems as a means to bring together the local knowledge and private expertise of many individuals [15, 11].”
BackgroundThe role of diversity in the evolution of cooperation
Santos, F. C., Pinheiro, F. L., Lenaerts, T., & Pacheco, J. M. (2012) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2011.09.003 · Cited by 197
Time to model all life on Earth
Purves, D., Scharlemann, J. P. W., Harfoot, M., Newbold, T., Tittensor, D. P., Hutton, J., & Emmott, S. (2013) · Nature · doi:10.1038/493295a · Cited by 175
Prediction Markets in Theory and PracticePreprint
Wolfers, J. J., & Zitzewitz, E. W. (2006) · SSRN Electronic Journal · doi:10.3386/w12083 · Cited by 152
The robust beauty of improper linear models in decision making.
Dawes, R. M. (1979) · American Psychologist · doi:10.1037//0003-066x.34.7.571 · Cited by 141
Stephan, P. (2012) · Nature · doi:10.1038/484029a · Cited by 126 · cited 1×
“In science as well, the incentive structure undervalues diversity: low-risk projects with assured outcomes are more likely to be funded than highly novel or interdisciplinary work [24, 25].”
BackgroundA crowdsourcing evaluation of the NIH chemical probes
Oprea, T. I., Bologa, C. G., Boyer, S., Curpan, R. F., Glen, R. C., Hopkins, A. L., Lipinski, C. A., Marshall, G. R., Martin, Y. C., Ostopovici-Halip, L., et al. (2009) · Nature Chemical Biology · doi:10.1038/nchembio0709-441 · Cited by 111 · cited 1×
“Scientists are also turning to crowd-sourcing collective wisdom as a validation tool [19, 20, 21].”
BackgroundTapping into the wisdom of the crowd—with confidence
Hertwig, R. (2012) · Science · doi:10.1126/science.1221403 · Cited by 89
A stochastic behavioral model and a ?Microscopic? foundation of evolutionary game theory
Helbing, D. (1996) · Theory and Decision · doi:10.1007/bf00133171 · Cited by 80 · cited 2×
“This leads to the classic replicator equation [28], describing the evolution of the proportion of agents, ρi, that pay attention to factor i (Methods, equation 6) We studied the behaviour of the model under the three incentive schemes described above.”
BackgroundSelf-citationHow Psychological Pitfalls Generated the Global Financial CrisisPreprint
Shefrin, H. (2009) · SSRN Electronic Journal · doi:10.4324/9781315780931-29 · Cited by 76
Opinion Formation and the Collective Dynamics of Risk Perception
Moussaïd, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0084592 · Cited by 66 · cited 1×
“nancial and prediction markets to foresee the results of recent elections in the UK and USA, collective wisdom is not a guaranteed property of a distributed system [2], in part due to herding eects [22, 23]. In science as well, the incentive structure undervalues diversity: low-risk projects with assured outcomes are…”
BackgroundWhere diversity comes from and why it matters?
Page, S. E. (2014) · European Journal of Social Psychology · doi:10.1002/ejsp.2016 · Cited by 66 · cited 1×
“Diversity is a crucial condition for collective intelligence [5, 6, 7, 8, 9] that can be more important than the intelligence of individuals within a group [10].”
BackgroundImproving forecasts using equally weighted predictors
Graefe, A. (2015) · Journal of Business Research · doi:10.1016/j.jbusres.2015.03.038 · Cited by 56 · cited 1×
“The relatively high performance of uniform allocations of attention supports work showing that linear models with equally weighted predictors can match or even improve on more closely fitted prediction models [29, 30].”
BackgroundGroup performance is maximized by hierarchical competence distribution
Zafeiris, A., & Vicsek, T. (2013) · Nature Communications · doi:10.1038/ncomms3484 · Cited by 41 · cited 1×
“j=1 ρjE(Rj) , [6] where ∑n i=1 ρi = 1 by definition.”
Incentives, Information, and Emergent Collective Accuracy
Hong, L., Page, S. E., & Riolo, M. A. (2012) · Managerial and Decision Economics · doi:10.1002/mde.2560 · Cited by 25 · cited 1×
“zi ] ; [ μψ μz ] , [ Kψ,ψ Kψ, z Kψ, z Kz, z ]) [13]”
Why We Need Democracy 2.0 and Capitalism 2.0 to Survive
Helbing, D. (2016) · Springer eBooks · doi:10.1007/978-3-319-90869-4_11 · Cited by 17 · cited 1×
“Future work should investigate how such a reward system could be implemented in practice, to improve career progression, funding and reputation systems [31], prediction markets, and democratic procedures [32].”
BackgroundSelf-citationA Turing test for collective motion
Herbert‐Read, J. E., Romenskyy, M., & Sumpter, D. J. T. (2015) · Biology Letters · doi:10.1098/rsbl.2015.0674 · Cited by 16 · cited 1×
“Scientists are also turning to crowd-sourcing collective wisdom as a validation tool [19, 20, 21].”
BackgroundWhy We Need Democracy 2.0 and Capitalism 2.0 to SurvivePreprint
Helbing, D. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2769633 · Cited by 14
Self-citation
Research works printed but not linked: 1
- [5] Surowiecki, J. The Wisdom of Crowds (Random House LLC, 2005). -
Cited by
3D printing of hydrogels: Rational design strategies and emerging biomedical applications
Li, J., Wu, C., Chu, P. K., & Gelinsky, M. (2020) · Materials Science and Engineering: R: Reports · doi:10.1016/j.mser.2020.100543 · Cited by 862
Minimally Invasive and Regenerative Therapeutics
Ashammakhi, N., Ahadian, S., Darabi, M. A., El Tahchi, M., Lee, J., Suthiwanich, K., Sheikhi, A., Dokmeci, M. R., Oklu, R., & Khademhosseini, A. (2019) · Advanced Materials · doi:10.1002/adma.201804041 · Cited by 190
Regenerative Therapies for Spinal Cord Injury
Ashammakhi, N., Kim, H.-J., Ehsanipour, A., Bierman, R. D., Kaarela, O., Xue, C., Khademhosseini, A., & Seidlits, S. K. (2019) · Tissue Engineering Part B: Reviews · doi:10.1089/ten.teb.2019.0182 · Cited by 162
Scholz, R. W., Bartelsman, E. J., Diefenbach, S., Franke, L., Grunwald, A., Helbing, D., Hill, R., Hilty, L., Höjer, M., Klauser, S., et al. (2018) · Sustainability · doi:10.3390/su10062001 · Cited by 141
“which allow to build virtual groups or well-organized digital heterogeneous communities across the world [65].”
BackgroundSelf-citationDemocracy by Design: Perspectives for Digitally Assisted, Participatory Upgrades of Society
Helbing, D., Mahajan, S., Hänggli, R., Musso, A., Hausladen, C. I., Carissimo, C., Carpentras, D., Stockinger, E., Sánchez–Vaquerizo, J. A., Yang, J. C., et al. (2023) · Journal of Computational Science · doi:10.1016/j.jocs.2023.102061 · Cited by 197
Self-citation
Metadata
- Authors
- Mann, R. P., & Helbing, D.
- Affiliations
- University of Leeds (GB)
- ETH Zurich (CH)
- Corresponding author
- Mann, Richard P.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2017-05
- Volume
- 114
- Issue
- 20
- Pages
- 5077-5082
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC5441831
- OpenAlex
- W2611112066
- Cited by
- 112
- References
- 46
- Citations by year
- 2026: 4 · 2025: 11 · 2024: 12 · 2023: 17 · 2022: 9 · 2021: 15 · 2020: 12 · 2019: 9 · 2018: 18 · 2017: 5
- FWCI
- 10.66
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- EC | European Research Council (324247)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Game Theory and Applications
- Social Sciences › Sociology and Political Science › Evolutionary Game Theory and Cooperation
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
- Keywords
- collective intelligence, group diversity, herding behavior, incentive mechanisms, market incentives, evolutionary game theory, prediction accuracy, social influence
- MeSH terms
- Humans, Models, Theoretical, Emotional Intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.