CoChat

Collective intelligence for deep learning: A survey of recent developments

Open access
Ha, David, Tang, Yujin · 2022 · Collective Intelligence

The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.

Abstract

In the past decade, we have witnessed the rise of deep learning to dominate the field of artificial intelligence. Advances in artificial neural networks alongside corresponding advances in hardware accelerators with large memory capacity, together with the availability of large datasets enabled practitioners to train and deploy sophisticated neural network models that achieve state-of-the-art performance on tasks across several fields spanning computer vision, natural language processing, and reinforcement learning. However, as these neural networks become bigger, more complex, and more widely used, fundamental problems with current deep learning models become more apparent. State-of-the-art deep learning models are known to suffer from issues that range from poor robustness, inability to adapt to novel task settings, to requiring rigid and inflexible configuration assumptions. Collective behavior, commonly observed in nature, tends to produce systems that are robust, adaptable, and have less rigid assumptions about the environment configuration. Collective intelligence, as a field, studies the group intelligence that emerges from the interactions of many individuals. Within this field, ideas such as self-organization, emergent behavior, swarm optimization, and cellular automata were developed to model and explain complex systems. It is therefore natural to see these ideas incorporated into newer deep learning methods. In this review, we will provide a historical context of neural network research’s involvement with complex systems, and highlight several active areas in modern deep learning research that incorporate the principles of collective intelligence to advance its capabilities. We hope this review can serve as a bridge between the complex systems and deep learning communities.

Overview

Integrity signals

Registry

Crossref · 10.1177/26339137221114874

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 70 references

Research works printed but not linked: 31

  1. Baker B, Kanitscheider I, Markov T, et al. (2019) Emergent Tool Use from Multi-Agent Autocurricula. arXiv preprint arXiv:1909 . 07528.
  2. Bansal T, Pachocki J, Sidor S, et al. (2017) Emergent Complexity via Multi-Agent Competition. arXiv preprint arXiv:1710 . 03748.
  3. Bhatia J, 2021, Advances in Neural Information Processing Systems
  4. Brockman G, Cheung V, Pettersson L, et al. (2016) Openai Gym. arXiv preprint arXiv:1606 . 01540.
  5. Chollet F, 2015, Keras
  6. Conway J, 1970, Scientific American, 223, 4
  7. Ha D, 2020, Slime Volleyball Gym Environment
  8. Hill A, 2018, Stable Baselines
  9. Huang W, Mordatch I, Pathak D (2020) One policy to control them all: Shared modular policies for agent-agnostic control. In: International Conference on Machine Learning, pp. 4455–4464.
  10. Jenal M, 2011, What Ants Can Teach Us about the Market
  11. Kirsch L, Schmidhuber J (2020) Meta Learning Backpropagation and Improving it. arXiv preprint arXiv:2012 . 14905.
  12. Lévy P, 1997, Collective Intelligence
  13. Liu S, Lever G, Merel J, et al. (2019) Emergent Coordination through Competition. arXiv preprint arXiv:1902 .07151
  14. Ohsawa S, 2018, Neuron as an Agent
  15. Palm RB, Duque MG, Sudhakaran S, et al. (2022) Variational neural cellular automata. In: International Conference on Learning Representations.
  16. Peng Z, 2021, Advances in Neural Information Processing Systems, 34
  17. Radford A, 2018, Improving Language Understanding by Generative Pre-training
  18. Radford A, 2019, OpenAI blog, 1, 9
  19. Sanchez-Lengeling B, 2021, Distill, 6, e33
  20. Sandler M, Vladymyrov M, Zhmoginov A, et al. (2021) Meta-learning bidirectional update rules. In: International Conference on Machine Learning, pp. 9288–9300.
  21. Schmidhuber J, 2014, Who Invented Backpropagation?
  22. Schmidhuber J, 2020, Metalearning Machines Learn to Learn (1987)
  23. Schoenholz S, 2020, Advances in Neural Information Processing Systems, 33
  24. Seeley TD, 2010, Honeybee Democracy
  25. Suarez J, Du Y, Zhu C, et al. (2021) The neural mmo platform for massively multiagent research. In: Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track.
  26. Surowiecki J, 2005, The Wisdom of Crowds
  27. Tang Y, Ha D (2021) The sensory neuron as a transformer: Permutation-invariant neural networks for reinforcement learning. In: Thirty-Fifth Conference on Neural Information Processing Systems. https://attentionneuron.github.io
  28. Wang T, Liao R, Ba J, et al. (2018) Nervenet: Learning structured policy with graph neural networks. In: International Conference on Learning Representations.
  29. Wikipedia, 2022, Trajan’s Bridge at Alcantara
  30. Wolfram S, 2002, A New Kind of Science
  31. Zhang D, Choi C, Kim J, et al (2021) Learning to generate 3d shapes with generative cellular automata. In: International Conference on Learning Representations.

Cited by

See all 85

Metadata

Authors
Ha, D., & Tang, Y.
Affiliations
Google (United States) (US)
Corresponding author
  • Ha, David
  • Tang, Yujin
Venue
Collective Intelligence
Published
2022-08
Volume
1
Issue
1
ISSN
2633-9137 (ISSN-L)
OpenAlex
W4226229891
Cited by
71
References
67
Citations by year
2026: 5 · 2025: 18 · 2024: 21 · 2023: 14 · 2022: 13
FWCI
5.43
Type
journal article
Language
en
Open access
Locations
  • Collective Intelligence (publishedVersion, cc-by-nc)
  • arXiv (Cornell University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Systems and Dynamics
Keywords
deep learning, complex systems, self-organization, emergent behavior, swarm intelligence optimization, cellular automata, robustness, adaptability, neural network architecture, artificial neural networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Collective intelligence for deep learning: A survey of recent developments. https://app.cochat.ai/papers/10.1177/26339137221114874
The paper
Ha, D., & Tang, Y. (2022). Collective intelligence for deep learning: A survey of recent developments. Collective Intelligence. https://doi.org/10.1177/26339137221114874

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.