LLM2Swarm: Robot Swarms that Responsively Reason, Plan, and Collaborate through LLMs
Open accessAbstract
Robot swarms are composed of many simple robots that communicate and collaborate to fulfill complex tasks. Robot controllers usually need to be specified by experts on a case-by-case basis via programming code. This process is time-consuming, prone to errors, and unable to take into account all situations that may be encountered during deployment. On the other hand, recent Large Language Models (LLMs) have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge. Hence, we propose to address the aforementioned challenges by integrating LLMs with robot swarms and show the potential in proofs of concept (showcases). For this integration, we explore two approaches. The first approach is 'indirect integration,' where LLMs are used to synthesize and validate the robot controllers. This approach may reduce development time and human error before deployment. Moreover, during deployment, it could be used for on-the-fly creation of new robot behaviors. The second approach is 'direct integration,' where each robot locally executes a separate LLM instance during deployment for robot-robot collaboration and human-swarm interaction. These local LLM instances enable each robot to reason, plan, and collaborate using natural language, as demonstrated in our showcases where the robots are able to detect a variety of anomalies, without prior information about the nature of these anomalies. To enable further research on our mainly conceptual contribution, we release the software and videos for our LLM2Swarm system: https://github.com/Pold87/LLM2Swarm.
AI snapshot
Written from the paper’s full text.
TL;DR
LLM2Swarm proposes integrating LLMs into robot swarms via indirect integration (LLM-synthesized/validated controllers) and direct integration (one local LLM per robot for reasoning, planning, and natural-language collaboration). It demonstrates proof-of-concept showcases in ARGoS and preliminary Raspberry Pi 5 tests, but remains mainly conceptual with no systematic performance evaluation.
Key findings
- The paper introduces two integration approaches: indirect integration for controller synthesis/validation before or during deployment, and direct integration where each robot locally executes a separate LLM instance for robot-robot collaboration and human-swarm interaction.
- In the controller synthesis showcase, the LLM synthesized a correct aggregate-then-disperse controller from a random-walk and a targeted-navigation example, with robots aggregating in the arena center and dispersing after 150 timesteps, despite the ARGoS-Python interface lacking an API description.
- In the anomaly detection showcase, the same prompt enabled robots to detect no anomalies, self diagnosis (disabled wheels detected via constant x,y coordinates), peer diagnosis (a faulty robot sensing only weeds), and environmental diagnosis (an injured person), without prior information about the nature of the anomalies.
- In the human-swarm interaction showcase, an Inform prompt produced a concise summary of swarm activities, while an Instruct command translated natural language into executable robot commands and moved robots to a specified target; a preliminary hardware test ran TinyLlama via Ollama on a Raspberry Pi 5 at 10–12 tokens per second.
Methods
- Conceptual/system-design paper with proofs of concept, proposing LLM2Swarm’s indirect and direct integration modules and releasing software and videos.
- Simulation setup: Pi-puck robots in ARGoS version 3.0.0-beta56 on Ubuntu 22.04.4 LTS, Intel Core i7-8550U @ 1.80 GHz, 16 GB RAM, Intel UHD Graphics 620; ARGoS-Python interface v1.0.0; each simulated robot connected to GPT-4o.
- Showcases cover controller synthesis, robot-robot collaboration for anomaly detection across four sub-showcases, and human-swarm interaction via Inform and Instruct prompts; a preliminary hardware test executed TinyLlama via Ollama on a Raspberry Pi 5.
Limitations
- Stated: the contribution is mainly conceptual, and future research is needed to systematically evaluate performance metrics; current LLM video analysis capabilities are limited, with a preliminary test incorrectly concluding random-walk behavior was successful flocking.
- Stated: simulations cannot account for all real-world scenarios; there is no guarantee the swarm will behave as intended due to the probabilistic nature of LLM responses; direct integration currently simulates local execution by connecting each robot to a separate external LLM; hardware limitations, scalability, partitioning, and controllability remain open challenges.
- Evident from the text: the showcases are illustrative and lack quantitative metrics such as anomaly detection accuracy, token counts, or response times beyond the TinyLlama Raspberry Pi 5 test; the hardware test uses only TinyLlama on a Raspberry Pi 5, not the full LLM2Swarm system on real robots.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 20 cited sources checked · 0 supported · 0 flagged
- Findingown data
In a preliminary test, executing TinyLlama via Ollama on a Raspberry Pi 5 with example prompts from the showcase yielded generation speeds between 10 and 12 tokens per second.
“Executing example prompts from our showcase in Subsection 6.2, we obtained generation speeds between 10 and 12 tokens per second, indicating promising performance for robot-to-robot-collaboration and human-swarm interaction.”
Quote in the paperSubstantial claim - Findingown data
In showcases, robots are able to detect a variety of anomalies without prior information about the nature of these anomalies.
“as demonstrated in our showcases where the robots are able to detect a variety of anomalies, without prior information about the nature of these anomalies.”
Quote in the paperSubstantial claim - Findingown data
In the self-diagnosis sub-showcase, after all robots' wheels were disabled, the robots detected their constant x,y coordinates.
“The robots detect their constant x, ycoordinates and correctly suggest that there is an issue with movement or sensor readings.”
Quote in the paperNot a substantial claim - Findingown data
In the peer-diagnosis sub-showcase, the other robots suggested further investigations.
“The other robots detect this fault by comparing sensor readings and suggest further investigations.”
Quote in the paperNot a substantial claim - Findingown data
In the self-diagnosis sub-showcase, the robots correctly suggested that there was an issue with movement or sensor readings.
“The robots detect their constant x, ycoordinates and correctly suggest that there is an issue with movement or sensor readings.”
Quote in the paperNot a substantial claim
- Findingown data
In a preliminary experiment, ChatGPT-4o's video analysis was unsatisfactory, as it incorrectly concluded that a random-walk behavior in an ARGoS simulation demonstrated successful flocking behavior.
“The LLM's analysis was unsatisfactory, as it incorrectly concluded that the behavior was successful flocking behavior.”
Quote in the paperNot a substantial claim - Findingown data
LLM2Swarm is able to identify various anomalies using the same prompt, without prior information about the anomalies.
“An interesting aspect of this showcase is that LLM2Swarm is able to identify various anomalies using the same prompt, without prior information about the anomalies.”
- Also stated in: § 7 Conclusions · plain
“The system was able to successfully diagnose the studied anomalies without prior information about the exact nature of the anomalies.”
Quote in the paperSubstantial claim - Also stated in: § 7 Conclusions · plain
- Findingown data
In the peer-diagnosis sub-showcase, when one robot was simulated to only sense weeds, the other robots detected this fault by comparing sensor readings.
“The other robots detect this fault by comparing sensor readings and suggest further investigations.”
Quote in the paperNot a substantial claim - Findingown data
In the human-swarm interaction showcase, LLM2Swarm understands the human's instruction about deviating from the original task.
“In this showcase, LLM2Swarm (i) correctly and understandably summarizes the current swarm activities and (ii) understands the human's instruction about deviating from the original task.”
Quote in the paperSubstantial claim - Findingown data
In the environmental-diagnosis sub-showcase, when an injured person was simulated as part of the environment, the robots recognized this anomaly.
“The robots recognize this anomaly and ask for immediate human help.”
Quote in the paperSubstantial claim - Findingown data
In the Instruct showcase, LLM2Swarm translates natural language instructions into executable robot commands.
“Using the Instruct command, LLM2Swarm translates the instructions specified in natural language into executable robot commands.”
Quote in the paperSubstantial claim - Findingown data
In the human-swarm interaction showcase, LLM2Swarm correctly and understandably summarizes the current swarm activities.
“In this showcase, LLM2Swarm (i) correctly and understandably summarizes the current swarm activities and (ii) understands the human's instruction about deviating from the original task.”
Quote in the paperSubstantial claim - Findingown data
In LLM2Swarm's controller synthesis showcase, the LLM was able to extrapolate from a few examples and synthesize a correct controller for the aggregate-then-disperse algorithm.
“The LLM is able to extrapolate from these few examples-even though the ARGoS-Python interface is not a widely-used interface and does not feature any API descriptionand synthesize a correct controller.”
Quote in the paperSubstantial claim- Rests on an assumption: The ARGoS-Python interface is not widely used and does not feature any API description.
- Findingnone given
In the no-anomalies sub-showcase, the robots correctly identified that there are more crops than weeds in the environment.
“Over time, they correctly identify that there are more crops than weeds in the environment.”
Quote in the paperNot a substantial claim - Interpretationcitation
LLM verbosity can negatively impact the efficiency of LLM-enabled robot swarms in terms of computational load and communication overhead.
“Additionally, LLMs can favor verbosity over conciseness [36], which can negatively impact the efficiency of LLM-enabled robot swarms in terms of computational load and communication overhead.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The indirect integration approach ensures that robot swarms responsively react, as they execute their classical (synthesized) control software, instead of waiting for LLM-generated responses.
“The approach ensures that robot swarms responsively react, as they execute their classical (synthesized) control software, instead of waiting for LLM-generated responses.”
Quote in the paperSubstantial claim - Interpretationreasoning
A higher number of inter-robot interactions can make the prompt very complex, potentially exceeding token limits or leading to prolonged response times.
“As the results of such inter-robot interactions may be necessary for a prompt, a higher number of them can make the prompt very complex, potentially exceeding token limits or leading to prolonged response times.”
Quote in the paperSubstantial claim - Premisecitation
In general, approaches such as finetuning, quantization, pruning, distillation, and flash attention are able to reduce the storage and memory requirements of LLMs, at the expense of lower accuracy and flexibility.
“In general, these approaches are able to reduce the storage and memory requirements of LLMs, at the expense of lower accuracy and flexibility.”
Quote in the paperNot a substantial claim0 of 6 sources checked- cites [23]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [8]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [29]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [30]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [16]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [31]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
LLMs can favor verbosity over conciseness.
“Additionally, LLMs can favor verbosity over conciseness [36], which can negatively impact the efficiency of LLM-enabled robot swarms in terms of computational load and communication overhead.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [36]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data
Local LLM instances enable each robot to reason, plan, and collaborate using natural language.
“These local LLM instances enable each robot to reason, plan, and collaborate using natural language, as demonstrated in our showcases where the robots are able to detect a variety of anomalies, without prior information about the nature of these anomalies.”
Quote in the paperSubstantial claim- Rests on an assumption: Recent LLMs have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge.
- Premisecitation
Robot controllers usually need to be specified by experts on a case-by-case basis via programming code.
“In robot swarms, communication and interaction protocols between robots usually need to be specified by experts on a case-by-case basis via programming code [28]:”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [28]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Robots in swarms are typically assumed to have limited hardware capacities.
“However, this local execution is difficult, as robots in swarms are typically assumed to have limited hardware capacities, even though recent hardware developments are starting to relax this assumption [25].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [25]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Such LLM-enabled robots can reason, plan, and collaborate thanks to the capabilities of their on-device LLMs.
“As a result, such LLM-enabled robots can reason, plan, and collaborate thanks to the capabilities of their on-device LLMs.”
Quote in the paperSubstantial claim- Rests on an assumption: Recent LLMs have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge.
- Premisecitation
With LLM2Swarm's direct integration module, new attack vectors arise that have already started to be identified in other research areas that integrate LLMs.
“With LLM2Swarm's direct integration module, new attack vectors arise that have already started to be identified in other research areas that integrate LLMs [18].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The human-swarm interaction showcase provides indication that LLM2Swarm facilitates human-swarm interaction, in particular for human operators without programming knowledge.
“This provides indication that LLM2Swarm facilitates humanswarm interaction, in particular for human operators without programming knowledge.”
Quote in the paperSubstantial claim - Study design and conductreasoning
LLM2Swarm's three-step validation procedure for its indirect integration module can potentially enhance the robustness and reliability of the synthesized controllers, ensuring more secure and predictable deployments.
“To partially counteract this problem, we proposed a three-step validation procedure for LLM2Swarm's indirect integration module (see Section 4.1) that can potentially enhance the robustness and reliability of the synthesized controllers, ensuring more secure and predictable deployments.”
Quote in the paperSubstantial claim - Interpretationreasoning
The anomaly-detection showcase provides a first indication that LLM2Swarm has the potential to incorporate commonsense knowledge into robot swarms.
“This provides a first indication for LLM2Swarm's potential of incorporating commonsense knowledge into robot swarms.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 12
- May combine two claims. 8
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenLLM2Swarm enables preliminary security checking through an LLM prompt with the request of identifying malicious parts and other weaknesses in a synthesized controller.
“LLM2Swarm enables preliminary security checking through an LLM prompt with the request of identifying malicious parts and other weaknesses in a synthesized controller.”
Quote in the paperNot a substantial claim- Rests on an assumption: Recent LLMs have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataIn the Inform showcase, a selected robot generates a concise summary of the swarm's current activities and intermediate results.
“When the human uses the Inform prompt, the selected robot provides a human-readable concise version of all interactions.”
- Also stated in: § 7 Conclusions · plain
“In the Inform showcase (left), a selected robot generates a concise summary of the swarm's current activities and intermediate results.”
Quote in the paperNot a substantial claim- Also stated in: § 7 Conclusions · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataIn the environmental-diagnosis sub-showcase, the robots asked for immediate human help.
“The robots recognize this anomaly and ask for immediate human help.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenIn the Instruct showcase, the robots move to the specified target extracted from the human operator's natural language input.
“In the Instruct showcase (right), the robots move to the specified target that they extracted from the natural language input provided by the human operator.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe indirect integration approach may reduce development time and human error before deployment.
“This approach may reduce development time and human error before deployment.”
Quote in the paperNot a substantial claim- Rests on an assumption: Recent LLMs have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe potential exponential increase in token requirements could be reduced by restricting the robots' communication radius, in order to limit the number of messages exchanged with nearby robots.
“The potential exponential increase in token requirements could be reduced by restricting the robots' communication radius, in order to limit the number of messages exchanged with nearby robots.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationExisting attempts to automate controller synthesis usually still require expert knowledge at design time and the controllers cannot react to unforeseen events at deployment time.
“Even though there are attempts to automate this process [15; 17; 40; 39; 14], these attempts usually still require expert knowledge at design time and the controllers cannot react to unforeseen events at deployment time.”
Quote in the paperSubstantial claim0 of 5 sources checked- cites [15]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [17]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [40]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [39]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [14]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationPrior LLM multi-robot works have limitations including low number of robots/agents, lack of decentralization, no consideration of mobile robots with physics-based dynamics, no consideration of typical swarm robotics tasks, or no consideration of hardware limitations; therefore, their applicability to swarm robotics is limited.
“These research efforts, however, have one or more of the following limitations: a low number of robots/agents, lack of decentralization, no consideration of mobile robots with physics-based dynamics, no consideration of typical swarm robotics tasks, or no consideration of hardware limitations; therefore, their applicability to swarm robotics is limited.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [5]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [32]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [44]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S4 (based).
Premisenone givenThe higher the number of robots, the higher the number of potential inter-robot interactions.
“The higher the number of robots, the higher the number of potential inter-robot interactions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenDuring deployment, indirect integration could be used for on-the-fly creation of new robot behaviors.
“Moreover, during deployment, it could be used for on-the-fly creation of new robot behaviors.”
Quote in the paperNot a substantial claim- Rests on an assumption: Recent LLMs have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge.
May combine two claims.
InterpretationreasoningLLM2Swarm enables robots to collaborate using natural language, enabling more sophisticated interactions among robots and between robots and humans than classical controllers.
“Finally, LLM2Swarm enables robots to collaborate using natural language, enabling more sophisticated interactions among robots and between robots and humans than classical controllers.”
Quote in the paperNot a substantial claim- Rests on an assumption: Recent LLMs have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningLocal execution ensures that data remains local, thereby protecting privacy in compliance with regulations like the GDPR.
“Additionally, this ensures that data remains local, thereby protecting privacy in compliance with regulations like the GDPR.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataLLM2Swarm has the potential to facilitate the design of robot swarms, in particular because no programming knowledge is required.
“This demonstrates LLM2Swarm's potential to facilitate the design of robot swarms-in particular as no programming knowledge is required.”
Quote in the paperSubstantial claim- Rests on an assumption: The ARGoS-Python interface is not widely used and does not feature any API description.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenDuring deployment, verification of controller logic is usually not possible, and simulations cannot account for all possible real-world scenarios.
“During deployment, however, such verification is usually not possible-in addition, simulations cannot account for all possible real-world scenarios.”
Quote in the paperNot a substantial claim- Rests on an assumption: There is not always a clear ground truth for validating whether generated code performs the intended task.
- Rests on an assumption: Simulations cannot account for all possible real-world scenarios.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIncreasing the autonomy of robot swarms-that is, reducing the reliance on external control or infrastructure-is a main goal of swarm robotics research.
“Increasing the autonomy of robot swarms-that is, reducing the reliance on external control or infrastructure-is a main goal of swarm robotics research [10; 3].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [3]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
InterpretationreasoningWhen enhancing robot swarms with LLMs, there is no guarantee that the swarm will behave as intended, due to the probabilistic nature of LLM responses.
“When enhancing robot swarms with LLMs, there is no guarantee that the swarm will behave as intended, due to the probabilistic nature of LLM responses.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataIntegrating LLMs into robot swarms enables natural language communication both among robots and with human operators.
“Integrating LLMs into robot swarms enables natural language communication both among robots and with human operators.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningExternal infrastructure might not always be accessible during deployment and could result in communication bottlenecks.
“as external infrastructure might not always be accessible during deployment (e.g., in underwater operations, underground mining, or space exploration) and could result in communication bottlenecks.”
Quote in the paperSubstantial claim
The paper relies on this without support.
The process of writing robot controller code is often time-consuming and prone to errors.
“The process of writing such code is often time-consuming and prone to errors.”
The paper relies on this without support.
Recent LLMs have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge.
“On the other hand, recent Large Language Models (LLMs) have demonstrated reasoning and planning capabilities, introduced new ways to interact with and program machines, and incorporate both domain-specific and commonsense knowledge.”
The paper relies on this without support.
There is not always a clear ground truth for validating whether generated code performs the intended task.
“Validating whether the generated code performs the intended task as expected is crucial but challenging, as there is not always a clear ground truth.”
The paper relies on this without support.
Simulations cannot account for all possible real-world scenarios.
“During deployment, however, such verification is usually not possible-in addition, simulations cannot account for all possible real-world scenarios.”
The paper relies on this without support.
The ARGoS-Python interface is not widely used and does not feature any API description.
“even though the ARGoS-Python interface is not a widely-used interface and does not feature any API description”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Guo et al. citation points to a different author
MinorThe text cites Guo et al. as reference [19], but reference 19 is by Garzón Ramos and Birattari. The Guo et al. entry is numbered 21.
“An overview of the integration of LLMs into multi-agent systems for various tasks has been given by Guo et al. [19].”
“19. D. Garzón Ramos and M. Birattari. Automatically designing robot swarms in environments populated by other robots: An experiment in robot shepherding.”
Zhang et al. citation points to a different author
MinorThe text cites Zhang et al. as reference [44], but reference 44 is by Vemprala et al. The Zhang et al. entry is numbered 47.
“Zhang et al. [44] study how two virtual humans can communicate via LLMs.”
“44. S. Vemprala, R. Bonatti, A. Bucker, and A. Kapoor. ChatGPT for robotics: Design principles and model abilities.”
Cites
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · cited 1× · see citing works
“Scaling down hardware requirements and enabling on-board execution of LLMs on edge devices is a very active area of research; several approaches (e.g., finetuning [23], quantization [8; 29; 30], pruning [16; 31], distillation [22], and flash attention [7]) have been proposed for this.”
BackgroundUniversal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100 · cited 1× · see citing works
“Scaling down hardware requirements and enabling on-board execution of LLMs on edge devices is a very active area of research; several approaches (e.g., finetuning [23], quantization [8; 29; 30], pruning [16; 31], distillation [22], and flash attention [7]) have been proposed for this.”
BackgroundSwarm robotics: a review from the swarm engineering perspective
Brambilla, M., Ferrante, E., Birattari, M., & Dorigo, M. (2013) · Swarm Intelligence · doi:10.1007/s11721-012-0075-2 · Cited by 1,791 · cited 1× · see citing works
“Increasing the autonomy of robot swarms—that is, reducing the reliance on external control or infrastructure—is a main goal of swarm robotics research [10; 3].”
BackgroundSelf-citationFlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Dao, T., Fu, D. Y., Ermon, S., Rudra, A., & Ré, C. (2022) · arXiv · doi:10.48550/arxiv.2205.14135 · Cited by 1,214 · cited 1× · see citing works
“Scaling down hardware requirements and enabling on-board execution of LLMs on edge devices is a very active area of research; several approaches (e.g., finetuning [23], quantization [8; 29; 30], pruning [16; 31], distillation [22], and flash attention [7]) have been proposed for this.”
BackgroundThe grand challenges of <i>Science Robotics</i>
Yang, G.-Z., Bellingham, J., Dupont, P. E., Fischer, P., Floridi, L., Full, R., Jacobstein, N., Kumar, V., McNutt, M., Merrifield, R., et al. (2018) · Science Robotics · doi:10.1126/scirobotics.aar7650 · Cited by 1,177 · cited 1× · see citing works
“These features could make robot swarms ideal for applications where fast reactions to unforeseen events are required, such as environmental monitoring and disaster response [12; 43].”
BackgroundLLM-Pruner: On the Structural Pruning of Large Language ModelsPreprint
Ma, X., Fang, G., & Wang, X. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2305.11627 · Cited by 1,003 · cited 1× · see citing works
“Scaling down hardware requirements and enabling on-board execution of LLMs on edge devices is a very active area of research; several approaches (e.g., finetuning [23], quantization [8; 29; 30], pruning [16; 31], distillation [22], and flash attention [7]) have been proposed for this.”
BackgroundGreshake, K., Abdelnabi, S., Mishra, S., Endres, C., Holz, T., & Fritz, M. (2023) · Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3605764.3623985 · Cited by 667 · cited 2× · see citing works
“LLMs are increasingly being integrated into other systems to enhance their capabilities (e.g., as part of search engines) [18].”
BackgroundSelf-citationChatGPT for Robotics: Design Principles and Model Abilities
Vemprala, S. H., Bonatti, R., Bucker, A., & Kapoor, A. (2024) · IEEE Access · doi:10.1109/access.2024.3387941 · Cited by 570 · cited 2× · see citing works
“Integrating LLMs into other systems has also led to several new applications in robotics [26], for example for task planning [9], centralized motion planning [24], and human-robot interaction [41].”
BackgroundMethodARGoS: a modular, parallel, multi-engine simulator for multi-robot systems
Pinciroli, C., Trianni, V., O’Grady, R., Pini, G., Brutschy, A., Brambilla, M., Mathews, N., Ferrante, E., Di Caro, G., Ducatelle, F., et al. (2012) · Swarm Intelligence · doi:10.1007/s11721-012-0072-5 · Cited by 551 · cited 1× · see citing works
“In our showcases, we simulate Pi-puck robots using the widely-used robot swarm simulator AR-GoS [34] (version 3.0.0-beta56) on a personal computer (OS: Ubuntu 22.04.4 LTS, CPU: Intel Core i7-8550U @ 1.80 GHz, RAM: 16 GB, GPU: Intel UHD Graphics 620).”
MethodInfluentialSelf-citationSwarm Robotics: Past, Present, and Future [Point of View]
Dorigo, M., Theraulaz, G., & Trianni, V. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3072740 · Cited by 401 · cited 1× · see citing works
“These features could make robot swarms ideal for applications where fast reactions to unforeseen events are required, such as environmental monitoring and disaster response [12; 43].”
BackgroundSelf-citationSwarm Robotics: A Formal Approach
Hamann, H. (2018) · doi:10.1007/978-3-319-74528-2 · Cited by 366 · cited 1× · see citing works
“Robot swarms consist of many simple robots that accomplish complex tasks by collaborating with each other [11; 20].”
BackgroundLLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
Dettmers, T., Lewis, M., Belkada, Y., & Zettlemoyer, L. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2198 · Cited by 305 · see citing works
Reflections on the future of swarm robotics
Dorigo, M., Theraulaz, G., & Trianni, V. (2020) · Science Robotics · doi:10.1126/scirobotics.abe4385 · Cited by 282 · cited 1× · see citing works
“Robot swarms consist of many simple robots that accomplish complex tasks by collaborating with each other [11; 20].”
BackgroundSelf-citationAWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration
Lin, J., Tang, J., Tang, H., Yang, S., Xiao, G., & Han, S. (2025) · GetMobile: Mobile Computing and Communications · doi:10.1145/3714983.3714987 · Cited by 274 · cited 1× · see citing works
“Scaling down hardware requirements and enabling on-board execution of LLMs on edge devices is a very active area of research; several approaches (e.g., finetuning [23], quantization [8; 29; 30], pruning [16; 31], distillation [22], and flash attention [7]) have been proposed for this.”
BackgroundRoCo: Dialectic Multi-Robot Collaboration with Large Language Models
Mandi, Z., Jain, S., & Song, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610855 · Cited by 206 · cited 1× · see citing works
“Mandi et al. [32] perform motion planning (of robotic arms) with up to three robots.”
BackgroundAutoMoDe: A novel approach to the automatic design of control software for robot swarms
Francesca, G., Brambilla, M., Brutschy, A., Trianni, V., & Birattari, M. (2014) · Swarm Intelligence · doi:10.1007/s11721-014-0092-4 · Cited by 171 · cited 1× · see citing works
“There are several related works on controller synthesis, both from the field of swarm robotics (e.g., AutoMoDe [15; 17], evolutionary approaches [40], neural network controllers [39]) and from more theoretical fields, such as computer aided verification [14].”
BackgroundLearning Decentralized Controllers for Robot Swarms with Graph Neural NetworksPreprint
Tolstaya, E. I., Gama, F., Paulos, J., Pappas, G. J., Kumar, V., & Ribeiro, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10527 · Cited by 170 · cited 1× · see citing works
“There are several related works on controller synthesis, both from the field of swarm robotics (e.g., AutoMoDe [15; 17], evolutionary approaches [40], neural network controllers [39]) and from more theoretical fields, such as computer aided verification [14].”
BackgroundSafety in numbers: fault-tolerance in robot swarms
Winfield, A., & Nembrini, J. (2006) · International journal of Modeling, identification and control · doi:10.1504/ijmic.2006.008645 · Cited by 158 · cited 1× · see citing works
“Thanks to their decentralized control and redundancy, robot swarms can potentially continue functioning even if individual robots fail [42].”
BackgroundStrobel, V., Castelló Ferrer, E., & Dorigo, M. (2018) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/nlel1871 · Cited by 149 · cited 2× · see citing works
“…for example, be used to store LLM responses or decisions made in different sub-swarms—thus preventing Byzantine robots (robots that show a discrepancy between their intended behavior and their actual behavior, for example, due to broken parts or malicious control [37]) from tampering with the data.”
BackgroundMethodSelf-citationDorigo, M., Birattari, M., & Brambilla, M. (2014) · Scholarpedia · doi:10.4249/scholarpedia.1463 · Cited by 148 · see citing works
Self-citationA survey on integration of large language models with intelligent robots
Kim, Y., Kim, D., Choi, J., Park, J., Oh, N., & Park, D. (2024) · Intelligent Service Robotics · doi:10.1007/s11370-024-00550-5 · Cited by 148 · see citing works
Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiation
Abdelnabi, S., Gomaa, A., Sivaprasad, S., et al. (2023) · Neural Information Processing Systems · doi:10.52202/079017-2658 · Cited by 140 · cited 1×
“In the recent past, there has been an increasing interest in letting multiple LLMs interact and discuss [1; 6].”
BackgroundSelf-citationSparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
Frantar, E., & Alistarh, D. (2023) · arXiv · doi:10.48550/arxiv.2301.00774 · Cited by 131 · cited 1× · see citing works
“Scaling down hardware requirements and enabling on-board execution of LLMs on edge devices is a very active area of research; several approaches (e.g., finetuning [23], quantization [8; 29; 30], pruning [16; 31], distillation [22], and flash attention [7]) have been proposed for this.”
BackgroundScalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?
Chen, Y., Arkin, J., Zhang, Y., Roy, N., & Fan, C. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610676 · Cited by 111 · cited 1× · see citing works
“Chen et al. [5] perform motion planning (e.g., to move a box to a target), with up to 32 simulated robots (in 2D grid environments and using robotic arms).”
BackgroundAnalysing robot swarm behaviour via probabilistic model checking
Konur, S., Dixon, C., & Fisher, M. (2011) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.10.005 · Cited by 98 · cited 1× · see citing works
“Alternatives for evaluating a controller during deployment could be reinforcement learning to compare different controllers [2] or probabilistic model checking based on mathematical analysis [27].”
BackgroundLLM-Pruner: On the Structural Pruning of Large Language Models
Ma, X., Fang, G., & Wang, X. (2023) · neural information processing systems · doi:10.52202/075280-0950 · Cited by 72 · see citing works
Integrating action knowledge and LLMs for task planning and situation handling in open worlds
Ding, Y. F., Zhang, X., Amiri, S., Cao, N., Yang, H., Kaminski, A., Esselink, C., & Zhang, S. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10133-5 · Cited by 71 · cited 1× · see citing works
“Integrating LLMs into other systems has also led to several new applications in robotics [26], for example for task planning [9], centralized motion planning [24], and human-robot interaction [41].”
BackgroundLarge Language Model based Multi-Agents: A Survey of Progress and Challenges
Guo, T., Chen, X., Wang, Y., Chang, R., Pei, S., Chawla, N. V., Wiest, O., & Zhang, X. (2024) · arXiv · doi:10.48550/arxiv.2402.01680 · Cited by 70 · cited 1× · see citing works
“An overview of the integration of LLMs into multi-agent systems for various tasks has been given by Guo et al. [19].”
MethodReinforcement learning for swarm robotics: An overview of applications, algorithms and simulators
Blais, M.-A., & Akhloufi, M. A. (2023) · Cognitive Robotics · doi:10.1016/j.cogr.2023.07.004 · Cited by 67 · cited 1× · see citing works
“Alternatives for evaluating a controller during deployment could be reinforcement learning to compare different controllers [2] or probabilistic model checking based on mathematical analysis [27].”
BackgroundŞahi̇n, E., Girgin, S., Bayındır, L., & Turgut, A. E. (2008) · Natural computing series · doi:10.1007/978-3-540-74089-6_3 · Cited by 61 · cited 1× · see citing works
“Increasing the autonomy of robot swarms—that is, reducing the reliance on external control or infrastructure—is a main goal of swarm robotics research [10; 3].”
BackgroundBuilding Cooperative Embodied Agents Modularly with Large Language Models
Zhang, H., Du, W., Shan, J., Zhou, Q., Du, Y., Tenenbaum, J. B., Shu, T., & Gan, C. (2023) · arXiv · doi:10.48550/arxiv.2307.02485 · Cited by 52 · see citing works
Podevijn, G., O’Grady, R., Mathews, N., Gilles, A., Fantini-Hauwel, C., & Dorigo, M. (2016) · Swarm Intelligence · doi:10.1007/s11721-016-0124-3 · Cited by 49 · see citing works
Self-citationRobot swarms neutralize harmful Byzantine robots using a blockchain-based token economy
Strobel, V., Pacheco, A., & Dorigo, M. (2023) · Science Robotics · doi:10.1126/scirobotics.abm4636 · Cited by 44 · cited 1× · see citing works
“A possibility is to use blockchain technology for obtaining consistent states, as demonstrated in previous research [37; 38; 13].”
MethodSelf-citationTwo invariants of human-swarm interaction
Brown, D. S., Goodrich, M. A., Jung, S.-Y., & Kerman, S. C. (2015) · Journal of Human-Robot Interaction · doi:10.5898/jhri.5.1.brown · Cited by 38 · cited 1× · see citing works
“This could be done with the goal of retrieving information about the collective state of the swarm [4] or of sending commands.”
BackgroundRecent trends in robot learning and evolution for swarm robotics
Kuckling, J. (2023) · Frontiers in Robotics and AI · doi:10.3389/frobt.2023.1134841 · Cited by 33 · cited 1× · see citing works
“In robot swarms, communication and interaction protocols between robots usually need to be specified by experts on a case-by-case basis via programming code [28]: Given a specific task, a human designer”
BackgroundBlockchain technology for mobile multi-robot systems
Dorigo, M., Pacheco, A., Reina, A., & Strobel, V. (2024) · Nature Reviews Electrical Engineering · doi:10.1038/s44287-024-00034-9 · Cited by 25 · cited 2× · see citing works
“However, when increasing autonomy, it is crucial to ensure the controllability of robot swarms, so that they perform their intended tasks while also acting in compliance with rules and regulations [13].”
BackgroundMethodSelf-citationJones, S., Studley, M., Hauert, S., & Winfield, A. F. T. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00011 · Cited by 18 · cited 1× · see citing works
“However, this local execution is difficult, as robots in swarms are typically assumed to have limited hardware capacities, even though recent hardware developments are starting to relax this assumption [25].”
BackgroundSwarm-GPT: Combining Large Language Models with Safe Motion Planning for Robot Choreography DesignPreprint
Jiao, A., Patel, T. P., Khurana, S., Korol, A.-M., Brunke, L., Adajania, V. K., Çulha, U., Zhou, S., & Schoellig, A. P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.01059 · Cited by 17 · cited 1× · see citing works
“Integrating LLMs into other systems has also led to several new applications in robotics [26], for example for task planning [9], centralized motion planning [24], and human-robot interaction [41].”
BackgroundTrianni, V., Tuci, E., Ampatzis, C., et al. (2014) · doi:10.7551/mitpress/8493.003.0008 · Cited by 17 · cited 1×
“There are several related works on controller synthesis, both from the field of swarm robotics (e.g., AutoMoDe [15; 17], evolutionary approaches [40], neural network controllers [39]) and from more theoretical fields, such as computer aided verification [14].”
BackgroundSelf-citationVerbosity Bias in Preference Labeling by Large Language Models
Saito, K., Wachi, A., Wataoka, K., & Akimoto, Y. (2023) · arXiv · doi:10.48550/arxiv.2310.10076 · Cited by 15 · cited 1× · see citing works
“Additionally, LLMs can favor verbosity over conciseness [36], which can negatively impact the efficiency of LLM-6 enabled robot swarms in terms of computational load and communication overhead.”
BackgroundTowards evaluating the impact of swarm robotic control strategy on operators’ cognitive load
Paas, A., Coffey, E. B. J., Beltrame, G., & St-Onge, D. (2022) · IEEE RO-MAN · doi:10.1109/ro-man53752.2022.9900763 · Cited by 11 · cited 1× · see citing works
“How to interact and collaborate as a human with a robot swarm in an effective manner while minimizing the cognitive load is an open research question [33; 35].”
BackgroundCooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive NegotiationPreprint
Abdelnabi, S., Gomaa, A., Sivaprasad, S., Schönherr, L., & Fritz, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.17234 · Cited by 11 · see citing works
Self-citationKIVI : Plug-and-play 2bit KV Cache Quantization with Streaming Asymmetric Quantization
Liu, Z., Yuan, J., Jin, H., Zhong, S., Xu, Z., Braverman, V., Chen, B., & Hu, X. (2023) · Unpublished · doi:10.13140/rg.2.2.28167.37282 · Cited by 6 · cited 1× · see citing works
“Scaling down hardware requirements and enabling on-board execution of LLMs on edge devices is a very active area of research; several approaches (e.g., finetuning [23], quantization [8; 29; 30], pruning [16; 31], distillation [22], and flash attention [7]) have been proposed for this.”
BackgroundInformation Flow Guided Synthesis
Finkbeiner, B., Metzger, N., & Moses, Y. (2022) · International Conference on Computer Aided Verification · doi:10.1007/978-3-031-13188-2_25 · Cited by 5 · cited 1×
“There are several related works on controller synthesis, both from the field of swarm robotics (e.g., AutoMoDe [15; 17], evolutionary approaches [40], neural network controllers [39]) and from more theoretical fields, such as computer aided verification [14].”
BackgroundSimulating Opinion Dynamics with Networks of LLM-based Agents
Chuang, Y.-S., Goyal, A., Harlalka, N., Suresh, S., Hawkins, R., Yang, S., Shah, D., Hu, J., & Rogers, T. T. (2023) · arXiv · Cited by 3 · cited 1× · see citing works
“In the recent past, there has been an increasing interest in letting multiple LLMs interact and discuss [1; 6].”
BackgroundRamos, D. G., & Birattari, M. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611309 · Cited by 3 · cited 1× · see citing works
“There are several related works on controller synthesis, both from the field of swarm robotics (e.g., AutoMoDe [15; 17], evolutionary approaches [40], neural network controllers [39]) and from more theoretical fields, such as computer aided verification [14].”
BackgroundHasselmann, K., Parravicini, A., Pacheco, A., et al. (2024) · Zenodo · doi:10.5281/zenodo.13765570
Flagged first, then by citations
Cited by
Sorted by citations
Raptis, E. K., Kapoutsis, A. C., & Kosmatopoulos, E. B. (2025) · Frontiers in Robotics and AI · doi:10.3389/frobt.2025.1605405 · Cited by 47 · see citing works
Multi-agent systems powered by large language models: applications in swarm intelligence
Jimenez-Romero, C., Yegenoglu, A., & Blum, C. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1593017 · Cited by 30 · see citing works
FLY-LLM Sim: A Novel Integration of UAV and LLM Lab Platform
Guntupalli, K. M., & Raja, A. V. (2025) · IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot65859.2025.11105292 · Cited by 3 · see citing works
ChatHSI: Reliable LLM-Powered Human-Swarm Interaction Framework
Zhang, Y., Bohan, S., Liu, L., Zhang, S., Wang, P., Yu, L., & Xu, D. (2025) · International Symposium on Visual Information Communication and Interaction (VINCI) · doi:10.1145/3769534.3769608 · Cited by 1 · see citing works
“Recent work applies LLMs to swarm interaction: Strobel et al. generate low-level controllers with LLMs [27], Pueyo et al. use vision–language models for formation generation [21], and Vem-prala et al. employ ChatGPT for high-level commands [29].”
- Authors
- Strobel, V., Dorigo, M., & Fritz, M.
- Affiliations
- Université Libre de Bruxelles (BE)
- Helmholtz Center for Information Security (DE)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2410.11387
- OpenAlex
- W4403576716
- Semantic Scholar
- ab8673c9cdc962aa9bc8e205873b03194a5ea66b
- Cited by
- 4
- References
- 45
- Citations by year
- 2025: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) (submittedVersion, other-oa)
- arXiv (Cornell University) (cc-by)
- Funders
- European Commission (101070617)
- Bundesministerium für Bildung und Forschung (16KIS2012)
- Fonds De La Recherche Scientifique - FNRS
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Modular Robots and Swarm Intelligence
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Control Multi-Agent Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Robotics and Automated Systems
- Keywords
- swarm robotics, large language models, robot controller, controller synthesis, human-swarm interaction, anomaly detection, natural language programming
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
