Decision Making in Multiagent Systems: A Survey
The DOI matches its Crossref record; 263 of the 275 references it cites were found in a registry or an index.
Abstract
Intelligent transport systems, efficient electric grids, and sensor networks for data collection and analysis are some examples of the multiagent systems (MAS) that cooperate to achieve common goals. Decision making is an integral part of intelligent agents and MAS that will allow such systems to accomplish increasingly complex tasks. In this survey, we investigate state-of-the-art work within the past five years on cooperative MAS decision making models, including Markov decision processes, game theory, swarm intelligence, and graph theoretic models. We survey algorithms that result in optimal and suboptimal policies such as reinforcement learning, dynamic programming, evolutionary computing, and neural networks. We also discuss the application of these models to robotics, wireless sensor networks, cognitive radio networks, intelligent transport systems, and smart electric grids. In addition, we define key terms in the area and discuss remaining challenges that include incorporating big data advancements to decision making, developing autonomous, scalable and computationally efficient algorithms, tackling more complex tasks, and developing standardized evaluation metrics. While recent surveys have been published on this topic, we present a broader discussion of related models and applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The objective is to maximize the system's overall reward, while agents work together to accomplish a common task [54].”
From Leveraging 3GPP Features and Optimization Techniques for 5G NR-V2X Resource Allocation: A Survey (2025) · cites this paper as [54]
Citations
Cites
Kennedy, J., & Eberhart, R. (2002) · Proceedings of ICNN'95 - International Conference on Neural Networks · doi:10.1109/icnn.1995.488968 · Cited by 58,192
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Particle swarm optimization: An overview
Poli, R., Kennedy, J., & Blackwell, T. (2007) · Swarm Intelligence · doi:10.1007/s11721-007-0002-0 · Cited by 21,101
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Consensus and Cooperation in Networked Multi-Agent Systems
Olfati-Saber, R., Fax, J. A., & Murray, R. M. (2007) · Proceedings of the IEEE · doi:10.1109/jproc.2006.887293 · Cited by 10,522 · cited 1×
“Graphical models for consensus [157], formation [158], [159], and rendezvous [158] have also been investigated.”
BackgroundEquilibrium points in n -person games
Nash, J. F. (1950) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.36.1.48 · Cited by 7,560 · cited 1×
“For example, stochastic games with a finite number of players, actions and states always have a Nash equilibrium, defined as the strategy profile which maximizes each player’s utility knowing the strategy of others in the game [111].”
BackgroundAsynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · cited 1×
“approximate methods are adopted and include model-free RL approaches like Q-learning [54] and SARSA [55], evolutionary computing [56], [57], RNN [58]–[63], and deep RL [64], [65].”
MethodSwarm Intelligence: From Natural to Artificial Systems
Bonabeau, E., Dorigo, M., & Theraulaz, G. (1999) · Oxford University Press eBooks · doi:10.1093/oso/9780195131581.001.0001 · Cited by 6,435
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
SMITH, J. M., & PRICE, G. R. (1973) · Nature · doi:10.1038/246015a0 · Cited by 5,089 · cited 1×
“Evolutionary stable strategy is a refinement of the Nash equilibrium which requires a strategy to be stable to any perturbations that may occur to the games as they evolve [112] and was extended to stochastic games [113].”
Background
Research works printed but not linked: 11
- 2015, First Workshop on Cognitive Architectures
- altman, 1999, Constrained Markov Decision Processes, 7
- amato, 2013, Scalable Bayesian reinforcement learning for multiagent POMDPs, Multidisciplinary Conf on Reinforcement Learning and Decision Making, 188
- sandhu, 2004, Wireless sensor networks for commercial lighting control: Decision making with multi-agent systems, Proc of the AAAI-04 Workshop on Sensor Networks, 10, 131
- strikos, 2007, A Full Approach for Intrusion Detection in Wireless Sensor Networks
- melo, 2012, Decentralized multiagent planning for balance control in smart grids, Proc 1st Int Workshop Inf Technol Energy Appl, 923, 21
- 2016, An Internet of Things That Will Number Ten Billions
- 2015, Gartner Says 6 4 Billion Connected “Things” Will Be in Use in 2016 Up 30 Percent From 2015
- lauri, 2013, Managing power flows in microgrids using multi-agent reinforcement learning, Proc Agent Technol Energy Syst, 1
- emery, 2005, Game Theoretic Control for Robot Teams
- teodorovi?, 2005, Bee colony optimization—A cooperative learning approach to complex transportation problems, Proc 16th Mini Eur Conf 10th Meeting Adv OR AI Methods Transport (EWGT), 51
Cited by
Blockchain for AI: review and open research challenges
Salah, K., Rehman, M. H. U., Nizamuddin, N., & Al-Fuqaha, A. (2019) · IEEE Access · doi:10.1109/access.2018.2890507 · Cited by 1,001
“ing inter-layer and intralayer operability across entire systems [50].”
BackgroundCooperative Heterogeneous Multi-Robot Systems: A Survey
Rizk, Y., Awad, M., & Tunstel, E. W. (2020) · ACM Computing Surveys · doi:10.1145/3303848 · Cited by 449
Self-citationAgbehadji, I. E., Awuzie, B. O., Ngowi, A. B., & Millham, R. C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17155330 · Cited by 248
Baccour, E., Mhaisen, N., Abdellatif, A. A., Erbad, A., Mohamed, A., Hamdi, M., & Guizani, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3200740 · Cited by 186
“Other papers surveyed the single agent and multi-agents RL, such as [75], [76], [77], [78], [79].”
BackgroundTheoretical approaches to AI in supply chain optimization: Pathways to efficiency and resilience
Abaku, E. A., Edunjobi, T. E., & Odimarha, A. C. (2024) · International Journal of Science and Technology Research Archive · doi:10.53771/ijstra.2024.6.1.0033 · Cited by 188
“Multi-agent systems (MAS) represent another approach to decentralized decision-making and coordination, where autonomous agents interact with each other and their environment to achieve individual and collective objectives (Rizk et al ., 2018).”
BackgroundHuman-machine Collaborative Decision-making: An Evolutionary Roadmap Based on Cognitive Intelligence
Ren, M., Chen, N., & Qiu, H. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01020-1 · Cited by 178
Systematic Review on AI-Blockchain Based E-Healthcare Records Management Systems
Haddad, A., Habaebi, M. H., Islam, M. R., Hasbullah, N. F., & Zabidi, S. A. (2022) · IEEE Access · doi:10.1109/access.2022.3201878 · Cited by 187
A Review of Recent Advances in Coordination Between Unmanned Aerial and Ground Vehicles
Ding, Y., Xin, B., & Chen, J. (2020) · Unmanned Systems · doi:10.1142/s2301385021500084 · Cited by 132
Li, Z., Shi, L., Yue, C., Shang, Z., & Qu, B. (2019) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2019.06.010 · Cited by 131
Artificial intelligence and blockchain: A review
Hussain, A. A., & Al-Turjman, F. M. (2021) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4268 · Cited by 164
Zhou, W., Li, J., Zhihong, L. I. U., & Shen, L. (2021) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2021.09.008 · Cited by 135
Leveraging Communicating UAVs for Emergency Vehicle Guidance in Urban Areas
Oubbati, O. S., Lakas, A., Lorenz, P., Atiquzzaman, M., & Jamalipour, A. (2019) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2019.2930124 · Cited by 127
“To overcome this limitation, there are multi-agent cooperative searching, acquisition, and tracking techniques that can be adopted [18].”
BackgroundIntelligent Cognitive Radio in 5G: AI-Based Hierarchical Cognitive Cellular Networks
Wang, D., Song, B., Dong, C., & Du, X. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2019.1800353 · Cited by 111
“Since numerous realistic communication scenarios are partially observable systems and multi-agent systems (MASs) [9], research on AI technologies in multi-agent environments and distributed networks has become more and more popular in recent years.”
BackgroundShen, G., Lei, L., Zhang, X., Li, Z., Cai, S., & Zhang, L. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3245120 · Cited by 124
“The control method of the MAS can be based on dynamic planning, artificial potential field, gradient optimization, RL, etc [33].”
MethodSandino, J., Vanegas, F., Maire, F., Caccetta, P. A., Sanderson, C., & Gonzalez, F. (2020) · Remote Sensing · doi:10.3390/rs12203386 · Cited by 106
“Applied theory on decision making addresses not only autonomous UAV navigation problems but it is also used in fields such as game theory, navigation strategies, Bayesian principles, multi-objective decision-making, Markov Decision Processes (MDP) and Partially Observable MDPs (POMDP) [21–23].”
MethodOptimal Evading Strategies and Task Allocation in Multi-player Pursuit–Evasion Problems
Makkapati, V. R., & Tsiotras, P. (2019) · Dynamic Games and Applications · doi:10.1007/s13235-019-00319-x · Cited by 101
Multi-target tracking for unmanned aerial vehicle swarms using deep reinforcement learning
Zhou, W., Liu, Z., Li, J., Xu, X., & Shen, L. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.09.044 · Cited by 86
Multi-robot exploration using Dynamic Fuzzy Cognitive Maps and Ant Colony Optimization
Mendonça, M., Palácios, R. H. C., Papageorgiou, E. I., & de Souza, L. B. (2020) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz48607.2020.9177814 · Cited by 87
“Examples of swarms in the wild can be seen in a flight of birds or in a shoal [11], [12].”
BackgroundMulti-Agent Systems: A Survey About Its Components, Framework and Workflow
Maldonado, D., Cruz, E., Torres, J. A., Cruz, P. J., & Gamboa, S. (2024) · IEEE Access · doi:10.1109/access.2024.3409051 · Cited by 138
“Systems such as those described above are identified as Multi-agent Systems (MAS), which are generally defined as a set of elements, called agents, interacting with each other to achieve a common purpose [5], [6], [7], [8], [9].”
BackgroundInfluentialAbdellatif, A. A., Mhaisen, N., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3288050 · Cited by 89
“Restrictions apply. such as autonomous IoT-based systems, communications and networking, 6G networks, IoT Security, and autonomous driving [13], [14], [15], [16], [17], [18], [19], [20].”
BackgroundResearch trends, themes, and insights on artificial neural networks for smart cities towards SDG-11
Jain, A., Gue, I. H. V., & Jain, P. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.137300 · Cited by 65
Artificial Intelligence for Metaverse: A Framework
Guo, Y., Yu, T., Wu, J., Wang, Y., Wan, S., Zheng, J., Fang, L., & Dai, Q. (2022) · CAAI Artificial Intelligence Research · doi:10.26599/air.2022.9150004 · Cited by 75
Intrusion response systems for cyber-physical systems: A comprehensive survey
Bashendy, M., Tantawy, A., & Erradi, A. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102984 · Cited by 71
A multi-agent system approach to exploit demand-side flexibility in an energy community
Reis, I. F. G., Gonçalves, I., Lopes, M. A. R., & Antunes, C. H. (2020) · Utilities Policy · doi:10.1016/j.jup.2020.101114 · Cited by 63
Xie, X. P., Wei, T., & Li, X. (2021) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2021.3119065 · Cited by 60
Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning
Wang, X., Zhao, C., Huang, T., Chakrabarti, P., & Kurths, J. (2023) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2023.3239654 · Cited by 49
“As a result, reinforcement learning shares better performance in cooperative behavior acquisition and in performing complex tasks, and some expected outcomes along this line are springing up [10], [11], [12], [13].”
BackgroundOcclusion-Based Coordination Protocol Design for Autonomous Robotic Shepherding Tasks
Hu, J., Turgut, A. E., Krajník, T., Lennox, B., & Arvin, F. (2020) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3018549 · Cited by 48
Zhang, X., Cheng, Z., Ma, J., Huang, S., Lewis, F. L., & Lee, T. H. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3094215 · Cited by 54
Synergistic effects of adaptive reward and reinforcement learning rules on cooperation
Wang, L., Fan, L., Zhang, L., Zou, R., & Wang, Z. (2023) · New Journal of Physics · doi:10.1088/1367-2630/acd26e · Cited by 40
“Over the past few years, the emergence of cooperative behaviors in multi-agent systems has been a prominent research topic [3–5].”
BackgroundTask Planning and Collaboration of Jellyfish-inspired Multiple Spherical Underwater Robots
An, R., Guo, S., Yu, Y., Li, C., & Awa, T. (2022) · Journal of Bionic Engineering · doi:10.1007/s42235-022-00164-6 · Cited by 38
Qasem, M. H., Aljaidi, M., Samara, G., Alazaidah, R., Alsarhan, A., & Alshammari, M. (2023) · Sustainability · doi:10.3390/su151410977 · Cited by 37
Pu, Z., Zhang, T., Ai, X., Qiu, T., & Yi, J. (2023) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2023.3241337 · Cited by 34
“T HE MULTIAGENT system (MAS) features great scalability, flexibility, adaption, and robustness in complicated tasks, thus providing a promising solution for numerous fundamental problems and practical applications [1], [2], [3], [4].”
BackgroundToward Autonomous UAV Swarm Navigation: A Review of Trajectory Design Paradigms
Arshid, K., Krayani, A., Marcenaro, L., Martín, D., & Regazzoni, C. S. (2025) · Sensors · doi:10.3390/s25185877 · Cited by 43
“The accuracy of these decisions is critical for mission success, collision avoidance, efficient energy use, and overall system stability [153,154].”
Bokhari, S. A. A., & Myeong, S. (2023) · IEEE Access · doi:10.1109/access.2023.3327174 · Cited by 42
“Cities function in a dynamic environment, and although decisions impact stakeholders directly or indirectly [33], [34], [35], smart decision-making is a challenging and dynamic process [36], [37], [38], [39].”
BackgroundA Survey of Adaptive Multi-Agent Networks and Their Applications in Smart Cities
Nezamoddini, N., & Gholami, A. (2022) · Smart Cities · doi:10.3390/smartcities5010019 · Cited by 52
“Markov games or stochastic games are examples of the initial applications of sequential multi-agent games that can be solved using dynamic programming (DP), Q-learning, or linear programming techniques [45].”
BackgroundMethodA Multiagent Meta-Based Task Offloading Strategy for Mobile-Edge Computing
Ding, W., Luo, F., Gu, C., Dai, Z., & Lu, H. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3246107 · Cited by 29
“To further verify the effect of different environments on each strategy, the value range of the transmission rate was set to [6 , 10] with a step size of 0.5.”
BackgroundMethodInfluentialDistributed Reptile Algorithm for Meta-Learning Over Multi-Agent Systems
Zhang, X., Hu, C., He, B., & Han, Z. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3222734 · Cited by 37
“Anotheristheinnerstep,i.e., base-learner,whichsolvesaspecifictask,suchasaconventional machinelearningproblem[23].”
Artificial Collective Intelligence Engineering: A Survey of Concepts and Perspectives
Casadei, R. (2023) · Artificial Life · doi:10.1162/artl_a_00408 · Cited by 39
“Rizk et al. (2018) provide a survey of decision making in MASs.”
BackgroundReinforcement Learning for Intelligent Healthcare Systems: A Comprehensive SurveyPreprint
Abdellatif, A. A., Mhaisen, N., Chkirbene, Z., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04087 · Cited by 44
Route Selection Decision-Making in an Intermodal Transport Network Using Game Theory
Bukvić, L., Škrinjar, J. P., Abramović, B., & Zitrický, V. (2021) · Sustainability · doi:10.3390/su13084443 · Cited by 26
“[12] main focus was on the decision-making process.”
BackgroundAn Effective Data‐Collection Scheme with AUV Path Planning in Underwater Wireless Sensor Networks
Khan, W., Wang, H., Anwar, M. S., Alharbi, A., Imran, M. A., & Khan, J. A. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/8154573 · Cited by 25
“MDP is a statistical optimization framework for making a decision in unpredictable situations [34, 51, 52].”
BackgroundRao, K. P., & Manvi, S. S. (2022) · Acta Informatica Pragensia · doi:10.18267/j.aip.194 · Cited by 32
“To empower partially or completely autonomic operations using several intelligent computer programs is one of the key objectives of AI application (Rizk et al., 2018).”
MethodSoni, S., & Shrivastava, M. (2019) · SN Applied Sciences · doi:10.1007/s42452-019-1091-2 · Cited by 24
“The framework of RL is MDP which contains states, actions, reward function and policy which helped us to calculate routing data path to perform mobile wireless charging in WRSNs [24, 25].”
BackgroundGuo, L., Ren, Y., Li, R., & Jiang, B. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3266791 · Cited by 23
“…the rapid development of communication and network technology has led to widespread use of multiagent systems (MASs) in several fields, including intelligent transportation, unmanned aerial vehicle (UAV) formation control, and industrial production [1], [2], [3], [4], [5], [6], [7], [8], [9], [10].”
BackgroundXia, B., Mantegh, I., & Xie, W. (2024) · Drones · doi:10.3390/drones8080350 · Cited by 24
Meindl, M., Molinari, F., Lehmann, D., & Seel, T. (2021) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2021.3109646 · Cited by 19
“INTELLIGENT multi-agent systems (MASs) describe groups of interacting autonomous agents that have gathered interest in the scientific community and have also become an integral concept in industrial technology and robotics [2], [3].”
BackgroundDistributed Cognitive Learning Strategy for Cooperative–Competitive Multiagent Systems
Liu, Y., Zhang, S., & Tang, L. D. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3242370 · Cited by 20
“Various agents perform a large number of complex tasks efficiently through autonomous perception, mutual communication, and reinforcement learning [1], [2], which cannot be done by a single agent.”
BackgroundMatching-Based Capture-the-Flag Games for Multiagent Systems
Wang, J., Zhou, Z., Jin, X., Mao, S., & Tang, Y. S. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3323572 · Cited by 22
“Each agent has the capacity to efficiently exchange information and acquire knowledge from multiple neighbors, thereby enabling collaborative decision making among them [2], [3], [4], [5].”
BackgroundPotent Real-Time Recommendations Using Multimodel Contextual Reinforcement Learning
Kabra, A., Agarwal, A., & Parihar, A. S. (2021) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2021.3100291 · Cited by 19
Multi-agent Systems for Distributed Data Mining Techniques: An Overview
Qasem, M. H., Hudaib, A. A., Obeid, N., Almaiah, M. A., Almomani, O., & Al-Khasawneh, A. M. (2022) · Studies in computational intelligence · doi:10.1007/978-3-030-87954-9_3 · Cited by 20
Spectral decision in cognitive radio networks based on deep learning
Giral, D., Hernández, C., & Salgado, C. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115080 · Cited by 17
Arzo, S. T., Akhavan, Z., Esmaeili, M., Devetsikiotis, M., & Granelli, F. (2022) · Future Internet · doi:10.3390/fi14080230 · Cited by 24
A multi-agent coalition-based approach for order fulfilment in e-commerce
Nanda, P., & Patnaik, S. (2023) · Decision Analytics Journal · doi:10.1016/j.dajour.2023.100227 · Cited by 17
Loose Coupling: An Invisible Thread in the History of Technology
Mämmelä, A., Riekki, J. P., & Kiviranta, M. (2023) · IEEE Access · doi:10.1109/access.2023.3284685 · Cited by 24
“The agents form a distributed self-organizing system, useful in ad hoc networks [225], [226].”
BackgroundDhou, K. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.08.021 · Cited by 18
Task-Oriented Data Compression for Multi-Agent Communications Over Bit-Budgeted Channels
Mostaani, A., Vu, T. X., Chatzinotas, S., & Ottersten, B. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3213213 · Cited by 23
“of multi-agent decision making [14], [46], [47].”
Probabilistic Search and Track with Multiple Mobile Agents
Papaioannou, S., Kolios, P., Theocharides, T., Panayiotou, C. G., & Polycarpou, M. M. (2019) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2019.8797831 · Cited by 18
“Indeed the recent advances in small UAVs and the cost reduction of electronic components have spurred an unprecedented interest in autonomous multi-agent systems for group missions [2].”
BackgroundSpatiotemporal Relationship Cognitive Learning for Multirobot Air Combat
Piao, H., Han, Y., He, S., Yu, C., Fan, S., Hou, Y., Bai, C., & Li, M. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3250819 · Cited by 17
“Recently, MADRL has been widely used in robotic decision making, which allows robots to learn collaborative strategies autonomously [33], [34], [35].”
MethodGame-theoretical approach for task allocation problems with constraints
Liu, C. L., Lu, K., Chen, X., & Szolnoki, A. (2023) · Applied Mathematics and Computation · doi:10.1016/j.amc.2023.128251 · Cited by 15
“Recently, game-theoretical approach for solving the distributed optimization problems has been received considerable attention [34, 40, 41, 42, 43].”
BackgroundSpectrum Decision-Making in Collaborative Cognitive Radio Networks
Giral, D., Suárez, C. A. H., & Rodríguez-Colina, E. (2020) · Applied Sciences · doi:10.3390/app10196786 · Cited by 14
Dhou, K., & Cruzen, C. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.12.016 · Cited by 14
Ye, M., Huang, L., Wang, X. L., Wang, Y., Jiang, Q. X., & Qiu, H. B. (2024) · International Journal of Intelligent Computing and Cybernetics · doi:10.1108/ijicc-09-2023-0269 · Cited by 21
Federated Digital Twins as an Enabling Technology for Collaborative Decision-Making
Vergara-Marcillo, C., Theodoropoulos, G. K., Rami Bahsoon, A., Yánez-Pazmiño, W., & Tziritas, N. (2024) · ACM/IEEE/SCS Workshop on Principles of Advanced and Distributed Simulation (PADS) · doi:10.1145/3615979.3662152 · Cited by 16
“Therefore, a natural approach is to envision the federation as a Multi-agent System (MAS), considering MAS decision-making methods [6].”
BackgroundEdge Computing in an IoT Base Station System: Reprogramming and Real‐Time Tasks
Wu, H., Hu, J., Sun, J., & Sun, D. (2019) · Complexity · doi:10.1155/2019/4027638 · Cited by 13
Controlling Fleets of Autonomous Mobile Robots with Reinforcement Learning: A Brief Survey
Wesselhöft, M., Hinckeldeyn, J., & Kreutzfeldt, J. (2022) · Robotics · doi:10.3390/robotics11050085 · Cited by 21
A Robust Decision-Making Framework Based on Collaborative Agents
Florez-Lozano, J., Caraffini, F., Parra, C., & Góngora, M. (2020) · IEEE Access · doi:10.1109/access.2020.3016784 · Cited by 14
“If this goal is to make a final decision, based on several other measures of support calculated by each agent, then aMAS can be turned in a much more suitable scheme for robust DM than classic centralised ones [26].”
MethodMulti-Agent Coordinated Interception of Multiple Rogue Drones
Valianti, P., Papaioannou, S., Kolios, P., & Ellinas, G. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322489 · Cited by 13
“Recently, the study of anti-drone systems has attracted a considerable amount of interest [2], [3].”
BackgroundBehavior Reasoning for Opponent Agents in Multi-Agent Learning Systems
Hou, Y., Sun, M., Zhu, W., Zeng, Y., Piao, H., Chen, X., & Zhang, Q. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3147011 · Cited by 19
“In the research field of multi-agent systems, one of the core objectives pertaining to social learning is to benefit from mutual interaction through cooperation/collaborations [15], [16].”
BackgroundLee, H.-Y., Zhou, P., Zhang, B., Qiu, L., Fan, B., Duan, A., Tang, J., Lam, T. L., & Navarro-Alarcón, D. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3264034 · Cited by 11
“For example, if there are type 1 and type 2 components in the capability domain d, then td = [1, 2] ⊺ and the corresponding quantity is q̂ d = [2].”
BackgroundMethodInfluentialBayesian Strategy Networks Based Soft Actor-Critic Learning
Yang, Q., & Parasuraman, R. N. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3643862 · Cited by 14
“From a single-agent perspective, a strategy is a rule used by agents to select an action to pursue goals, which is equivalent to a policy in a Markov Decision Process ( MDP ) [40].”
BackgroundFuzzy clustering-based large-scale multimodal multi-objective differential evolution algorithm
Wu, L., Zhao, X., Ye, L., Qiao, Z., & Zuo, X. (2025) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2025.101856 · Cited by 11
APFD: an effective approach to taxi route recommendation with mobile trajectory big data
Zhang, W., Xia, D., Chang, G., Yang, H., Huo, Y., Feng, F., Li, Y., & Li, H. (2022) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2100530 · Cited by 11
“Therefore, the calculation of the shortest route has a high success rate and good robustness, but when it is applied to a large-scale node network, the execution time is longer than that of other algorithms (Hoy et al., 2015; Mavrovouniotis et al., 2017; Rizk et al., 2018; Zajac and Huber, 2021).”
BackgroundShi, F., Xi, J., Gong, C. Y., Gong, J., Hu, S., & Ma, Y. (2020) · IEEE International Conference on Unmanned Systems (ICUS) · doi:10.1109/icus50048.2020.9275007 · Cited by 13
Spectral decision for cognitive radio networks in a multi-user environment
Giral, D., Suárez, C. A. H., & Salgado, C. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07132 · Cited by 11
“(Rizk et al., 2018) review the most relevant cooperative models for decision-making in multi-agent systems (MAS).”
BackgroundPervasive AI for IoT Applications: Resource-efficient Distributed Artificial Intelligence.Preprint
Baccour, E., Mhaisen, N., Abdellatif, A. A., Erbad, A., Mohamed, A. M. S., Hamdi, M., & Guizani, M. (2021) · arXiv (Cornell University) · Cited by 11
Efficient Multitask Reinforcement Learning via Task-Specific Action Correction
Feng, J., Chen, M., Pu, Z., Qiu, T., Yi, J., & Zhang, J. (2025) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2025.3543694 · Cited by 13
Sun, S., Li, T., Chen, X., Dong, H., & Wang, X. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111968 · Cited by 10
Dynamic communication topologies for distributed heuristics in energy system optimization algorithms
Holly, S., & Nieße, A. (2021) · Annals of Computer Science and Information Systems · doi:10.15439/2021f60 · Cited by 13
Optimal Strategies and Cooperative Teaming for 3-D Multiplayer Reach-Avoid Games
Gao, P., Li, X., & Hu, J. (2024) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2024.3406889 · Cited by 9
A novel multi-agent simulation based particle swarm optimization algorithm
Du, S., Fan, W., & Liu, Y. (2022) · PLoS ONE · doi:10.1371/journal.pone.0275849 · Cited by 9
“Heterogeneous agents can deal with diverse scenarios and complex tasks, making it more suitable for complicated realistic systems [11].”
BackgroundDecentralised Multi-UAV Cooperative Searching Multi-Target in Cluttered and GPS-Denied Environments
Xiaolong, Z., Vanegas, F., & Gonzalez, F. (2022) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero53065.2022.9843665 · Cited by 9
Performance Analysis of Fault-Tolerant Multiagent Coordination Mechanisms
Pinciroli, R., & Trubiani, C. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3234606 · Cited by 9
“Following a survey on decision making in MAS [18], our tool includes time complexity for agents: 1) T comp (computational overhead for decision making), i.e., the amount of time needed to search for a solution; 2) T comm (communication overhead), i.e., the amount of time needed for the…”
BackgroundMethodApollonius Allocation Algorithm for Heterogeneous Pursuers to Capture Multiple EvadersPreprint
Makkapati, V. R., & Panagiotis Tsiotras, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10253 · Cited by 9
“It should therefore come as no surprise that a great amount of work has been devoted over the past decade to study coordination strategies of multi-agent UAV problems [4].”
BackgroundLeveraging 3GPP Features and Optimization Techniques for 5G NR-V2X Resource Allocation: A Survey
Bin Ali Wael, C., Hadj Dogheche, E., Armi, N., Subekti, A., & Dayoub, I. (2025) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2025.3584024 · Cited by 10
“The objective is to maximize the system’s overall reward, while agents work together to accomplish a common task [54].”
Sun, S., Dong, H., & Li, T. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01385-4 · Cited by 8
Construction and Application of an Agent-Based Intelligent Operation and Maintenance System for UAV
Li, Q., Cui, L., Wang, Q., Guo, A., & Yuan, H. (2025) · Drones · doi:10.3390/drones9040309 · Cited by 8
Multiagent Multiobjective Decision Making and Game for Saving Public Resources
Ma, X., Zhang, Y., Xie, W., Yang, J., & Zhang, W. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3307722 · Cited by 8
“However, MADDPG and G2ANet oversimplify the game process by making strong assumptions on game theory [2], [37], [38].”
BackgroundTrustful Coopetitive Infrastructures for the New Space Exploration Era
Baima, R. L., Chovet, L., Hartwich, E., Bera, A., Sedlmeir, J., Fridgen, G., & Olivares-Méndez, M. A. (2024) · ACM Symposium on Applied Computing · doi:10.1145/3605098.3635887 · Cited by 13
“For instance, validation mechanisms [50], reputation systems [16, 73], and different consensus mechanisms [30, 65] could be integrated to enhance mapped data reliability.”
BackgroundThe Vision of Self-Management in Cognitive Organic Power Distribution Systems
Loeser, I., Braun, M., Gruhl, C., Menke, J., Sick, B., & Tomforde, S. (2022) · Energies · doi:10.3390/en15030881 · Cited by 10
“, using Learning Classifier Systems [47].”
Raza, A., Shah, M. A., Khattak, H. A., Maple, C. R., Al-Turjman, F. M., & Rauf, H. T. (2022) · Environment Development and Sustainability · doi:10.1007/s10668-021-01836-9 · Cited by 10
“In [43,14], it is argued that MAS suffers from scalability, heterogeneity of agents, and continuous action spaces.”
BackgroundMethodAutonomous Network Traffic Classifier Agent for Autonomic Network Management System
Serugunda, C. N., Arzo, S. T., Granelli, F., Bassoli, R., Devetsikiotis, M., & Fitzek, F. H. P. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685568 · Cited by 10
“This, together with the information from the sensors, is fed into the inference mechanism, which decides the appropriate action to be taken by the agent [14].”
BackgroundState Augmentation via Self-Supervision in Offline Multiagent Reinforcement Learning
Wang, S., Li, X., Qu, H., & Chen, W. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3326297 · Cited by 10
“Deep reinforcement learning (RL) has proven to be a highly effective decision-making method, achieving notable success by analyzing the interaction between modeled agents and either simulated or physical environments [4], [5], [6], [7], [8].”
BackgroundChen, J., Shen, J., Chen, W., Li, J., & Zhang, S. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3539624 · Cited by 7
“…have emerged as a pivotal branch of modern technology, finding extensive application in advanced domains such as automation, robotics, network communication, intelligent transportation systems, and distributed decision-making [1], [2], [3], [4], [5], [6], [7], [8], [9], [10], [11], [12], [13].”
A System of Agents for Supporting Optimization and Control of a Connected Community
Hall, J., Starke, M. R., Munk, P. L., Zandi, H., Kuruganti, T. P., & Buckberry, H. (2021) · IEEE Journal of Emerging and Selected Topics in Industrial Electronics · doi:10.1109/jestie.2021.3112282 · Cited by 7
Six Software Engineering Principles for Smarter Cyber-Physical Systems
Weyns, D., Bureš, T., Călinescu, R., Craggs, B., Fitzgerald, J. S., Garlan, D., Nuseibeh, B., Pasquale, L., Rashid, A., Ruchkin, I., et al. (2021) · IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C) · doi:10.1109/acsos-c52956.2021.00058 · Cited by 11
“This level of adaptability is difficult to tackle with traditional engineering approaches that either put the focus on individual entities in the system or lack first-class support for truly open collaborations between entities [29].”
BackgroundDetection of traffic anomaly in highways by using recurrent neural network
Snineh, S. M., Amrani, N. E. A., Youssfi, M., Bouattane, O., & Daaif, A. (2021) · International Conference on Intelligent Computing in Data Sciences (ICDS) · doi:10.1109/icds53782.2021.9626741 · Cited by 7
Sensing spectrum sharing based massive MIMO radar for drone tracking and interception
Miantezila, J. M., & Guo, B. (2022) · PLoS ONE · doi:10.1371/journal.pone.0268834 · Cited by 7
Giral-Ramírez, D. A., Suárez, C. A. H., & Martínez, L. F. P. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07763 · Cited by 7
Assured Deep Multi-Agent Reinforcement Learning for Safe Robotic Systems
Riley, J., Călinescu, R., Paterson, C., Kudenko⋆, D., & Banks, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-10161-8_8 · Cited by 8
Spatial reciprocity under reinforcement learning mechanism
Wang, L., Shi, X., & Zhou, Y. (2025) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0246843 · Cited by 6
Metadata
- Authors
- Rizk, Y., Awad, M., & Tunstel, E. W.
- Affiliations
- American University of Beirut (LB)
- Venue
- IEEE Transactions on Cognitive and Developmental Systems
- Published
- 2018-09
- Volume
- 10
- Issue
- 3
- Pages
- 514-529
- ISSN
- 2379-8920 (ISSN-L)
- 2379-8939
- OpenAlex
- W2803208334
- Cited by
- 219
- References
- 275
- Citations by year
- 2026: 18 · 2025: 29 · 2024: 34 · 2023: 39 · 2022: 35 · 2021: 29 · 2020: 21 · 2019: 13 · 2018: 1
- FWCI
- 8.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Cognitive and Developmental Systems (publishedVersion)
- Funders
- National Council of Scientific Research in Lebanon
- American University of Beirut
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Engineering › Control and Systems Engineering › Distributed Control Multi-Agent Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- multi-agent systems, cooperative decision-making, Markov decision process, game theory, swarm intelligence, graph model, reinforcement learning, dynamic programming, evolutionary computation, artificial neural networks, robotics, wireless sensor networks, cognitive radio networks, intelligent transportation systems, big data, evaluation metrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.