Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)

QMARL: A Quantum Multi-Agent Reinforcement Learning Framework for Swarm Robots Navigation

Weizhao Chen, Jiawang Wan, Fangwen Ye, Ran Wang, Cheng Xu

Published Apr 14, 2024• 3 citations
Publisher

Abstract

In the last decade, the field of reinforcement learning has evolved from single-agent paradigms to embrace multi-agent settings. However, as the number of agents increases, especially in intricate or stochastic environments, the efficacy of individual learning models tends to diminish. Moreover, applying experience replay techniques in multi-agent scenarios presents considerable challenges. To address these pressing issues, this paper introduces a straightforward yet highly effective approach known as Quantum-Based Multi-Agent Reinforcement Learning (QMARL). This approach revolves around the quantization of states and actions within the multi-agent reinforcement learning system. Leveraging the power of the Grover algorithm for action decision-making, we also introduce a novel quantum-based prioritized experience replay method. Our proposed approach has been rigorously validated through experiments conducted in the cooperative navigation environment provided by OpenAI. The results demonstrate its capacity to enhance multi-agent learning in complex settings. This research opens promising avenues for harnessing quantum computing techniques in the realm of reinforcement learning, paving the way for more robust and scalable solutions in multi-agent systems.

DOI
10.1109/icasspw62465.2024.10627769

Related papers

Quantum Multi-Agent Reinforcement Learning as an Emerging AI Technology: A Survey and Future Directions

Jun Zhao, Wenhan Yu

This paper presents a comprehensive survey of Quantum Multi-Agent Reinforcement Learning (QMARL), a nascent field at the intersection of quantum computing and multi-agent systems. The survey begins by introducing the fundamentals of quantum computing, highlighting its potential to revolutionize computational capabilities. We then delve into the principles of multi-agent reinforcement learning (MARL), examining how quantum computing can enhance learning efficiency and decision-making processes in complex environments. The core of the survey focuses on the current state of QMARL, reviewing existing literature, methodologies, and case studies that demonstrate the integration of quantum algorithms with MARL frameworks. The paper also addresses the unique challenges and opportunities presented by quantum technologies in multi-agent systems, such as quantum entanglement and superposition, and their implications for agent coordination and learning dynamics. Additionally, the survey explores the practical applications of QMARL in various domains, including cybersecurity, finance, and robotics, underscoring its transformative potential. The paper concludes by identifying key research gaps and proposing future directions for the development of QMARL. This includes the need for scalable quantum algorithms, the exploration of quantum-resistant strategies in adversarial settings, and the integration of quantum principles in agent communication and collaboration. Overall, this survey serves as a foundational guide for researchers and practitioners interested in the emerging field of QMARL, offering insights into its current achievements and future possibilities.

•Nov 22, 2023•6 citations

Quantum Multi-Agent Reinforcement Learning as an Emerging AI Technology: A Survey and Future Directions

Jun Hai Zhao, Wenhan Yu

This paper presents a comprehensive survey of Quantum Multi-Agent Reinforcement Learning (QMARL), a nascent field at the intersection of quantum computing and multi-agent systems. The survey begins by introducing the fundamentals of quantum computing, highlighting its potential to revolutionize computational capabilities. We then delve into the principles of multi-agent reinforcement learning (MARL), examining how quantum computing can enhance learning efficiency and decision-making processes in complex environments. The core of the survey focuses on the current state of QMARL, reviewing existing literature, methodologies, and case studies that demonstrate the integration of quantum algorithms with MARL frameworks. The paper also addresses the unique challenges and opportunities presented by quantum technologies in multi-agent systems, such as quantum entanglement and superposition, and their implications for agent coordination and learning dynamics. Additionally, the survey explores the practical applications of QMARL in various domains, including cybersecurity, finance, and robotics, underscoring its transformative potential. The paper concludes by identifying key research gaps and proposing future directions for the development of QMARL. This includes the need for scalable quantum algorithms, the exploration of quantum-resistant strategies in adversarial settings, and the integration of quantum principles in agent communication and collaboration. Overall, this survey serves as a foundational guide for researchers and practitioners interested in the emerging field of QMARL, offering insights into its current achievements and future possibilities.

•Nov 22, 2023•3 citations

Quantum Multi-Agent Reinforcement Learning as an Emerging AI Technology: A Survey and Future Directions

Wenhan Yu, Jun Zhao

This paper surveys Quantum Multi-Agent Reinforcement Learning (QMARL), an emerging fusion of quantum computing and multi-agent systems. It begins by introducing the transformative potential of quantum computing in computational capabilities. Examining the principles of multi-agent reinforcement learning (MARL), the paper explores how quantum computing enhances learning efficiency and decision-making. Focusing on the current state of QMARL, it reviews literature, methodologies, and case studies showcasing the integration of quantum algorithms with MARL frameworks. The survey addresses challenges and opportunities arising from quantum technologies in multi-agent systems, such as entanglement and superposition, exploring their implications for agent coordination and learning dynamics. Practical applications in domains like cybersecurity and finance underscore QMARL’s transformative potential. Concluding, the paper identifies research gaps and proposes future directions, emphasizing the need for scalable quantum algorithms, exploring quantum-resistant strategies in adversarial settings, and integrating quantum principles in agent communication and collaboration. This concise survey serves as a foundational guide for researchers and practitioners, offering insights into the current state and future possibilities of QMARL.

International Conference on Computer and Applications (ICCA)•Nov 28, 2023•7 citations

Introduction to Quantum Multi-Agent Reinforcement Learning: Concepts and Applications

Yeryeong Cho, Seok Bin Son, Soohyun Park +1 more

Advancements in quantum computer hardware and software have paved the way for the application of quantum computing across various fields. With the development of computers with thousands of qubits, the power of quantum is increasing. Because of efficiency in high action dimensions, quantum computing has advantages in multi-agent fields where the amount of data is huge. At the same time, reinforcement learning (RL) has gained prominence for its potential in unknown environments. Consequently, the integration of quantum computing and multi-agent reinforcement learning (MARL), known as quantum multi-agent reinforcement learning (QMARL), is proposed. This paper introduces the overall concept and applications of quantum computing, MARL, and QMARL. It also shows the current technology trends depending on the application. In conclusion, the paper presents challenges and future research directions for QMARL and shows that QMARL can be utilized in various applications for excellent performance.

International Conference on Information and Communication Technology Convergence (ICTC)•Oct 16, 2024•0 citations

Quantum Multi-Agent Reinforcement Learning via Variational Quantum Circuit Design

Won Joon Yun, Yunseok Kwak, Jae Pyoung Kim +4 more

In recent years, quantum computing (QC) has been getting a lot of attention from industry and academia. Especially, among various QC research topics, variational quantum circuit (VQC) enables quantum deep reinforcement learning (QRL). Many studies of QRL have shown that the QRL is superior to the classical reinforcement learning (RL) methods under the constraints of the number of training parameters. This paper extends and demonstrates the QRL to quantum multi-agent RL (QMARL). However, the extension of QRL to QMARL is not straightforward due to the challenge of the noise intermediate-scale quantum (NISQ) and the non-stationary properties in classical multi-agent RL (MARL). Therefore, this paper proposes the centralized training and decentralized execution (CTDE) QMARL framework by designing novel VQCs for the framework to cope with these issues. To corroborate the QMARL framework, this paper conducts the QMARL demonstration in a single-hop environment where edge agents offload packets to clouds. The extensive demonstration shows that the proposed QMARL framework enhances 57.7% of total reward than classical frameworks.

arXiv:2203.10443•IEEE International Conference on Distributed Computing Systems (ICDCS)•Jul 1, 2022•74 citations

QiMARL: Quantum-Inspired Multi-Agent Reinforcement Learning Strategy for Efficient Resource Energy Distribution in Nodal Power Stations

Sapthak Mohajon Turjya, Anjan Bandyopadhyay, M. Shamim Kaiser +1 more

The coupling of quantum computing with multi-agent reinforcement learning (MARL) provides an exciting direction to tackle intricate decision-making tasks in high-dimensional spaces. This work introduces a new quantum-inspired multi-agent reinforcement learning (QiMARL) model, utilizing quantum parallelism to achieve learning efficiency and scalability improvement. The QiMARL model is tested on an energy distribution task, which optimizes power distribution between generating and demanding nodal power stations. We compare the convergence time, reward performance, and scalability of QiMARL with traditional Multi-Armed Bandit (MAB) and Multi-Agent Reinforcement Learning methods, such as Greedy, Upper Confidence Bound (UCB), Thompson Sampling, MADDPG, QMIX, and PPO methods with a comprehensive ablation study. Our findings show that QiMARL yields better performance in high-dimensional systems, decreasing the number of training epochs needed for convergence while enhancing overall reward maximization. We also compare the algorithm’s computational complexity, indicating that QiMARL is more scalable to high-dimensional quantum environments. This research opens the door to future studies of quantum-enhanced reinforcement learning (RL) with potential applications to energy optimization, traffic management, and other multi-agent coordination problems.

AI•Sep 1, 2025•5 citations
In the last decade, the field of reinforcement learning has evolved from single-agent paradigms to embrace multi-agent settings. However, as the number of agents increases, especially in intricate or stochastic environments, the efficacy of individual learning models tends to diminish. Moreover, applying experience replay techniques in multi-agent scenarios presents considerable challenges. To address these pressing issues, this paper introduces a straightforward yet highly effective approach known as Quantum-Based Multi-Agent Reinforcement Learning (QMARL). This approach revolves around the quantization of states and actions within the multi-agent reinforcement learning system. Leveraging the power of the Grover algorithm for action decision-making, we also introduce a novel quantum-based prioritized experience replay method. Our proposed approach has been rigorously validated through experiments conducted in the cooperative navigation environment provided by OpenAI. The results demonstrate its capacity to enhance multi-agent learning in complex settings. This research opens promising avenues for harnessing quantum computing techniques in the realm of reinforcement learning, paving the way for more robust and scalable solutions in multi-agent systems.
This paper presents a comprehensive survey of Quantum Multi-Agent Reinforcement Learning (QMARL), a nascent field at the intersection of quantum computing and multi-agent systems. The survey begins by introducing the fundamentals of quantum computing, highlighting its potential to revolutionize computational capabilities. We then delve into the principles of multi-agent reinforcement learning (MARL), examining how quantum computing can enhance learning efficiency and decision-making processes in complex environments. The core of the survey focuses on the current state of QMARL, reviewing existing literature, methodologies, and case studies that demonstrate the integration of quantum algorithms with MARL frameworks. The paper also addresses the unique challenges and opportunities presented by quantum technologies in multi-agent systems, such as quantum entanglement and superposition, and their implications for agent coordination and learning dynamics. Additionally, the survey explores the practical applications of QMARL in various domains, including cybersecurity, finance, and robotics, underscoring its transformative potential. The paper concludes by identifying key research gaps and proposing future directions for the development of QMARL. This includes the need for scalable quantum algorithms, the exploration of quantum-resistant strategies in adversarial settings, and the integration of quantum principles in agent communication and collaboration. Overall, this survey serves as a foundational guide for researchers and practitioners interested in the emerging field of QMARL, offering insights into its current achievements and future possibilities.
This paper presents a comprehensive survey of Quantum Multi-Agent Reinforcement Learning (QMARL), a nascent field at the intersection of quantum computing and multi-agent systems. The survey begins by introducing the fundamentals of quantum computing, highlighting its potential to revolutionize computational capabilities. We then delve into the principles of multi-agent reinforcement learning (MARL), examining how quantum computing can enhance learning efficiency and decision-making processes in complex environments. The core of the survey focuses on the current state of QMARL, reviewing existing literature, methodologies, and case studies that demonstrate the integration of quantum algorithms with MARL frameworks. The paper also addresses the unique challenges and opportunities presented by quantum technologies in multi-agent systems, such as quantum entanglement and superposition, and their implications for agent coordination and learning dynamics. Additionally, the survey explores the practical applications of QMARL in various domains, including cybersecurity, finance, and robotics, underscoring its transformative potential. The paper concludes by identifying key research gaps and proposing future directions for the development of QMARL. This includes the need for scalable quantum algorithms, the exploration of quantum-resistant strategies in adversarial settings, and the integration of quantum principles in agent communication and collaboration. Overall, this survey serves as a foundational guide for researchers and practitioners interested in the emerging field of QMARL, offering insights into its current achievements and future possibilities.
This paper surveys Quantum Multi-Agent Reinforcement Learning (QMARL), an emerging fusion of quantum computing and multi-agent systems. It begins by introducing the transformative potential of quantum computing in computational capabilities. Examining the principles of multi-agent reinforcement learning (MARL), the paper explores how quantum computing enhances learning efficiency and decision-making. Focusing on the current state of QMARL, it reviews literature, methodologies, and case studies showcasing the integration of quantum algorithms with MARL frameworks. The survey addresses challenges and opportunities arising from quantum technologies in multi-agent systems, such as entanglement and superposition, exploring their implications for agent coordination and learning dynamics. Practical applications in domains like cybersecurity and finance underscore QMARL’s transformative potential. Concluding, the paper identifies research gaps and proposes future directions, emphasizing the need for scalable quantum algorithms, exploring quantum-resistant strategies in adversarial settings, and integrating quantum principles in agent communication and collaboration. This concise survey serves as a foundational guide for researchers and practitioners, offering insights into the current state and future possibilities of QMARL.
Advancements in quantum computer hardware and software have paved the way for the application of quantum computing across various fields. With the development of computers with thousands of qubits, the power of quantum is increasing. Because of efficiency in high action dimensions, quantum computing has advantages in multi-agent fields where the amount of data is huge. At the same time, reinforcement learning (RL) has gained prominence for its potential in unknown environments. Consequently, the integration of quantum computing and multi-agent reinforcement learning (MARL), known as quantum multi-agent reinforcement learning (QMARL), is proposed. This paper introduces the overall concept and applications of quantum computing, MARL, and QMARL. It also shows the current technology trends depending on the application. In conclusion, the paper presents challenges and future research directions for QMARL and shows that QMARL can be utilized in various applications for excellent performance.
In recent years, quantum computing (QC) has been getting a lot of attention from industry and academia. Especially, among various QC research topics, variational quantum circuit (VQC) enables quantum deep reinforcement learning (QRL). Many studies of QRL have shown that the QRL is superior to the classical reinforcement learning (RL) methods under the constraints of the number of training parameters. This paper extends and demonstrates the QRL to quantum multi-agent RL (QMARL). However, the extension of QRL to QMARL is not straightforward due to the challenge of the noise intermediate-scale quantum (NISQ) and the non-stationary properties in classical multi-agent RL (MARL). Therefore, this paper proposes the centralized training and decentralized execution (CTDE) QMARL framework by designing novel VQCs for the framework to cope with these issues. To corroborate the QMARL framework, this paper conducts the QMARL demonstration in a single-hop environment where edge agents offload packets to clouds. The extensive demonstration shows that the proposed QMARL framework enhances 57.7% of total reward than classical frameworks.
The coupling of quantum computing with multi-agent reinforcement learning (MARL) provides an exciting direction to tackle intricate decision-making tasks in high-dimensional spaces. This work introduces a new quantum-inspired multi-agent reinforcement learning (QiMARL) model, utilizing quantum parallelism to achieve learning efficiency and scalability improvement. The QiMARL model is tested on an energy distribution task, which optimizes power distribution between generating and demanding nodal power stations. We compare the convergence time, reward performance, and scalability of QiMARL with traditional Multi-Armed Bandit (MAB) and Multi-Agent Reinforcement Learning methods, such as Greedy, Upper Confidence Bound (UCB), Thompson Sampling, MADDPG, QMIX, and PPO methods with a comprehensive ablation study. Our findings show that QiMARL yields better performance in high-dimensional systems, decreasing the number of training epochs needed for convergence while enhancing overall reward maximization. We also compare the algorithm’s computational complexity, indicating that QiMARL is more scalable to high-dimensional quantum environments. This research opens the door to future studies of quantum-enhanced reinforcement learning (RL) with potential applications to energy optimization, traffic management, and other multi-agent coordination problems.