Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

IEEE Transactions on Smart Grid

Quantum Privacy-Preserving Multi-Agent Deep Reinforcement Learning for Local Volt/Var Control

Qiong Liu, Changhong Zhao, Yuji Cao, Tongxin Li, Yue Chen

Published Jan 1, 2026• 0 citations
Publisher

Abstract

High photovoltaic penetration poses challenges to the voltage regulation of active distribution networks. While multi-agent deep reinforcement learning (MADRL) provides a data-driven framework for local Volt/Var control (VVC), classical approaches face limitations in coordination under extreme partial observability, parameter efficiency, and privacy. To address these gaps, this paper proposes quantum MADRL with public information (QMADRL-PI), which formulates VVC as a public-information-enhanced Markov game in which shared exogenous signals enable communication-free coordination. A hybrid quantum-classical policy with data re-uploading variational quantum circuits (VQCs) is developed for edge deployment, repeatedly encoding classical features at each circuit layer to enhance approximation capability. A quantum differential privacy (DP) mechanism repurposes intrinsic VQC shot noise, reducing external noise injection. Simulations on IEEE 33-bus and 141-bus systems show that QMADRL-PI attains VVC performance comparable to traditional MADRL while using over 1000-fold fewer parameters per agent. Under the same output-level DP mechanism, the compact quantum actor achieves a better privacy-utility trade-off than an over-parameterized classical actor. Experiments on a real 180-qubit superconducting quantum processor further validate the trained policy’s hardware feasibility and control performance.

DOI
10.1109/tsg.2026.3734069

Related papers

Quantum Reinforcement Learning for Volt-VAR Control in Power Distribution Systems

Lin Ding, Jianhui Wang, Huan-Hsin Tseng +3 more

Volt-VAR control (VVC) is crucial in active distribution networks for optimizing voltage profiles and minimizing network losses. While traditional deep reinforcement learning (DRL) algorithms exhibit promise for VVC, they often require extensive computational resources to handle such a high-dimensional problem. As a potential solution, quantum reinforcement learning (QRL) algorithms integrate the computational capabilities of quantum computing into the DRL framework. However, existing QRL algorithms struggle with complex VVC problems due to the limitations of current quantum hardware. To bridge this gap, this paper proposes an innovative QRL algorithm featuring an end-to-end architecture that integrates a classical autoencoder, variational quantum circuits (VQCs), and classical post-processing layers. This design efficiently compresses high-dimensional grid states, enabling VQCs to leverage quantum advantages while producing multiple control device outputs, specifically tailored for VVC tasks. Numerical studies on three representative distribution systems verify the effectiveness and scalability of the proposed QRL algorithm, and demonstrate its enhanced performance over classical approaches with only approximately 1% of the parameters. Additionally, the robustness of our developed algorithm is validated through noisy quantum environments.

IEEE Open Access Journal of Power and Energy•Jan 1, 2025•3 citations

A Sample-Efficient Quantum-Classical Reinforcement Learning Framework for Transmission Switching

Lin Ding, Jianhui Wang, Huan-Hsin Tseng +3 more

This paper presents a sample-efficient hybrid quantum-classical reinforcement learning (QCRL) framework for multi-objective transmission switching (MO-TS) in power systems. We introduce a Chunk-Based Data Reuploading Variational Quantum Circuit (CBDR-VQC) architecture, which is designed to enhance policy expressivity without increasing circuit depth or width. Unlike conventional VQC approaches that scale circuit size to improve learning capacity, often at the cost of hardware feasibility and trainability, our method encodes high-dimensional input features sequentially into a fixed-width, shallow quantum circuit with a learnable measurement scheme. This design maintains compatibility with near-term quantum devices while avoiding issues such as noise accumulation and barren plateaus. Embedded within a quantum-classical Soft Actor-Critic (QCSAC) framework, the proposed model achieves competitive performance for MO-TS on the IEEE 118-bus system. It significantly reduces the numbers of both required qubits and trainable parameters compared to both classical and wider VQC-based baselines, demonstrating its promise for resourceconstrained QCRL in real-world power system optimization.

IEEE International Conference on Quantum Computing and Engineering (QCE)•Aug 30, 2025•1 citation

eQMARL: Entangled Quantum Multi-Agent Reinforcement Learning for Distributed Cooperation over Quantum Channels

Alexander DeRieux, Walid Saad

Collaboration is a key challenge in distributed multi-agent reinforcement learning (MARL) environments. Learning frameworks for these decentralized systems must weigh the benefits of explicit player coordination against the communication overhead and computational cost of sharing local observations and environmental data. Quantum computing has sparked a potential synergy between quantum entanglement and cooperation in multi-agent environments, which could enable more efficient distributed collaboration with minimal information sharing. This relationship is largely unexplored, however, as current state-of-the-art quantum MARL (QMARL) implementations rely on classical information sharing rather than entanglement over a quantum channel as a coordination medium. In contrast, in this paper, a novel framework dubbed entangled QMARL (eQMARL) is proposed. The proposed eQMARL is a distributed actor-critic framework that facilitates cooperation over a quantum channel and eliminates local observation sharing via a quantum entangled split critic. Introducing a quantum critic uniquely spread across the agents allows coupling of local observation encoders through entangled input qubits over a quantum channel, which requires no explicit sharing of local observations and reduces classical communication overhead. Further, agent policies are tuned through joint observation-value function estimation via joint quantum measurements, thereby reducing the centralized computational burden. Experimental results show that eQMARL with $Ψ^{+}$ entanglement converges to a cooperative strategy up to $17.8\%$ faster and with a higher overall score compared to split classical and fully centralized classical and quantum baselines. The results also show that eQMARL achieves this performance with a constant factor of $25$-times fewer centralized parameters compared to the split classical baseline.

arXiv:2405.17486•May 24, 2024•7 citations

Quantum Multi-Agent Reinforcement Learning via Variational Quantum Circuit Design

Won Joon Yun, Yunseok Kwak, Jae Pyoung Kim +4 more

In recent years, quantum computing (QC) has been getting a lot of attention from industry and academia. Especially, among various QC research topics, variational quantum circuit (VQC) enables quantum deep reinforcement learning (QRL). Many studies of QRL have shown that the QRL is superior to the classical reinforcement learning (RL) methods under the constraints of the number of training parameters. This paper extends and demonstrates the QRL to quantum multi-agent RL (QMARL). However, the extension of QRL to QMARL is not straightforward due to the challenge of the noise intermediate-scale quantum (NISQ) and the non-stationary properties in classical multi-agent RL (MARL). Therefore, this paper proposes the centralized training and decentralized execution (CTDE) QMARL framework by designing novel VQCs for the framework to cope with these issues. To corroborate the QMARL framework, this paper conducts the QMARL demonstration in a single-hop environment where edge agents offload packets to clouds. The extensive demonstration shows that the proposed QMARL framework enhances 57.7% of total reward than classical frameworks.

arXiv:2203.10443•IEEE International Conference on Distributed Computing Systems (ICDCS)•Jul 1, 2022•74 citations

Hybrid Quantum-Classical Computing for Privacy-Preserving Machine Learning on Edge Devices

B. Dinesh, M. Thangamani, B. Paulchamy +3 more

The edge computing environment faces a challenge in maintaining data privacy while performing machine learning tasks. The current solutions for privacy preservation are inefficient or do not provide security guarantees, causing a critical gap in the edge computing environment, which is resource-constrained. The aim of this research work is to design a hybrid quantum-classical computing system that addresses the challenges of privacy preservation and efficiency in machine learning tasks. We design a novel architecture combining variational quantum circuits for secure data encoding with classical neural networks for scalable inference, implemented through federated learning protocols enhanced with quantum differential privacy mechanisms. Experimental evaluation demonstrates a 35% reduction in communication overhead compared to traditional federated learning approaches while maintaining 99.2% classification accuracy across diverse datasets. The quantum-enhanced privacy mechanisms achieve provable security guarantees with information-theoretic bounds, outperforming conventional cryptographic methods by 28% in computational overhead reduction. This hybrid approach establishes a new paradigm for secure and efficient machine learning deployment on edge devices, enabling privacy-preserving artificial intelligence in healthcare, finance, and IoT applications.

IEEE International Conference on Emerging Computing and Intelligent Technologies (ICoECIT)•Jan 28, 2026•0 citations

Quantum Reinforcement Learning by Adaptive Non-Local Observables

Hsin-Yi Lin, Samuel Yen-Chi Chen, Huan-Hsin Tseng +1 more

Hybrid quantum-classical frameworks leverage quantum computing for machine learning; however, variational quantum circuits (VQCs) are limited by local measurements. We introduce an adaptive non-local observable (ANO) paradigm within VQCs for quantum reinforcement learning (QRL), jointly optimizing circuit parameters and multi-qubit measurements. The ANO-VQC architecture serves as the function approximator in Deep Q-Network (DQN) and Asynchronous Advantage Actor-Critic (A3C) algorithms. On multiple benchmark tasks, ANOVQC agents outperform baseline VQCs. Ablation studies reveal that adaptive measurements enhance the function space without increasing circuit depth. Our results demonstrate that adaptive multi-qubit observables can enable practical quantum advantages in reinforcement learning.

IEEE International Conference on Quantum Computing and Engineering (QCE)•Aug 30, 2025•3 citations
High photovoltaic penetration poses challenges to the voltage regulation of active distribution networks. While multi-agent deep reinforcement learning (MADRL) provides a data-driven framework for local Volt/Var control (VVC), classical approaches face limitations in coordination under extreme partial observability, parameter efficiency, and privacy. To address these gaps, this paper proposes quantum MADRL with public information (QMADRL-PI), which formulates VVC as a public-information-enhanced Markov game in which shared exogenous signals enable communication-free coordination. A hybrid quantum-classical policy with data re-uploading variational quantum circuits (VQCs) is developed for edge deployment, repeatedly encoding classical features at each circuit layer to enhance approximation capability. A quantum differential privacy (DP) mechanism repurposes intrinsic VQC shot noise, reducing external noise injection. Simulations on IEEE 33-bus and 141-bus systems show that QMADRL-PI attains VVC performance comparable to traditional MADRL while using over 1000-fold fewer parameters per agent. Under the same output-level DP mechanism, the compact quantum actor achieves a better privacy-utility trade-off than an over-parameterized classical actor. Experiments on a real 180-qubit superconducting quantum processor further validate the trained policy’s hardware feasibility and control performance.
Volt-VAR control (VVC) is crucial in active distribution networks for optimizing voltage profiles and minimizing network losses. While traditional deep reinforcement learning (DRL) algorithms exhibit promise for VVC, they often require extensive computational resources to handle such a high-dimensional problem. As a potential solution, quantum reinforcement learning (QRL) algorithms integrate the computational capabilities of quantum computing into the DRL framework. However, existing QRL algorithms struggle with complex VVC problems due to the limitations of current quantum hardware. To bridge this gap, this paper proposes an innovative QRL algorithm featuring an end-to-end architecture that integrates a classical autoencoder, variational quantum circuits (VQCs), and classical post-processing layers. This design efficiently compresses high-dimensional grid states, enabling VQCs to leverage quantum advantages while producing multiple control device outputs, specifically tailored for VVC tasks. Numerical studies on three representative distribution systems verify the effectiveness and scalability of the proposed QRL algorithm, and demonstrate its enhanced performance over classical approaches with only approximately 1% of the parameters. Additionally, the robustness of our developed algorithm is validated through noisy quantum environments.
This paper presents a sample-efficient hybrid quantum-classical reinforcement learning (QCRL) framework for multi-objective transmission switching (MO-TS) in power systems. We introduce a Chunk-Based Data Reuploading Variational Quantum Circuit (CBDR-VQC) architecture, which is designed to enhance policy expressivity without increasing circuit depth or width. Unlike conventional VQC approaches that scale circuit size to improve learning capacity, often at the cost of hardware feasibility and trainability, our method encodes high-dimensional input features sequentially into a fixed-width, shallow quantum circuit with a learnable measurement scheme. This design maintains compatibility with near-term quantum devices while avoiding issues such as noise accumulation and barren plateaus. Embedded within a quantum-classical Soft Actor-Critic (QCSAC) framework, the proposed model achieves competitive performance for MO-TS on the IEEE 118-bus system. It significantly reduces the numbers of both required qubits and trainable parameters compared to both classical and wider VQC-based baselines, demonstrating its promise for resourceconstrained QCRL in real-world power system optimization.
Collaboration is a key challenge in distributed multi-agent reinforcement learning (MARL) environments. Learning frameworks for these decentralized systems must weigh the benefits of explicit player coordination against the communication overhead and computational cost of sharing local observations and environmental data. Quantum computing has sparked a potential synergy between quantum entanglement and cooperation in multi-agent environments, which could enable more efficient distributed collaboration with minimal information sharing. This relationship is largely unexplored, however, as current state-of-the-art quantum MARL (QMARL) implementations rely on classical information sharing rather than entanglement over a quantum channel as a coordination medium. In contrast, in this paper, a novel framework dubbed entangled QMARL (eQMARL) is proposed. The proposed eQMARL is a distributed actor-critic framework that facilitates cooperation over a quantum channel and eliminates local observation sharing via a quantum entangled split critic. Introducing a quantum critic uniquely spread across the agents allows coupling of local observation encoders through entangled input qubits over a quantum channel, which requires no explicit sharing of local observations and reduces classical communication overhead. Further, agent policies are tuned through joint observation-value function estimation via joint quantum measurements, thereby reducing the centralized computational burden. Experimental results show that eQMARL with Ψ+Ψ^{+}Ψ+ entanglement converges to a cooperative strategy up to 17.8%17.8\%17.8% faster and with a higher overall score compared to split classical and fully centralized classical and quantum baselines. The results also show that eQMARL achieves this performance with a constant factor of 252525-times fewer centralized parameters compared to the split classical baseline.
In recent years, quantum computing (QC) has been getting a lot of attention from industry and academia. Especially, among various QC research topics, variational quantum circuit (VQC) enables quantum deep reinforcement learning (QRL). Many studies of QRL have shown that the QRL is superior to the classical reinforcement learning (RL) methods under the constraints of the number of training parameters. This paper extends and demonstrates the QRL to quantum multi-agent RL (QMARL). However, the extension of QRL to QMARL is not straightforward due to the challenge of the noise intermediate-scale quantum (NISQ) and the non-stationary properties in classical multi-agent RL (MARL). Therefore, this paper proposes the centralized training and decentralized execution (CTDE) QMARL framework by designing novel VQCs for the framework to cope with these issues. To corroborate the QMARL framework, this paper conducts the QMARL demonstration in a single-hop environment where edge agents offload packets to clouds. The extensive demonstration shows that the proposed QMARL framework enhances 57.7% of total reward than classical frameworks.
The edge computing environment faces a challenge in maintaining data privacy while performing machine learning tasks. The current solutions for privacy preservation are inefficient or do not provide security guarantees, causing a critical gap in the edge computing environment, which is resource-constrained. The aim of this research work is to design a hybrid quantum-classical computing system that addresses the challenges of privacy preservation and efficiency in machine learning tasks. We design a novel architecture combining variational quantum circuits for secure data encoding with classical neural networks for scalable inference, implemented through federated learning protocols enhanced with quantum differential privacy mechanisms. Experimental evaluation demonstrates a 35% reduction in communication overhead compared to traditional federated learning approaches while maintaining 99.2% classification accuracy across diverse datasets. The quantum-enhanced privacy mechanisms achieve provable security guarantees with information-theoretic bounds, outperforming conventional cryptographic methods by 28% in computational overhead reduction. This hybrid approach establishes a new paradigm for secure and efficient machine learning deployment on edge devices, enabling privacy-preserving artificial intelligence in healthcare, finance, and IoT applications.
Hybrid quantum-classical frameworks leverage quantum computing for machine learning; however, variational quantum circuits (VQCs) are limited by local measurements. We introduce an adaptive non-local observable (ANO) paradigm within VQCs for quantum reinforcement learning (QRL), jointly optimizing circuit parameters and multi-qubit measurements. The ANO-VQC architecture serves as the function approximator in Deep Q-Network (DQN) and Asynchronous Advantage Actor-Critic (A3C) algorithms. On multiple benchmark tasks, ANOVQC agents outperform baseline VQCs. Ablation studies reveal that adaptive measurements enhance the function space without increasing circuit depth. Our results demonstrate that adaptive multi-qubit observables can enable practical quantum advantages in reinforcement learning.