Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2401.17190 · Physical Review A

Improving robustness of quantum feedback control with reinforcement learning

Manuel Guatto, Gian Antonio Susto, Francesco Ticozzi

Published Jul 3, 2024• 7 citations
arXivHTMLPDF

Abstract

Obtaining reliable state preparation protocols is a key step toward practical implementation of many quantum technologies, and one of the main tasks in quantum control. In this work, different reinforcement learning approaches are used to derive a feedback law for state preparation of a desired state in a target system. In particular, we focus on the robustness of the obtained strategies with respect to different types and amount of noise. Comparing the results indicates that the learned controls are more robust to unmodeled perturbations with respect to simple feedback strategy based on optimized population transfer, and that training on a simulated nominal model retains the same advantages displayed by controllers trained on real data. The possibility of effective off-line training of robust controllers promises significant advantages toward practical implementation.

DOI
10.1103/physreva.110.012605

Related papers

Reinforcement Learning for Quantum Control under Physical Constraints

Jan Ole Ernst, Chatterjee, Aniket, Tim Franzmeyer +1 more

Quantum control is concerned with the realisation of desired dynamics in quantum systems, serving as a linchpin for advancing quantum technologies and fundamental research. Analytic approaches and standard optimisation algorithms do not yield satisfactory solutions for more complex quantum systems, and especially not for real world quantum systems which are open and noisy. We devise a physics-constrained Reinforcement Learning (RL) algorithm that restricts the space of possible solutions. We incorporate priors about the desired time scales of the quantum state dynamics - as well as realistic control signal limitations - as constraints to the RL algorithm. These constraints improve solution quality and enhance computational scaleability. We evaluate our method on three broadly relevant quantum systems and incorporate real-world complications, arising from dissipation and control signal perturbations. We achieve both higher fidelities - which exceed 0.999 across all systems - and better robustness to time-dependent perturbations and experimental imperfections than previous methods. Lastly, we demonstrate that incorporating multi-step feedback can yield solutions robust even to strong perturbations. Our implementation can be found at https://github.com/jan-o-e/RL4qcWpc.

arXiv:2501.14372•Jan 24, 2025•9 citations

Feedback-Based Steering for Quantum State Preparation

Daniel Volya, Zhixin Pan, Prabhat Mishra

State preparation is an essential component in quantum information science. A recently developed steering protocol utilizes a sequence of generalized measurements on a detector to steer a quantum system towards a desired state. However, it is designed as an open-loop technique that requires accurate modeling of the overall quantum system and can be prone to errors. To address this challenge, we propose a closed-loop control technique that introduces feedback to the steering protocol, providing robustness to noise and faster state convergence. We introduce two strategies for feedback: (1) a gradient-based active steering protocol that changes the detector-system coupling conditioned on the detector's readout and (2) tuning the fixed detector-system coupling via model-free reinforcement learning. We study the effectiveness of these strategies under various noise models, including both incoherent and decoherent noise, and discuss potential applications in quantum technologies.

IEEE International Conference on Quantum Computing and Engineering (QCE)•Sep 17, 2023•6 citations

A Generic and Robust Agent to Accomplish Quantum Control Tasks

S Zhang, Zibo Miao, Qixiang Zhang +1 more

In view of inevitable uncertainties or disturbances in quantum systems, efficient and systematic numerical methods for robust control design are of significant importance. Although reinforcement learning has recently been applied in the field of quantum control, completing quantum control tasks in practice is always challenging due to the lack of data from real-world environments. In this paper, a generic and robust agent can be constructed catering to system imperfections by applying a curriculum meta-reinforcement learning quantum control (CMQC) approach. The proposed approach incorporates an objective module that can break down a complex quantum control objective into multiple sub-objectives using an exponential decay strategy, enabling the agent to gradually learn to solve the final goal through experience transfer and knowledge consolidation. Furthermore, a meta module is employed to achieve adaptation to environmental imperfections. This allows the agent to adjust its strategy in real time, obtaining strong robustness even in the presence of uncertainties. The superiority of CMQC is demonstrated in robust control problems regarding state transfer in a two-level quantum system and realization of the$R_{x}(\pi)$gate, with reduced computational cost and improved accuracy achieved. Our results pave the way towards more reliable and secure quantum information processing with uncertainties involved.

IEEE Transactions on Emerging Topics in Computational Intelligence•Feb 12, 2026•0 citations

Adaptive Quantum Control via Reinforcement Learning

Jincheng Zhang

This paper investigates the application of reinforcement learning (RL) for adaptive quantum control. Traditional quantum control methods often rely on pre-designed pulse shapes optimized for specific scenarios, lacking adaptability to variations in system parameters or environmental noise. This work proposes a novel framework where an RL agent learns to dynamically adjust quantum control pulses in real-time, maximizing the fidelity of quantum operations. The agent receives feedback from the quantum system, typically measured through state variables, and utilizes this information to optimize the control pulse sequence. This adaptive approach addresses the limitations of static control schemes and promises enhanced robustness and performance in complex quantum systems. The core claim centers on utilizing reinforcement learning to design optimal quantum control pulses. The central mechanism involves a trained controller dynamically adjusting pulses based on system feedback. The presented methodology offers a new approach to quantum control, particularly relevant in noisy environments and systems with parameter variations. The research demonstrates the potential of RL for achieving superior quantum control outcomes compared to conventional techniques. ---

•Sep 4, 2026•0 citations

Adaptive Quantum Control Algorithm Optimization

Jincheng Zhang

This paper investigates the optimization of quantum control algorithms using reinforcement learning (RL). The core claim is that RL can significantly enhance the control precision and efficiency of quantum devices. We propose a framework where the quantum control algorithm is treated as an intelligent agent, interacting with the quantum environment to learn optimal control strategies. This approach allows for adaptive control, addressing the challenges inherent in designing fixed control protocols for complex quantum systems. The methodology involves defining a reward function that reflects the desired quantum state evolution, using RL algorithms to train the agent, and validating the learned control strategy through simulations. We demonstrate the potential of this approach to improve control accuracy and robustness, particularly in scenarios with noisy environments or rapidly changing system parameters. The results suggest a promising direction for leveraging machine learning techniques to unlock the full potential of quantum control.

•Sep 6, 2026•0 citations

Enhancement of Machine Learning for Adaptive Quantum Computing Control: The Optimization Performance and Prevention of Real Time Error

V. Saravanan, Ganesan M, R. Balasubramaniyan +3 more

Adaptive quantum computing control is important for the stability and efficiency of quantum systems, especially in the presence of dynamic environmental noise and hardware fluctuations. We present a unified strategy for machine learning (ML) techniques to improve adaptive quantum control in two main directions: optimization speed and out-of-sample error. Here, we propose a hybrid learning method combining reinforcement learning (RL), deep neural networks (DNNs), and quantum-inspired models to actively and adaptively update quantum gate parameters and error mitigation strategies on the fly. Embedding of quantum noise models directly into the learning allows the system to predict and correct for decoherence, gate errors and measurement inaccuracy before they affect computational fidelity. Using extensive simulations as well as experimental validation on noisy intermediate-scale quantum (NISQ) processors, our improved ML model achieves a substantially higher fidelity and robustness compared to standard model-free and static control approaches. We introduce a novel feedback-loop mechanism based on online learning algorithms enabling the system to adjust for changing noise profiles and hardware drift without retraining. The optimization part uses metaheuristic methods to quickly converge to control parameters that perform well, and the error prevention mechanism features anomaly detection and prediction correction layers to minimize the effects of cumulative decoherence. The results demonstrate that our adaptive control framework can be used to not only speed up the convergence in training quantum algorithms, but also sustain the performance of gates against error at a variety of error rates with the reduction of the real-time impact of the error up to 35 %. This work highlights the promise of machine learningaugmented quantum control for improving reliability and scalability in quantum computing and serves as a stepping stone for future incorporation with fault-tolerant designs.

International Conference on Electronics and Computing, Communication Networking Automation Technologies (ICEC2NT)•Sep 3, 2025•3 citations
Obtaining reliable state preparation protocols is a key step toward practical implementation of many quantum technologies, and one of the main tasks in quantum control. In this work, different reinforcement learning approaches are used to derive a feedback law for state preparation of a desired state in a target system. In particular, we focus on the robustness of the obtained strategies with respect to different types and amount of noise. Comparing the results indicates that the learned controls are more robust to unmodeled perturbations with respect to simple feedback strategy based on optimized population transfer, and that training on a simulated nominal model retains the same advantages displayed by controllers trained on real data. The possibility of effective off-line training of robust controllers promises significant advantages toward practical implementation.
Quantum control is concerned with the realisation of desired dynamics in quantum systems, serving as a linchpin for advancing quantum technologies and fundamental research. Analytic approaches and standard optimisation algorithms do not yield satisfactory solutions for more complex quantum systems, and especially not for real world quantum systems which are open and noisy. We devise a physics-constrained Reinforcement Learning (RL) algorithm that restricts the space of possible solutions. We incorporate priors about the desired time scales of the quantum state dynamics - as well as realistic control signal limitations - as constraints to the RL algorithm. These constraints improve solution quality and enhance computational scaleability. We evaluate our method on three broadly relevant quantum systems and incorporate real-world complications, arising from dissipation and control signal perturbations. We achieve both higher fidelities - which exceed 0.999 across all systems - and better robustness to time-dependent perturbations and experimental imperfections than previous methods. Lastly, we demonstrate that incorporating multi-step feedback can yield solutions robust even to strong perturbations. Our implementation can be found at https://github.com/jan-o-e/RL4qcWpc.
State preparation is an essential component in quantum information science. A recently developed steering protocol utilizes a sequence of generalized measurements on a detector to steer a quantum system towards a desired state. However, it is designed as an open-loop technique that requires accurate modeling of the overall quantum system and can be prone to errors. To address this challenge, we propose a closed-loop control technique that introduces feedback to the steering protocol, providing robustness to noise and faster state convergence. We introduce two strategies for feedback: (1) a gradient-based active steering protocol that changes the detector-system coupling conditioned on the detector's readout and (2) tuning the fixed detector-system coupling via model-free reinforcement learning. We study the effectiveness of these strategies under various noise models, including both incoherent and decoherent noise, and discuss potential applications in quantum technologies.
In view of inevitable uncertainties or disturbances in quantum systems, efficient and systematic numerical methods for robust control design are of significant importance. Although reinforcement learning has recently been applied in the field of quantum control, completing quantum control tasks in practice is always challenging due to the lack of data from real-world environments. In this paper, a generic and robust agent can be constructed catering to system imperfections by applying a curriculum meta-reinforcement learning quantum control (CMQC) approach. The proposed approach incorporates an objective module that can break down a complex quantum control objective into multiple sub-objectives using an exponential decay strategy, enabling the agent to gradually learn to solve the final goal through experience transfer and knowledge consolidation. Furthermore, a meta module is employed to achieve adaptation to environmental imperfections. This allows the agent to adjust its strategy in real time, obtaining strong robustness even in the presence of uncertainties. The superiority of CMQC is demonstrated in robust control problems regarding state transfer in a two-level quantum system and realization of theRx(π)R_{x}(\pi)Rx​(π)gate, with reduced computational cost and improved accuracy achieved. Our results pave the way towards more reliable and secure quantum information processing with uncertainties involved.
This paper investigates the application of reinforcement learning (RL) for adaptive quantum control. Traditional quantum control methods often rely on pre-designed pulse shapes optimized for specific scenarios, lacking adaptability to variations in system parameters or environmental noise. This work proposes a novel framework where an RL agent learns to dynamically adjust quantum control pulses in real-time, maximizing the fidelity of quantum operations. The agent receives feedback from the quantum system, typically measured through state variables, and utilizes this information to optimize the control pulse sequence. This adaptive approach addresses the limitations of static control schemes and promises enhanced robustness and performance in complex quantum systems. The core claim centers on utilizing reinforcement learning to design optimal quantum control pulses. The central mechanism involves a trained controller dynamically adjusting pulses based on system feedback. The presented methodology offers a new approach to quantum control, particularly relevant in noisy environments and systems with parameter variations. The research demonstrates the potential of RL for achieving superior quantum control outcomes compared to conventional techniques. ---
This paper investigates the optimization of quantum control algorithms using reinforcement learning (RL). The core claim is that RL can significantly enhance the control precision and efficiency of quantum devices. We propose a framework where the quantum control algorithm is treated as an intelligent agent, interacting with the quantum environment to learn optimal control strategies. This approach allows for adaptive control, addressing the challenges inherent in designing fixed control protocols for complex quantum systems. The methodology involves defining a reward function that reflects the desired quantum state evolution, using RL algorithms to train the agent, and validating the learned control strategy through simulations. We demonstrate the potential of this approach to improve control accuracy and robustness, particularly in scenarios with noisy environments or rapidly changing system parameters. The results suggest a promising direction for leveraging machine learning techniques to unlock the full potential of quantum control.
Adaptive quantum computing control is important for the stability and efficiency of quantum systems, especially in the presence of dynamic environmental noise and hardware fluctuations. We present a unified strategy for machine learning (ML) techniques to improve adaptive quantum control in two main directions: optimization speed and out-of-sample error. Here, we propose a hybrid learning method combining reinforcement learning (RL), deep neural networks (DNNs), and quantum-inspired models to actively and adaptively update quantum gate parameters and error mitigation strategies on the fly. Embedding of quantum noise models directly into the learning allows the system to predict and correct for decoherence, gate errors and measurement inaccuracy before they affect computational fidelity. Using extensive simulations as well as experimental validation on noisy intermediate-scale quantum (NISQ) processors, our improved ML model achieves a substantially higher fidelity and robustness compared to standard model-free and static control approaches. We introduce a novel feedback-loop mechanism based on online learning algorithms enabling the system to adjust for changing noise profiles and hardware drift without retraining. The optimization part uses metaheuristic methods to quickly converge to control parameters that perform well, and the error prevention mechanism features anomaly detection and prediction correction layers to minimize the effects of cumulative decoherence. The results demonstrate that our adaptive control framework can be used to not only speed up the convergence in training quantum algorithms, but also sustain the performance of gates against error at a variety of error rates with the reduction of the real-time impact of the error up to 35 %. This work highlights the promise of machine learningaugmented quantum control for improving reliability and scalability in quantum computing and serves as a stepping stone for future incorporation with fault-tolerant designs.