Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

IEEE International Conference on Cybernetics (CYBCONF)

A Learning-Enabled Framework for Hamiltonian and Dissipative Control in Measurement-Based Quantum Feedback

Shengyong Li, Weichao Liang, Pengtao Song, Qianchuan Zhao, Jing Zhang

Published Apr 1, 2026• 0 citations
Publisher

Abstract

We develop a learning-based framework for designing measurement-based quantum feedback control in open quantum systems governed by stochastic master equations. By discretizing the continuous dynamics and parameterizing both coherent drives (Hamiltonian controls) and measurement strengths as differentiable feedback policies, we construct a fully end-to-end optimization pipeline compatible with modern automatic differentiation. As a result, feedback policies can be learned efficiently using gradient information, avoiding handcrafted rules and exhaustive parameter searches. We demonstrate the approach on a qubit stabilization task under continuous homodyne measurement and energy dissipation. In the absence of energy dissipation, jointly learning coherent drive strengths and measurement strengths yields faster convergence and lowers the final infidelity around the target state than optimizing coherent drive strengths alone. With moderate dissipation, the learned feedback approach significantly reduces the steady-state infidelity. Parameter sweeps show that increasing the available coherent drive strength improves performance more than increasing the maximum measurement strength. Finally, we analyze robustness to imperfect state estimation, including additive noise and information delay modeled via exponential smoothing, and find that state stabilization remains effective over a broad range of imperfections. These results highlight the promise of gradientbased learning as a practical tool for synthesizing real-time quantum feedback strategies.

DOI
10.1109/cybconf69298.2026.11670264

Related papers

Measurement-Based Feedback of Open Quantum Systems: A Control-Theoretic Review and Tutorial

Weichao Liang, Jing Zhang, Gaoyue Guo +1 more

This review develops a control-theoretic perspective on measurement-based feedback for continuously monitored open quantum systems, with the main analysis focused on finite-dimensional systems governed by diffusive stochastic master equations. We introduce the relevant state-space, invariant-subspace, and quantum non-demolition structures, interpret quantum filtering as nonlinear observer dynamics, and review open-loop asymptotics, filter stability, state-feedback stabilization, robustness, and reduced-order observer-based control. Particular emphasis is placed on a recurrence--contraction framework, in which Hamiltonian feedback removes non-target invariant obstructions while measurement-induced dynamics provide local exponential contraction. Although the detailed analysis is developed for finite-dimensional diffusive models, the underlying measurement--estimation--feedback architecture is relevant across a broad range of quantum platforms. We further discuss implementation challenges and open problems involving scalable estimation, sampling and delay, adaptation, hybrid and non-Markovian dynamics, practical stability, optimal control, and learning-based design. By organizing these developments around invariance, estimation, recurrence, and contraction, the review provides a tutorial bridge between measurement-based quantum feedback and nonlinear stochastic control.

quant-pharXiv:2609.06111•Sep 8, 2026•0 citations

Stabilization of Time-Varying Perturbed Quantum Systems via Reduced Filters

Weichao Liang, Daoyi Dong

In practical applications, quantum systems are inevitably subject to significant uncertainties, including unknown initial states, imprecise physical parameters, and unmodeled environmental noise, all of which pose major challenges to robust quantum feedback control. This paper proposes a feedback stabilization strategy based on a reduced quantum filter that achieves robustness against time-varying Hamiltonian perturbations and additional dissipative effects, without requiring prior knowledge of the initial state or exact system parameters. The proposed filter estimates only O(N) real variables corresponding to the diagonal elements of the system density matrix in a quantum non-demolition basis in contrast to the O(N^2) variables required by a full stochastic master equation, where N is the Hilbert space dimension. This dimensionality reduction substantially simplifies real-time computation and feedback implementation while preserving both convergence and robustness guarantees. Rigorous analysis further establishes global exponential stability of the target subspace. The results provide a scalable framework for robust and efficient measurement-based feedback control applicable to high-dimensional perturbed open quantum systems.

math-phCross-listedarXiv:2511.07949•Nov 12, 2025•3 citations

Quantum Filtering and Stabilization of Dissipative Quantum Systems via Augmented Neural Ordinary Differential Equations

Qamar, Shahid, Mushtaq Rana Imran, Bo Li +1 more

Modeling open quantum dynamics without full knowledge of the system Hamiltonian or noise model is a key challenge in quantum control and quantum state estimation. We introduce an Augmented Quantum Neural Ordinary Differential Equation (AQNODE) framework that learns quantum trajectories and dissipation parameters directly from partial continuous measurement data. By embedding the system into a latent space evolved via neural ODEs, AQNODE captures both observable and hidden non-Markovian dynamics with temporal smoothness and physical consistency. Our approach integrates weak measurement data to reconstruct qubit states and time-dependent decoherence rates, enabling accurate state prediction and parameter inference without explicit physical equations. Furthermore, we incorporate AQNODE-based feedback control techniques, including proportional-derivative and time-varying linear-quadratic regulator (LQR) strategies, to steer the quantum system toward target states in real time. Extensive numerical simulations demonstrate AQNODE's ability to generalize across system configurations, achieve low prediction errors, and perform robust quantum filtering and control. These results establish AQNODE as a scalable, differentiable, and experimentally compatible framework for real-time modeling and control of dissipative quantum systems.

arXiv:2509.07196•Sep 8, 2025•0 citations

Fast State Stabilization Using Deep Reinforcement Learning for Measurement-Based Quantum Feedback Control

Chunxiang Song, Yanan Liu, Daoyi Dong +1 more

The stabilization of quantum states is a fundamental problem for realizing various quantum technologies. Measurement-based-feedback strategies have demonstrated powerful performance, and the construction of quantum control signals using measurement information has attracted great interest. However, the interaction between quantum systems and the environment is inevitable, especially when measurements are introduced, which leads to decoherence. To mitigate decoherence, it is desirable to stabilize quantum systems faster, thereby reducing the time of interaction with the environment. In this paper, we utilize information obtained from measurement and apply deep reinforcement learning (DRL) algorithms, without explicitly constructing specific complex measurement-control mappings, to rapidly drive random initial quantum state to the target state. The proposed DRL algorithm has the ability to speed up the convergence to a target state, which shortens the interaction between quantum systems and their environments to protect coherence. Simulations are performed on two-qubit and three-qubit systems, and the results show that our algorithm can successfully stabilize random initial quantum system to the target entangled state, with a convergence time faster than traditional methods such as Lyapunov feedback control and several DRL algorithms with different reward functions. Moreover, it exhibits robustness against imperfect measurements and delays in system evolution.

arXiv:2408.11328•IEEE Transactions on Quantum Engineering•Jan 1, 2025•5 citations

Continuous Quantum Feedback Control via Kraus-Parameterized Belief Reinforcement Learning

Priyanshi Singh, Krishna Bhatia

Quantum feedback control requires acting on noisy continuous measurement records without direct access to the underlying quantum state. We propose Kraus-Parameterized Belief Reinforcement Learning, a pipeline in which a recurrent encoder, constrained to the Stiefel manifold, produces density-matrix estimates that are guaranteed positive-semidefinite and trace-normalized by construction, embedding quantum state geometry directly into the learning loop. A Proximal Policy Optimization (PPO) actor then maps these physically valid belief states to continuous control actions. On a simulated continuously monitored qubit, the resulting policy achieves stable feedback control, maintaining a measurement-conditioned belief fidelity of approximately 0.77-0.80 and exhibiting substantially lower return variance than a parameter-matched LSTM-history baseline across both nominal and out-of-distribution conditions. Although gains in raw target fidelity are modest, the geometric constraint guarantees a physically valid, interpretable belief representation and yields markedly more stable control under measurement inefficiency and abrupt dynamics switches. These results indicate that physics-informed neural memory is a practical inductive bias for reliable quantum feedback control.

quant-pharXiv:2608.15715•Aug 18, 2026•0 citations

Control of stochastic quantum dynamics by differentiable programming

Frank Schäfer, Pavel Sekatski, Martin Koppenhöfer +2 more

Abstract Control of the stochastic dynamics of a quantum system is indispensable in fields such as quantum information processing and metrology. However, there is no general ready-made approach to the design of efficient control strategies. Here, we propose a framework for the automated design of control schemes based on differentiable programming. We apply this approach to the state preparation and stabilization of a qubit subjected to homodyne detection. To this end, we formulate the control task as an optimization problem where the loss function quantifies the distance from the target state, and we employ neural networks (NNs) as controllers. The system’s time evolution is governed by a stochastic differential equation (SDE). To implement efficient training, we backpropagate the gradient information from the loss function through the SDE solver using adjoint sensitivity methods. As a first example, we feed the quantum state to the controller and focus on different methods of obtaining gradients. As a second example, we directly feed the homodyne detection signal to the controller. The instantaneous value of the homodyne current contains only very limited information on the actual state of the system, masked by unavoidable photon-number fluctuations. Despite the resulting poor signal-to-noise ratio, we can train our controller to prepare and stabilize the qubit to a target state with a mean fidelity of around 85%. We also compare the solutions found by the NN to a hand-crafted control strategy.

arXiv:2101.01190•Machine Learning Science and Technology•Mar 4, 2021•21 citations
We develop a learning-based framework for designing measurement-based quantum feedback control in open quantum systems governed by stochastic master equations. By discretizing the continuous dynamics and parameterizing both coherent drives (Hamiltonian controls) and measurement strengths as differentiable feedback policies, we construct a fully end-to-end optimization pipeline compatible with modern automatic differentiation. As a result, feedback policies can be learned efficiently using gradient information, avoiding handcrafted rules and exhaustive parameter searches. We demonstrate the approach on a qubit stabilization task under continuous homodyne measurement and energy dissipation. In the absence of energy dissipation, jointly learning coherent drive strengths and measurement strengths yields faster convergence and lowers the final infidelity around the target state than optimizing coherent drive strengths alone. With moderate dissipation, the learned feedback approach significantly reduces the steady-state infidelity. Parameter sweeps show that increasing the available coherent drive strength improves performance more than increasing the maximum measurement strength. Finally, we analyze robustness to imperfect state estimation, including additive noise and information delay modeled via exponential smoothing, and find that state stabilization remains effective over a broad range of imperfections. These results highlight the promise of gradientbased learning as a practical tool for synthesizing real-time quantum feedback strategies.
This review develops a control-theoretic perspective on measurement-based feedback for continuously monitored open quantum systems, with the main analysis focused on finite-dimensional systems governed by diffusive stochastic master equations. We introduce the relevant state-space, invariant-subspace, and quantum non-demolition structures, interpret quantum filtering as nonlinear observer dynamics, and review open-loop asymptotics, filter stability, state-feedback stabilization, robustness, and reduced-order observer-based control. Particular emphasis is placed on a recurrence--contraction framework, in which Hamiltonian feedback removes non-target invariant obstructions while measurement-induced dynamics provide local exponential contraction. Although the detailed analysis is developed for finite-dimensional diffusive models, the underlying measurement--estimation--feedback architecture is relevant across a broad range of quantum platforms. We further discuss implementation challenges and open problems involving scalable estimation, sampling and delay, adaptation, hybrid and non-Markovian dynamics, practical stability, optimal control, and learning-based design. By organizing these developments around invariance, estimation, recurrence, and contraction, the review provides a tutorial bridge between measurement-based quantum feedback and nonlinear stochastic control.
In practical applications, quantum systems are inevitably subject to significant uncertainties, including unknown initial states, imprecise physical parameters, and unmodeled environmental noise, all of which pose major challenges to robust quantum feedback control. This paper proposes a feedback stabilization strategy based on a reduced quantum filter that achieves robustness against time-varying Hamiltonian perturbations and additional dissipative effects, without requiring prior knowledge of the initial state or exact system parameters. The proposed filter estimates only O(N) real variables corresponding to the diagonal elements of the system density matrix in a quantum non-demolition basis in contrast to the O(N^2) variables required by a full stochastic master equation, where N is the Hilbert space dimension. This dimensionality reduction substantially simplifies real-time computation and feedback implementation while preserving both convergence and robustness guarantees. Rigorous analysis further establishes global exponential stability of the target subspace. The results provide a scalable framework for robust and efficient measurement-based feedback control applicable to high-dimensional perturbed open quantum systems.
Modeling open quantum dynamics without full knowledge of the system Hamiltonian or noise model is a key challenge in quantum control and quantum state estimation. We introduce an Augmented Quantum Neural Ordinary Differential Equation (AQNODE) framework that learns quantum trajectories and dissipation parameters directly from partial continuous measurement data. By embedding the system into a latent space evolved via neural ODEs, AQNODE captures both observable and hidden non-Markovian dynamics with temporal smoothness and physical consistency. Our approach integrates weak measurement data to reconstruct qubit states and time-dependent decoherence rates, enabling accurate state prediction and parameter inference without explicit physical equations. Furthermore, we incorporate AQNODE-based feedback control techniques, including proportional-derivative and time-varying linear-quadratic regulator (LQR) strategies, to steer the quantum system toward target states in real time. Extensive numerical simulations demonstrate AQNODE's ability to generalize across system configurations, achieve low prediction errors, and perform robust quantum filtering and control. These results establish AQNODE as a scalable, differentiable, and experimentally compatible framework for real-time modeling and control of dissipative quantum systems.
The stabilization of quantum states is a fundamental problem for realizing various quantum technologies. Measurement-based-feedback strategies have demonstrated powerful performance, and the construction of quantum control signals using measurement information has attracted great interest. However, the interaction between quantum systems and the environment is inevitable, especially when measurements are introduced, which leads to decoherence. To mitigate decoherence, it is desirable to stabilize quantum systems faster, thereby reducing the time of interaction with the environment. In this paper, we utilize information obtained from measurement and apply deep reinforcement learning (DRL) algorithms, without explicitly constructing specific complex measurement-control mappings, to rapidly drive random initial quantum state to the target state. The proposed DRL algorithm has the ability to speed up the convergence to a target state, which shortens the interaction between quantum systems and their environments to protect coherence. Simulations are performed on two-qubit and three-qubit systems, and the results show that our algorithm can successfully stabilize random initial quantum system to the target entangled state, with a convergence time faster than traditional methods such as Lyapunov feedback control and several DRL algorithms with different reward functions. Moreover, it exhibits robustness against imperfect measurements and delays in system evolution.
Quantum feedback control requires acting on noisy continuous measurement records without direct access to the underlying quantum state. We propose Kraus-Parameterized Belief Reinforcement Learning, a pipeline in which a recurrent encoder, constrained to the Stiefel manifold, produces density-matrix estimates that are guaranteed positive-semidefinite and trace-normalized by construction, embedding quantum state geometry directly into the learning loop. A Proximal Policy Optimization (PPO) actor then maps these physically valid belief states to continuous control actions. On a simulated continuously monitored qubit, the resulting policy achieves stable feedback control, maintaining a measurement-conditioned belief fidelity of approximately 0.77-0.80 and exhibiting substantially lower return variance than a parameter-matched LSTM-history baseline across both nominal and out-of-distribution conditions. Although gains in raw target fidelity are modest, the geometric constraint guarantees a physically valid, interpretable belief representation and yields markedly more stable control under measurement inefficiency and abrupt dynamics switches. These results indicate that physics-informed neural memory is a practical inductive bias for reliable quantum feedback control.
Abstract Control of the stochastic dynamics of a quantum system is indispensable in fields such as quantum information processing and metrology. However, there is no general ready-made approach to the design of efficient control strategies. Here, we propose a framework for the automated design of control schemes based on differentiable programming. We apply this approach to the state preparation and stabilization of a qubit subjected to homodyne detection. To this end, we formulate the control task as an optimization problem where the loss function quantifies the distance from the target state, and we employ neural networks (NNs) as controllers. The system’s time evolution is governed by a stochastic differential equation (SDE). To implement efficient training, we backpropagate the gradient information from the loss function through the SDE solver using adjoint sensitivity methods. As a first example, we feed the quantum state to the controller and focus on different methods of obtaining gradients. As a second example, we directly feed the homodyne detection signal to the controller. The instantaneous value of the homodyne current contains only very limited information on the actual state of the system, masked by unavoidable photon-number fluctuations. Despite the resulting poor signal-to-noise ratio, we can train our controller to prepare and stabilize the qubit to a target state with a mean fidelity of around 85%. We also compare the solutions found by the NN to a hand-crafted control strategy.