Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2406.05597 · Physical Review A

Optimal control of linear Gaussian quantum systems via quantum learning control

Yu-Hong Liu, Ye‐Xiong Zeng, Qing-Shou Tan, Daoyi Dong, Franco Nori, Jie‐Qiao Liao

Published Jun 6, 2024• 11 citations
arXivHTMLPDF

Abstract

Efficiently controlling linear Gaussian quantum (LGQ) systems is a significant task in both the study of fundamental quantum theory and the development of modern quantum technology. Here, we propose a general quantum-learning-control method for optimally controlling LGQ systems based on the gradient-descent algorithm. Our approach flexibly designs the loss function for diverse tasks by utilizing first- and second-order moments that completely describe the quantum state of LGQ systems. We demonstrate both deep optomechanical cooling and large optomechanical entanglement using this approach. Our approach enables the fast and deep ground-state cooling of a mechanical resonator within a short time, surpassing the limitations of sideband cooling in the continuous-wave driven strong-coupling regime. Furthermore, optomechanical entanglement could be generated remarkably fast and surpass several times the corresponding steady-state entanglement, even when the thermal phonon occupation reaches one hundred. This work will not only broaden the application of quantum learning control, but also open an avenue for optimal control of LGQ systems.

DOI
10.1103/physreva.109.063508

Related papers

Entanglement engineering of optomechanical systems by reinforcement learning

Lili Ye, Christian Arenz, Joseph M. Lukens +1 more

Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.

arXiv:2406.04550•APL Machine Learning•Jan 17, 2025•9 citations

A gradient descent approach to optimal coherent quantum LQG controller design

Arash Kh. Sichani, Igor G. Vladimirov, Ian R. Petersen

This paper is concerned with the Coherent Quantum Linear Quadratic Gaussian (CQLQG) control problem of finding a stabilizing measurement-free quantum controller for a quantum plant so as to minimize an infinite-horizon mean square performance index for the fully quantum closed-loop system. In comparison with the observation-actuation structure of classical controllers, the coherent quantum feedback is less invasive to the quantum dynamics and quantum information. Both the plant and the controller are open quantum systems whose dynamic variables satisfy the canonical commutation relations (CCRs) of a quantum harmonic oscillator and are governed by linear quantum stochastic differential equations (QSDEs). In order to correspond to such oscillators, these QSDEs must satisfy physical realizability (PR) conditions, which are organised as quadratic constraints on the controller matrices and reflect the preservation of CCRs in time. The CQLQG problem is a constrained optimization problem for the steady-state quantum covariance matrix of the plant-controller system satisfying an algebraic Lyapunov equation. We propose a gradient descent algorithm equipped with adaptive stepsize selection for the numerical solution of the problem. The algorithm finds a local minimum of the LQG cost over the parameters of the Hamiltonian and coupling operators of a stabilizing PR quantum controller, thus taking the PR constraints into account. A convergence analysis of the proposed algorithm is presented.

arXiv:1502.00274•Proceedings of the ... American Control Conference/Proceedings of the American Control Conference•Jul 1, 2015•8 citations

Optimal Lyapunov-based quantum control for quantum systems

S. C. Hou, Muhammad Aslam Khan, X. X. Yi +2 more

Quantum Lyapunov control was developed in order to transform a quantum system from arbitrary initial states to a target state. The idea is to find control fields that steer the Lyapunov function to zero as $t\ensuremath{\rightarrow}\ensuremath{\infty}$, meanwhile the quantum system is driven to the target state. In order to shorten the time required to reach the target state, we propose two designs to optimize Lyapunov control in this paper. The first design makes the Lyapunov function decrease as fast as possible with a constraint on the total power of control fields, and the second design has the same purpose but with a constraint on each control field. Examples of a three-level system demonstrate that the evolution time for Lyapunov control can be significantly shortened, especially when high control fidelity is required. Besides, this optimal Lyapunov-based quantum control is robust against uncertainties in the free Hamiltonian and decoherence in the system compared to conventional Lyapunov control. We apply our optimal design to cool a nanomechanical resonator where a shorter cooling time is found with respect to the cooling time by the conventional Lyapunov design.

arXiv:1203.5373•Physical Review A•Aug 21, 2012•118 citations

Gradient-based optimal control of open quantum systems using quantum trajectories and automatic differentiation

Mohamed R. Abdelhafez, David Schuster, Jens Koch

We present a gradient-based optimal-control technique for open quantum systems that utilizes quantum trajectories to simulate the quantum dynamics during optimization. Using trajectories allows for optimizing open systems with less computational cost than the regular density matrix approaches in most realistic optimization problems. We introduce an improved-sampling algorithm which minimizes the number of trajectories needed per optimization iteration. Together with employing stochastic gradient descent techniques, this reduces the complexity of optimizing many realistic open quantum systems to the complexity encountered with closed systems. Our optimizer harnesses automatic differentiation to provide flexibility in optimization and to suit the different constraints and diverse parameter regimes of real-life experiments. We utilize the optimizer in a variety of applications to demonstrate how the use of quantum trajectories significantly reduces the computation complexity while achieving a multitude of simultaneous optimization targets. Demonstrated targets include high state-transfer fidelities despite dissipation, faster gate times, and maximization of qubit-readout fidelity while maintaining the quantum nondemolition nature of the measurement and allowing for subsequent fast resonator reset.

arXiv:1901.05541•Physical Review A•May 20, 2019•98 citations

Quantum gradient descent for linear systems and least squares

Iordanis Kerenidis, Anupam Prakash

Quantum machine learning and optimization are exciting new areas that have been brought forward by the breakthrough quantum algorithm of Harrow, Hassidim, and Lloyd for solving systems of linear equations. The utility of classical linear system solvers extends beyond linear algebra as they can be leveraged to solve optimization problems using iterative methods like gradient descent. In this work, we provide a quantum method for performing gradient descent when the gradient is an affine function. Performing $\ensuremath{\tau}$ steps of the gradient descent requires time $O(\ensuremath{\tau}{C}_{S})$ for weighted least-squares problems, where ${C}_{S}$ is the cost of performing one step of the gradient descent quantumly, which at times can be considerably smaller than the classical cost. We illustrate our method by providing two applications: first, for solving positive semidefinite linear systems, and, second, for performing stochastic gradient descent for the weighted least-squares problem with reduced quantum memory requirements. We also provide a quantum linear system solver in the QRAM data structure model that provides significant savings in cost for large families of matrices.

arXiv:1704.04992•Physical Review A•Feb 14, 2020•206 citations

Coherent controllers for optical-feedback cooling of quantum oscillators

Ryan Hamerly, Hideo Mabuchi

We study the cooling performance of optical-feedback controllers for open optical and mechanical resonators in the linear quadratic Gaussian setting of stochastic control theory. We utilize analysis and numerical optimization of closed-loop models based on quantum stochastic differential equations to show that coherent control schemes, where we embed the resonator in an interferometer to achieve all-optical feedback, can outperform optimal measurement-based feedback control schemes in the quantum regime of low steady-state excitation number. These performance gains are attributed to the coherent controller's ability to simultaneously process both quadratures of an optical probe field without measurement or loss of fidelity, and may guide the design of coherent feedback schemes for more general problems of robust nonlinear and robust control.

arXiv:1206.2688•Physical Review A•Jan 16, 2013•54 citations
Efficiently controlling linear Gaussian quantum (LGQ) systems is a significant task in both the study of fundamental quantum theory and the development of modern quantum technology. Here, we propose a general quantum-learning-control method for optimally controlling LGQ systems based on the gradient-descent algorithm. Our approach flexibly designs the loss function for diverse tasks by utilizing first- and second-order moments that completely describe the quantum state of LGQ systems. We demonstrate both deep optomechanical cooling and large optomechanical entanglement using this approach. Our approach enables the fast and deep ground-state cooling of a mechanical resonator within a short time, surpassing the limitations of sideband cooling in the continuous-wave driven strong-coupling regime. Furthermore, optomechanical entanglement could be generated remarkably fast and surpass several times the corresponding steady-state entanglement, even when the thermal phonon occupation reaches one hundred. This work will not only broaden the application of quantum learning control, but also open an avenue for optimal control of LGQ systems.
Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.
This paper is concerned with the Coherent Quantum Linear Quadratic Gaussian (CQLQG) control problem of finding a stabilizing measurement-free quantum controller for a quantum plant so as to minimize an infinite-horizon mean square performance index for the fully quantum closed-loop system. In comparison with the observation-actuation structure of classical controllers, the coherent quantum feedback is less invasive to the quantum dynamics and quantum information. Both the plant and the controller are open quantum systems whose dynamic variables satisfy the canonical commutation relations (CCRs) of a quantum harmonic oscillator and are governed by linear quantum stochastic differential equations (QSDEs). In order to correspond to such oscillators, these QSDEs must satisfy physical realizability (PR) conditions, which are organised as quadratic constraints on the controller matrices and reflect the preservation of CCRs in time. The CQLQG problem is a constrained optimization problem for the steady-state quantum covariance matrix of the plant-controller system satisfying an algebraic Lyapunov equation. We propose a gradient descent algorithm equipped with adaptive stepsize selection for the numerical solution of the problem. The algorithm finds a local minimum of the LQG cost over the parameters of the Hamiltonian and coupling operators of a stabilizing PR quantum controller, thus taking the PR constraints into account. A convergence analysis of the proposed algorithm is presented.
Quantum Lyapunov control was developed in order to transform a quantum system from arbitrary initial states to a target state. The idea is to find control fields that steer the Lyapunov function to zero as $t\ensuremath{\rightarrow}\ensuremath{\infty}$, meanwhile the quantum system is driven to the target state. In order to shorten the time required to reach the target state, we propose two designs to optimize Lyapunov control in this paper. The first design makes the Lyapunov function decrease as fast as possible with a constraint on the total power of control fields, and the second design has the same purpose but with a constraint on each control field. Examples of a three-level system demonstrate that the evolution time for Lyapunov control can be significantly shortened, especially when high control fidelity is required. Besides, this optimal Lyapunov-based quantum control is robust against uncertainties in the free Hamiltonian and decoherence in the system compared to conventional Lyapunov control. We apply our optimal design to cool a nanomechanical resonator where a shorter cooling time is found with respect to the cooling time by the conventional Lyapunov design.
We present a gradient-based optimal-control technique for open quantum systems that utilizes quantum trajectories to simulate the quantum dynamics during optimization. Using trajectories allows for optimizing open systems with less computational cost than the regular density matrix approaches in most realistic optimization problems. We introduce an improved-sampling algorithm which minimizes the number of trajectories needed per optimization iteration. Together with employing stochastic gradient descent techniques, this reduces the complexity of optimizing many realistic open quantum systems to the complexity encountered with closed systems. Our optimizer harnesses automatic differentiation to provide flexibility in optimization and to suit the different constraints and diverse parameter regimes of real-life experiments. We utilize the optimizer in a variety of applications to demonstrate how the use of quantum trajectories significantly reduces the computation complexity while achieving a multitude of simultaneous optimization targets. Demonstrated targets include high state-transfer fidelities despite dissipation, faster gate times, and maximization of qubit-readout fidelity while maintaining the quantum nondemolition nature of the measurement and allowing for subsequent fast resonator reset.
Quantum machine learning and optimization are exciting new areas that have been brought forward by the breakthrough quantum algorithm of Harrow, Hassidim, and Lloyd for solving systems of linear equations. The utility of classical linear system solvers extends beyond linear algebra as they can be leveraged to solve optimization problems using iterative methods like gradient descent. In this work, we provide a quantum method for performing gradient descent when the gradient is an affine function. Performing $\ensuremath{\tau}$ steps of the gradient descent requires time $O(\ensuremath{\tau}{C}_{S})$ for weighted least-squares problems, where CS{C}_{S}CS​ is the cost of performing one step of the gradient descent quantumly, which at times can be considerably smaller than the classical cost. We illustrate our method by providing two applications: first, for solving positive semidefinite linear systems, and, second, for performing stochastic gradient descent for the weighted least-squares problem with reduced quantum memory requirements. We also provide a quantum linear system solver in the QRAM data structure model that provides significant savings in cost for large families of matrices.
We study the cooling performance of optical-feedback controllers for open optical and mechanical resonators in the linear quadratic Gaussian setting of stochastic control theory. We utilize analysis and numerical optimization of closed-loop models based on quantum stochastic differential equations to show that coherent control schemes, where we embed the resonator in an interferometer to achieve all-optical feedback, can outperform optimal measurement-based feedback control schemes in the quantum regime of low steady-state excitation number. These performance gains are attributed to the coherent controller's ability to simultaneously process both quadratures of an optical probe field without measurement or loss of fidelity, and may guide the design of coherent feedback schemes for more general problems of robust nonlinear and robust control.