Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:quant-ph/0502155 · Journal of Optics B Quantum and Semiclassical Optics

Hamilton–Jacobi–Bellman equations for quantum optimal feedback control

John Edward Gough, V. P. Belavkin, Oleg Georgievich Smolyanov

Published Sep 14, 2005• 61 citations
arXivHTMLPDF

Abstract

We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman equations using the elementary arguments of classical control theory and show that this is equivalent, in the Stratonovich calculus, to a stochastic Hamilton-Pontryagin setup. We show that, for cost functionals that are linear in the state, the theory yields the traditional Bellman equations treated so far in quantum feedback.

DOI
10.1088/1464-4266/7/10/006

Related papers

Hamilton-jacobi-bellman equations for quantum optimal control

John Edward Gough, V.A. Belavkin, Oleg Georgievich Smolyanov

One develops a Hamilton-Jacobi-Bellman equation and a stochastic Hamilton-Jacobi-Bellman equation for quantum optimal feedback control. In this paper we do not discuss in details how to find the optimal control functions; we would like to notice only that the corresponding generalizations of the classical Pontryagin maximum principle can be obtained and used

Days on Diffraction•Jan 1, 2006•2 citations

TOWARDS QUANTUM CYBERNETICS: OPTIMAL FEEDBACK CONTROL IN QUANTUM BIO INFORMATICS

V. P. Belavkin

A brief account of the quantum information dynamics and dynamical programming methods for the purpose of optimal control in quantum cybernetics with convex constraints and cońcave cost and bequest functions of the quantum state is given. Consideration is given to both open loop and feedback control schemes corresponding respectively to deterministic and stochastic semi-Markov dynamics of stable or unstable systems. For the quantum feedback control scheme with continuous observations we exploit the separation theorem of filtering and control aspects for quantum stochastic micro-dynamics of the total system. This allows to start with the Belavkin quantum filtering equation and derive the generalized Hamilton-Jacobi-Bellman equation using standard arguments of classical control theory. This is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term if the control is restricted to only Hamiltonian terms in the filtering equation. A controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure quantum qubit state from a mixed one.

Quantum Bio-Informatics•Feb 1, 2009•1 citation

Optimal control equation for quantum stochastic differential equations

Javad Sharifi, Hamidreza Momeni

Interaction of open quantum systems with fundamental noncommutative quantum noises can be described by quantum stochastic differential equations (QSDE). These equations have a key role in quantum network analysis and design, especially for quantum information processing. Hence, in this paper, we derive a Hamilton-Jacobi-Bellman equation for quantum stochastic differential equations. The Bellman optimality principle is developed for open quantum systems. The cost functional of quantum observable to be minimized is considered to be general noncommutative polynomial of quantum operator. Since the method directly deals with QSDE, then it is a useful tool for optimal control of quantum optical networks. In addition, we will exhibit some electro-optical and all-optical feedback control schematics for implementation of quantum control based on QSDEs.

IEEE Conference on Decision and Control (CDC)•Dec 1, 2010•2 citations

Optimal Quantum Feedback Control for Canonical Observables

John Edward Gough

We show that the stochastic Schrodinger equation for the filtered state of a system, with linear free dynamics, undergoing continual non-demolition measurement or either position or momentum, or both together, can be solved explicitly within a class of Gaussian states which we call extended coherent states. The asymptotic limit yields a class of relaxed states which we describe explicitly. Bellman's principle is then applied directly to optimal feedback control of such dynamical systems and the Hamilton Jacobi Bellman equation for the minimum cost is derived. The situation of quadratic performance criteria is treated as the important special case and solved exactly for the class of relaxed states.

arXiv:quant-ph/0504099•Apr 13, 2005•2 citations

Optimal Quantum Filtering and Quantum Feedback Control

Simon Edwards, V. P. Belavkin

Quantum mechanical systems exhibit an inherently probabilistic nature upon measurement. Using a quantum noise model to describe the stochastic evolution of the open quantum system and working in parallel with classical indeterministic control theory, we present the theory of nonlinear optimal quantum feedback control. The resulting quantum Bellman equation is then applied to the explicitly solvable quantum linear-quadratic-Gaussian (LQG) problem which emphasizes many similarities with the corresponding classical control problem.

arXiv:quant-ph/0506018•Jun 2, 2005•115 citations

Hamilton-Jacobi-Bellman equations for quantum control

MO Ogundiran, Philip Oladapo Olanrewaju

The aim of this work is to study Hamilton-Jacobi-Bellman equation for quantum control driven by quantum noises. These noises are annhihilation, creation and gauge processes. We shall consider the solutions of Hamilton-Jacobi-Bellman equation via the Hamiltonian system measurable in time. JONAMP Vol. 11 2007: pp. 525-528

Journal of the Nigerian Association of Mathematical Physics•Jun 13, 2008•0 citations
We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman equations using the elementary arguments of classical control theory and show that this is equivalent, in the Stratonovich calculus, to a stochastic Hamilton-Pontryagin setup. We show that, for cost functionals that are linear in the state, the theory yields the traditional Bellman equations treated so far in quantum feedback.
A brief account of the quantum information dynamics and dynamical programming methods for the purpose of optimal control in quantum cybernetics with convex constraints and cońcave cost and bequest functions of the quantum state is given. Consideration is given to both open loop and feedback control schemes corresponding respectively to deterministic and stochastic semi-Markov dynamics of stable or unstable systems. For the quantum feedback control scheme with continuous observations we exploit the separation theorem of filtering and control aspects for quantum stochastic micro-dynamics of the total system. This allows to start with the Belavkin quantum filtering equation and derive the generalized Hamilton-Jacobi-Bellman equation using standard arguments of classical control theory. This is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term if the control is restricted to only Hamiltonian terms in the filtering equation. A controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure quantum qubit state from a mixed one.
Interaction of open quantum systems with fundamental noncommutative quantum noises can be described by quantum stochastic differential equations (QSDE). These equations have a key role in quantum network analysis and design, especially for quantum information processing. Hence, in this paper, we derive a Hamilton-Jacobi-Bellman equation for quantum stochastic differential equations. The Bellman optimality principle is developed for open quantum systems. The cost functional of quantum observable to be minimized is considered to be general noncommutative polynomial of quantum operator. Since the method directly deals with QSDE, then it is a useful tool for optimal control of quantum optical networks. In addition, we will exhibit some electro-optical and all-optical feedback control schematics for implementation of quantum control based on QSDEs.
We show that the stochastic Schrodinger equation for the filtered state of a system, with linear free dynamics, undergoing continual non-demolition measurement or either position or momentum, or both together, can be solved explicitly within a class of Gaussian states which we call extended coherent states. The asymptotic limit yields a class of relaxed states which we describe explicitly. Bellman's principle is then applied directly to optimal feedback control of such dynamical systems and the Hamilton Jacobi Bellman equation for the minimum cost is derived. The situation of quadratic performance criteria is treated as the important special case and solved exactly for the class of relaxed states.
Quantum mechanical systems exhibit an inherently probabilistic nature upon measurement. Using a quantum noise model to describe the stochastic evolution of the open quantum system and working in parallel with classical indeterministic control theory, we present the theory of nonlinear optimal quantum feedback control. The resulting quantum Bellman equation is then applied to the explicitly solvable quantum linear-quadratic-Gaussian (LQG) problem which emphasizes many similarities with the corresponding classical control problem.