Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Quantum Bio-Informatics

TOWARDS QUANTUM CYBERNETICS: OPTIMAL FEEDBACK CONTROL IN QUANTUM BIO INFORMATICS

V. P. Belavkin

Published Feb 1, 2009• 1 citation
Publisher

Abstract

A brief account of the quantum information dynamics and dynamical programming methods for the purpose of optimal control in quantum cybernetics with convex constraints and cońcave cost and bequest functions of the quantum state is given. Consideration is given to both open loop and feedback control schemes corresponding respectively to deterministic and stochastic semi-Markov dynamics of stable or unstable systems. For the quantum feedback control scheme with continuous observations we exploit the separation theorem of filtering and control aspects for quantum stochastic micro-dynamics of the total system. This allows to start with the Belavkin quantum filtering equation and derive the generalized Hamilton-Jacobi-Bellman equation using standard arguments of classical control theory. This is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term if the control is restricted to only Hamiltonian terms in the filtering equation. A controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure quantum qubit state from a mixed one.

DOI
10.1142/9789814273756_0004

Related papers

Dynamical programming of continuously observed quantum systems

V. P. Belavkin, Antonio Negretti, Klaus Mølmer

We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes, which correspond, respectively, to deterministic and stochastic master equation dynamics. For the quantum feedback control scheme with continuous nondemolition observations, we exploit the separation theorem of filtering and control aspects for quantum stochastic dynamics to derive a generalized Hamilton-Jacobi-Bellman equation. If the control is restricted to only Hamiltonian terms this is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term. In this work, we consider, in particular, the case when control is restricted only to observation. A controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure state from a mixed state of a quantum two-level system.

arXiv:0805.4741•Physical Review A•Feb 27, 2009•25 citations

Quantum demolition filtering and optimal control of unstable systems

V. P. Belavkin

A brief account of the quantum information dynamics and dynamical programming methods for optimal control of quantum unstable systems is given to both open loop and feedback control schemes corresponding respectively to deterministic and stochastic semi-Markov dynamics of stable or unstable systems. For the quantum feedback control scheme, we exploit the separation theorem of filtering and control aspects as in the usual case of quantum stable systems with non-demolition observation. This allows us to start with the Belavkin quantum filtering equation generalized to demolition observations and derive the generalized Hamilton-Jacobi-Bellman equation using standard arguments of classical control theory. This is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term if the control is restricted to Hamiltonian terms in the filtering equation. An unstable controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure quantum qubit state from a mixed one.

Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences•Oct 22, 2012•2 citations

Hamilton–Jacobi–Bellman equations for quantum optimal feedback control

John Edward Gough, V. P. Belavkin, Oleg Georgievich Smolyanov

We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman equations using the elementary arguments of classical control theory and show that this is equivalent, in the Stratonovich calculus, to a stochastic Hamilton-Pontryagin setup. We show that, for cost functionals that are linear in the state, the theory yields the traditional Bellman equations treated so far in quantum feedback.

arXiv:quant-ph/0502155•Journal of Optics B Quantum and Semiclassical Optics•Sep 14, 2005•61 citations

Hamilton-jacobi-bellman equations for quantum optimal control

John Edward Gough, V.A. Belavkin, Oleg Georgievich Smolyanov

One develops a Hamilton-Jacobi-Bellman equation and a stochastic Hamilton-Jacobi-Bellman equation for quantum optimal feedback control. In this paper we do not discuss in details how to find the optimal control functions; we would like to notice only that the corresponding generalizations of the classical Pontryagin maximum principle can be obtained and used

Days on Diffraction•Jan 1, 2006•2 citations

Quantum Filtering and Optimal Control

V. P. Belavkin, Simon Edwards

Quantum mechanical systems exhibit an inherently probabilistic nature upon measurement which excludes in principle the singular direct observability case. Quantum theory of time continuous measurements and quantum filtering developed by VPB on the basis of semi-Markov independent increment models for quantum noise and quantum nondemolition (QND) observability is generalized for demolition indirect measurements of quantum unstable systems satisfying the microcausality principle. The reduced quantum feedback-controlled dynamics is described both by linear semi-Markov and nonlinear conditionally-Markov stochastic master equations. Using this scheme for diffusive and counting measurement to describe the stochastic evolution of the open quantum system under the continuous indirect observation and working in parallel with classical indeterministic control theory, we show the conditionally-Markov Bellman equations for optimal feedback control of the a posteriori stochastic quantum states conditioned upon these measurements. The resulting Bellman equation for the diffusive observation is then applied to the explicitly solvable quantum linear-quadratic-Gaussian (LQG) problem which emphasizes many similarities with the corresponding classical control problem.

Quantum Stochastics and Information•Aug 1, 2008•41 citations

Towards the theory of control in observable quantum systems

V. P. Belavkin

An operational description of the controlled Markov dynamics of quantum-mechanical system is introduced. The feedback control strategies with regard to the dynamical reduction of quantum states in the course of quantum real-time measurements are discribed in terms of quantum filtering of these states. The concept of sufficient coordinates for the description of the a posteriori quantum states from a given class is introduced, and it is proved that they form a classical Markov process with values in either state operators or state vector space. The general problem of optimal control of a quantum-mechanical system is discussed and the corresponding Bellman equation in the space of sufficient coordinates is derived. The results are illustrated in the example of control of the semigroup dynamics of a quantum system that is instantaneously observed at discrete times and evolves between measurement times according to the Schroedinger equation.

arXiv:quant-ph/0408003•Aug 1, 2004•35 citations
A brief account of the quantum information dynamics and dynamical programming methods for the purpose of optimal control in quantum cybernetics with convex constraints and cońcave cost and bequest functions of the quantum state is given. Consideration is given to both open loop and feedback control schemes corresponding respectively to deterministic and stochastic semi-Markov dynamics of stable or unstable systems. For the quantum feedback control scheme with continuous observations we exploit the separation theorem of filtering and control aspects for quantum stochastic micro-dynamics of the total system. This allows to start with the Belavkin quantum filtering equation and derive the generalized Hamilton-Jacobi-Bellman equation using standard arguments of classical control theory. This is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term if the control is restricted to only Hamiltonian terms in the filtering equation. A controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure quantum qubit state from a mixed one.
We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes, which correspond, respectively, to deterministic and stochastic master equation dynamics. For the quantum feedback control scheme with continuous nondemolition observations, we exploit the separation theorem of filtering and control aspects for quantum stochastic dynamics to derive a generalized Hamilton-Jacobi-Bellman equation. If the control is restricted to only Hamiltonian terms this is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term. In this work, we consider, in particular, the case when control is restricted only to observation. A controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure state from a mixed state of a quantum two-level system.
A brief account of the quantum information dynamics and dynamical programming methods for optimal control of quantum unstable systems is given to both open loop and feedback control schemes corresponding respectively to deterministic and stochastic semi-Markov dynamics of stable or unstable systems. For the quantum feedback control scheme, we exploit the separation theorem of filtering and control aspects as in the usual case of quantum stable systems with non-demolition observation. This allows us to start with the Belavkin quantum filtering equation generalized to demolition observations and derive the generalized Hamilton-Jacobi-Bellman equation using standard arguments of classical control theory. This is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term if the control is restricted to Hamiltonian terms in the filtering equation. An unstable controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure quantum qubit state from a mixed one.
We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman equations using the elementary arguments of classical control theory and show that this is equivalent, in the Stratonovich calculus, to a stochastic Hamilton-Pontryagin setup. We show that, for cost functionals that are linear in the state, the theory yields the traditional Bellman equations treated so far in quantum feedback.
Quantum mechanical systems exhibit an inherently probabilistic nature upon measurement which excludes in principle the singular direct observability case. Quantum theory of time continuous measurements and quantum filtering developed by VPB on the basis of semi-Markov independent increment models for quantum noise and quantum nondemolition (QND) observability is generalized for demolition indirect measurements of quantum unstable systems satisfying the microcausality principle. The reduced quantum feedback-controlled dynamics is described both by linear semi-Markov and nonlinear conditionally-Markov stochastic master equations. Using this scheme for diffusive and counting measurement to describe the stochastic evolution of the open quantum system under the continuous indirect observation and working in parallel with classical indeterministic control theory, we show the conditionally-Markov Bellman equations for optimal feedback control of the a posteriori stochastic quantum states conditioned upon these measurements. The resulting Bellman equation for the diffusive observation is then applied to the explicitly solvable quantum linear-quadratic-Gaussian (LQG) problem which emphasizes many similarities with the corresponding classical control problem.
An operational description of the controlled Markov dynamics of quantum-mechanical system is introduced. The feedback control strategies with regard to the dynamical reduction of quantum states in the course of quantum real-time measurements are discribed in terms of quantum filtering of these states. The concept of sufficient coordinates for the description of the a posteriori quantum states from a given class is introduced, and it is proved that they form a classical Markov process with values in either state operators or state vector space. The general problem of optimal control of a quantum-mechanical system is discussed and the corresponding Bellman equation in the space of sufficient coordinates is derived. The results are illustrated in the example of control of the semigroup dynamics of a quantum system that is instantaneously observed at discrete times and evolves between measurement times according to the Schroedinger equation.