Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:quant-ph/0508138 · Physical Review A

Jensen-Shannon divergence as a measure of distinguishability between mixed quantum states

A. P. Majtey, Pedro W. Lamberti, Domingo P. Prato

Published Nov 11, 2005• 230 citations
arXivHTMLPDF

Abstract

We discuss an alternative to relative entropy as a measure of distance between mixed quantum states. The proposed quantity is an extension to the realm of quantum theory of the Jensen-Shannon divergence (JSD) between probability distributions. The JSD has several interesting properties. It arises in information theory and, unlike the Kullback-Leibler divergence, it is symmetric, always well-defined, and bounded. We show that the quantum JSD shares with the relative entropy most of the physically relevant properties, in particular those required for a ``good'' quantum distinguishability measure. We relate it to other known quantum distances and we suggest possible applications in the field of the quantum information theory.

DOI
10.1103/physreva.72.052310

Related papers

Jensen-Shannon Divergence: A Multipurpose Distance for Statistical and Quantum Mechanics

Pedro W. Lamberti, A. P. Majtey, Marcos A. Madrid +1 more

Many problems of statistical and quantum mechanics can be established in terms of a distance; in the first case the distance is usually defined between probability distributions; in the second one, between quantum states. The present work is devoted to review the main properties of a distance known as the Jensen‐Shannon divergence (JSD) in its classical and quantum version. We present two examples of application of this distance: in the first one we use it as a quantifiers of the stochastic resonance phenomenon in ion channels; in the second one we use the JSD to propose a geometrical view of entanglement for two qubits states.

AIP conference proceedings•Jan 1, 2007•14 citations

Properties of classical and quantum Jensen-Shannon divergence

Jop Briët, Peter Harremoës

Jensen-Shannon divergence (JD) is a symmetrized and smoothed version of the most important divergence measure of information theory, Kullback divergence. As opposed to Kullback divergence it determines in a very direct way a metric; indeed, it is the square of a metric. We consider a family of divergence measures (${\text{JD}}_{\ensuremath{\alpha}}$ for $\ensuremath{\alpha}>0$), the Jensen divergences of order $\ensuremath{\alpha}$, which generalize JD as ${\text{JD}}_{1}=\text{JD}$. Using a result of Schoenberg, we prove that ${\text{JD}}_{\ensuremath{\alpha}}$ is the square of a metric for $\ensuremath{\alpha}∊(0,2]$, and that the resulting metric space of probability distributions can be isometrically embedded in a real Hilbert space. Quantum Jensen-Shannon divergence (QJD) is a symmetrized and smoothed version of quantum relative entropy and can be extended to a family of quantum Jensen divergences of order $\ensuremath{\alpha}$ $({\text{QJD}}_{\ensuremath{\alpha}})$. We strengthen results by Lamberti and co-workers by proving that for qubits and pure states, ${\text{QJD}}_{\ensuremath{\alpha}}^{1/2}$ is a metric space which can be isometrically embedded in a real Hilbert space when $\ensuremath{\alpha}∊(0,2]$. In analogy with Burbea and Rao's generalization of JD, we also define general QJD by associating a Jensen-type quantity to any weighted family of states. Appropriate interpretations of quantities introduced are discussed and bounds are derived in terms of the total variation and trace distance.

arXiv:0806.4472•Physical Review A•May 12, 2009•219 citations

Metric character of the quantum Jensen-Shannon divergence

Pedro W. Lamberti, A. P. Majtey, Antoni Borràs +2 more

In a recent paper, the generalization of the Jensen-Shannon divergence in the context of quantum theory has been studied [Majtey et al., Phys. Rev. A 72, 052310 (2005)]. This distance between quantum states has shown to verify several of the properties required for a good distinguishability measure. Here we investigate the metric character of this distance. More precisely we show, formally for pure states and by means of a numerical procedure for mixed states, that its square root verifies the triangle inequality.

arXiv:0801.1586•Physical Review A•May 9, 2008•155 citations

Distances Measures for Probability Distributions

Many problems of statistical and quantum mechanics can be established in terms of a distance between probability distributions. The present work is devoted to review some of the most relevant applications of the notion of distance in the context of statistical mechanics, quantum mechanics and information theory. Although we make a general overview of the most frequently used distances between probability distributions, we will center our presentation in a distance known as the Jensen-Shannon divergence both in their classical and quantum versions. For the classical one we present its main properties and we discuss its relevance as a segmentation tool for symbolic sequences. In the quantum case we show that the quantum Jensen-Shannon divergence is an adequate measure of entanglement.

BENTHAM SCIENCE PUBLISHERS eBooks•Dec 11, 2013•1 citation

JENSEN–SHANNON DIVERGENCE AS A MEASURE OF THE DEGREE OF ENTANGLEMENT

A. P. Majtey, Antoni Borràs, Montserrat Casas +2 more

The notion of distance in Hilbert space is relevant in many scenarios. In particular, "distances" between quantum states play a central role in quantum information theory. An appropriate measure of distance is the quantum Jensen Shannon divergence (QJSD) between quantum states. Here we study this distance as a geometrical measure of entanglement and apply it to different families of states.

arXiv:0804.3662•International Journal of Quantum Information•Jul 1, 2008•20 citations

Classical and quantum relative entropy

Patrícia Szokol

The concept of entropy rst arose in the study of thermodynamics and statistical me- chanics. In information theory the so-called Shannon entropy plays a signi cant role, which measures how much information we gain, on average, when we learn the value of a random variable. An alternative interpretation is that the entropy of the random variable quanti es the amount of uncertainty about the random variable before we learn its value. The concept was introduced by Claude E. Shannon in his 1948 paper "A Mathematical Theory of Communication". In the rst part of the present work we consider this fundamental measure of information and show some of its properties, such as non-negativity. The relative entropy or the Kullback-Leibler divergence is a very useful measure of the distance between two prob- ability distributions. After introducing its de nition and other notions (joint entropy, conditional entropy or mutual information) we can prove additional assertions about the Shannon entropy and present statements about the relations between the above men- tioned quantities. In quantum information theory, there is a quantity, namely von Neumann entropy, which corresponds to Shannon entropy and originates from it. In the section Von Neu- mann entropy we will introduce this quantity which is a continuous functional on the states, or on their mathematical representatives, the density operators, and it ful ls in- equalities such as subadditivity and strong subaddititvity. Just as with the Shannon entropy, it is extremely useful to de ne a quantum version of the relative entropy, which is one of the most important numerical quantities appearing in quantum information theory. It is used as a measure of distinguishability between quantum states. Among others its properties are jointly convexity, monotonicity which are speci cally convenient. Transformations on structures which preserve operations, quantities or relations among elements appear in many areas of mathematics. These are the so-called preservers which show up also in physics and even in chemistry where they are usually called symmetries. Therefore, the study of preserver transformations is an important area of research. The third section of this work is based on a paper, in which Lajos Molnár described the structure every bijective map on the space of all density operators on a given Hilbert space, which preserves the relative entropy. This result is closely related to Wigner's famous theorem on the form of quantum mechanical symmetry transformations. The above theorem of Molnár can be extended into two directions. On the one hand, the result holds also in the case when the transformation under consideration acts on the space of all positive semide nite operators not only on density operators (i.e., we omit the condition of unit trace). On the other hand the statement remains valid even if we omit the strongly restrictive condition that the transformation is bijective. The second result is a joint work with Prof. Lajos Molnár which appeared in the journal Linear Algebra and Its Applications.

•May 6, 2010•0 citations
We discuss an alternative to relative entropy as a measure of distance between mixed quantum states. The proposed quantity is an extension to the realm of quantum theory of the Jensen-Shannon divergence (JSD) between probability distributions. The JSD has several interesting properties. It arises in information theory and, unlike the Kullback-Leibler divergence, it is symmetric, always well-defined, and bounded. We show that the quantum JSD shares with the relative entropy most of the physically relevant properties, in particular those required for a ``good'' quantum distinguishability measure. We relate it to other known quantum distances and we suggest possible applications in the field of the quantum information theory.
Many problems of statistical and quantum mechanics can be established in terms of a distance; in the first case the distance is usually defined between probability distributions; in the second one, between quantum states. The present work is devoted to review the main properties of a distance known as the Jensen‐Shannon divergence (JSD) in its classical and quantum version. We present two examples of application of this distance: in the first one we use it as a quantifiers of the stochastic resonance phenomenon in ion channels; in the second one we use the JSD to propose a geometrical view of entanglement for two qubits states.
Jensen-Shannon divergence (JD) is a symmetrized and smoothed version of the most important divergence measure of information theory, Kullback divergence. As opposed to Kullback divergence it determines in a very direct way a metric; indeed, it is the square of a metric. We consider a family of divergence measures (${\text{JD}}_{\ensuremath{\alpha}}$ for $\ensuremath{\alpha}>0$), the Jensen divergences of order $\ensuremath{\alpha}$, which generalize JD as JD1=JD{\text{JD}}_{1}=\text{JD}JD1​=JD. Using a result of Schoenberg, we prove that ${\text{JD}}_{\ensuremath{\alpha}}$ is the square of a metric for $\ensuremath{\alpha}∊(0,2]$, and that the resulting metric space of probability distributions can be isometrically embedded in a real Hilbert space. Quantum Jensen-Shannon divergence (QJD) is a symmetrized and smoothed version of quantum relative entropy and can be extended to a family of quantum Jensen divergences of order $\ensuremath{\alpha}$ $({\text{QJD}}_{\ensuremath{\alpha}})$. We strengthen results by Lamberti and co-workers by proving that for qubits and pure states, ${\text{QJD}}_{\ensuremath{\alpha}}^{1/2}$ is a metric space which can be isometrically embedded in a real Hilbert space when $\ensuremath{\alpha}∊(0,2]$. In analogy with Burbea and Rao's generalization of JD, we also define general QJD by associating a Jensen-type quantity to any weighted family of states. Appropriate interpretations of quantities introduced are discussed and bounds are derived in terms of the total variation and trace distance.
In a recent paper, the generalization of the Jensen-Shannon divergence in the context of quantum theory has been studied [Majtey et al., Phys. Rev. A 72, 052310 (2005)]. This distance between quantum states has shown to verify several of the properties required for a good distinguishability measure. Here we investigate the metric character of this distance. More precisely we show, formally for pure states and by means of a numerical procedure for mixed states, that its square root verifies the triangle inequality.
Many problems of statistical and quantum mechanics can be established in terms of a distance between probability distributions. The present work is devoted to review some of the most relevant applications of the notion of distance in the context of statistical mechanics, quantum mechanics and information theory. Although we make a general overview of the most frequently used distances between probability distributions, we will center our presentation in a distance known as the Jensen-Shannon divergence both in their classical and quantum versions. For the classical one we present its main properties and we discuss its relevance as a segmentation tool for symbolic sequences. In the quantum case we show that the quantum Jensen-Shannon divergence is an adequate measure of entanglement.
The concept of entropy rst arose in the study of thermodynamics and statistical me- chanics. In information theory the so-called Shannon entropy plays a signi cant role, which measures how much information we gain, on average, when we learn the value of a random variable. An alternative interpretation is that the entropy of the random variable quanti es the amount of uncertainty about the random variable before we learn its value. The concept was introduced by Claude E. Shannon in his 1948 paper "A Mathematical Theory of Communication". In the rst part of the present work we consider this fundamental measure of information and show some of its properties, such as non-negativity. The relative entropy or the Kullback-Leibler divergence is a very useful measure of the distance between two prob- ability distributions. After introducing its de nition and other notions (joint entropy, conditional entropy or mutual information) we can prove additional assertions about the Shannon entropy and present statements about the relations between the above men- tioned quantities. In quantum information theory, there is a quantity, namely von Neumann entropy, which corresponds to Shannon entropy and originates from it. In the section Von Neu- mann entropy we will introduce this quantity which is a continuous functional on the states, or on their mathematical representatives, the density operators, and it ful ls in- equalities such as subadditivity and strong subaddititvity. Just as with the Shannon entropy, it is extremely useful to de ne a quantum version of the relative entropy, which is one of the most important numerical quantities appearing in quantum information theory. It is used as a measure of distinguishability between quantum states. Among others its properties are jointly convexity, monotonicity which are speci cally convenient. Transformations on structures which preserve operations, quantities or relations among elements appear in many areas of mathematics. These are the so-called preservers which show up also in physics and even in chemistry where they are usually called symmetries. Therefore, the study of preserver transformations is an important area of research. The third section of this work is based on a paper, in which Lajos Molnár described the structure every bijective map on the space of all density operators on a given Hilbert space, which preserves the relative entropy. This result is closely related to Wigner's famous theorem on the form of quantum mechanical symmetry transformations. The above theorem of Molnár can be extended into two directions. On the one hand, the result holds also in the case when the transformation under consideration acts on the space of all positive semide nite operators not only on density operators (i.e., we omit the condition of unit trace). On the other hand the statement remains valid even if we omit the strongly restrictive condition that the transformation is bijective. The second result is a joint work with Prof. Lajos Molnár which appeared in the journal Linear Algebra and Its Applications.