Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

A maximum value for the Kullback-Leibler divergence between quantum discrete distributions

Vincenzo Bonnici

Published Aug 13, 2020• 0 citations
OpenAlex

Abstract

This work presents an upper-bound for the maximum value that the Kullback-Leibler (KL) divergence can reach for a newly introduced class of probability distributions, called quantum distributions (QD). In particular, the aim is to find a discrete distribution $U$ which maximize the finite KL divergence from a given $P$ under the assumption that $P$ and $U$ have been generated by distributing a fixed discretized quantity. The theoretical findings are used for proposing a notion of normalized KL divergence that is empirically shown to behave differently from already known measures.

Related papers

Kullback-Leibler divergence between quantum distributions, and its upper-bound

Vincenzo Bonnici

This work presents an upper-bound to value that the Kullback-Leibler (KL) divergence can reach for a class of probability distributions called quantum distributions (QD). The aim is to find a distribution $U$ which maximizes the KL divergence from a given distribution $P$ under the assumption that $P$ and $U$ have been generated by distributing a given discrete quantity, a quantum. Quantum distributions naturally represent a wide range of probability distributions that are used in practical applications. Moreover, such a class of distributions can be obtained as an approximation of any probability distribution. The retrieving of an upper-bound for the entropic divergence is here shown to be possible under the condition that the compared distributions are quantum distributions over the same quantum value, thus they become comparable. Thus, entropic divergence acquires a more powerful meaning when it is applied to comparable distributions. This aspect should be taken into account in future developments of divergences. The theoretical findings are used for proposing a notion of normalized KL divergence that is empirically shown to behave differently from already known measures.

arXiv:2008.05932•Aug 13, 2020•9 citations

On maximization of measured $f$-divergence between a given pair of quantum states

Keiji Matsumoto

This paper deals with maximization of classical $f$-divergence between the distributions of a measurement outputs of a given pair of quantum states. $f$-divergence $D_{f}$ between the probability density functions $p_{1}$ and $p_{2}$ over a discrete set is defined as $D_{f}( p_{1}||p_{2}) :=\sum_{x}p_{2}(x) f\left(p_{1}(x)/p_{2}( x) \right) $. For example, Kullback-Leibler divergence and Renyi type relative entropy are well-known examples with good operational meanings. Thus, finding the maximal value $D_{f}^{\min}$ of measured measured $f$-divergence is also an interesting question. But so far the question is solved only for very restricted example of $f$. \ The purposes of the present paper is to advance the study further, by investigating its properties, rewriting the maximization problem to more tractable form, and giving closed formulas of the quantity in some special cases.

arXiv:1412.3676•Dec 11, 2014•11 citations

Asymptotic Attainment for Quantum Relative Entropy

Masahito Hayashi

In this paper it was proved that the quantum relative entropy D(k) can be asymptotically attained by Kullback Leibler divergences of probabilities given by a certain sequence of measurements. The sequence of measurements depends on , but is independent of the choice of . In classical statistical theory the relative entropy D(pkq) is an information quantity which means the statistical eÆciency in order to distinguish a probability measure p of a measurable space from another probability measure q of the same measurable space. The states correspond to measures on measurable space. When p; q are discrete probabilities, the relative entropy (called also information divergence) introduced by Kullback and Leibler is dened by [1]: D(pkq) := X i p i log p i q i : In general, when p; q are measures on measurable space the relative entropy is dened by: D(pkq) := Z log dq dp (!)p( d!); where dq dp (!) is Radon-Nikodym derivative of q with respect to p. In this paper, we co...

•Apr 24, 1997•2 citations

Asymptotics of Quantum Relative Entropy from a Representation Theoretical Viewpoint

Masahito Hayashi

In this paper it was proved that the quantum relative entropy D(σ‖ρ) can be asymptotically attained by Kullback Leibler divergences of probabilities given by a certain sequence of POVMs. The sequence of POVMs depends on ρ, but is independent of the choice of σ. 1

WORLD SCIENTIFIC eBooks•Feb 1, 2005•0 citations

Classifying deviation from standard quantum behavior using the Kullback-Leibler divergence

Salman Sajad Wani, Saif M. Al-Kuwari, Xiaoping Shi +5 more

Abstract In this letter, we propose a novel statistical method to measure which system is better suited to probe small deviations from the usual quantum behavior. Such deviations are motivated by a number of theoretical and phenomenological motivations, and various systems have been proposed to test them. We propose that measuring deviations from quantum mechanics for a system would be easier if it had a higher Kullback-Leibler divergence. We show this explicitly for a non-local Scrödinger equation and argue that it will hold for any modification to standard quantum behavior. Thus, the results of this letter can be used to classify a wide range of theoretical and phenomenological models.

arXiv:2308.02496•Europhysics Letters (EPL)•Dec 1, 2023•0 citations

Nonadditive generalization of the quantum Kullback-Leibler divergence for measuring the degree of purification

Sumiyoshi Abe

The Kullback-Leibler divergence offers an information-theoretic basis for measuring the difference between two given distributions. Its quantum analog, however, fails to play a corresponding role for comparing two density matrices, if the reference states are pure states. Here it is shown that nonadditive quantum information theory inspired by nonextensive statistical mechanics is free from such a difficulty and the associated quantity, termed the quantum q-divergence, can in fact be a good information-theoretic measure of the degree of state purification. The correspondence relation between the ordinary divergence and the q-divergence is violated for the pure reference states, in general.

arXiv:quant-ph/0301136•Physical Review A•Sep 10, 2003•68 citations
This work presents an upper-bound for the maximum value that the Kullback-Leibler (KL) divergence can reach for a newly introduced class of probability distributions, called quantum distributions (QD). In particular, the aim is to find a discrete distribution UUU which maximize the finite KL divergence from a given PPP under the assumption that PPP and UUU have been generated by distributing a fixed discretized quantity. The theoretical findings are used for proposing a notion of normalized KL divergence that is empirically shown to behave differently from already known measures.
This work presents an upper-bound to value that the Kullback-Leibler (KL) divergence can reach for a class of probability distributions called quantum distributions (QD). The aim is to find a distribution UUU which maximizes the KL divergence from a given distribution PPP under the assumption that PPP and UUU have been generated by distributing a given discrete quantity, a quantum. Quantum distributions naturally represent a wide range of probability distributions that are used in practical applications. Moreover, such a class of distributions can be obtained as an approximation of any probability distribution. The retrieving of an upper-bound for the entropic divergence is here shown to be possible under the condition that the compared distributions are quantum distributions over the same quantum value, thus they become comparable. Thus, entropic divergence acquires a more powerful meaning when it is applied to comparable distributions. This aspect should be taken into account in future developments of divergences. The theoretical findings are used for proposing a notion of normalized KL divergence that is empirically shown to behave differently from already known measures.
On maximization of measured fff-divergence between a given pair of quantum states
This paper deals with maximization of classical fff-divergence between the distributions of a measurement outputs of a given pair of quantum states. fff-divergence DfD_{f}Df​ between the probability density functions p1p_{1}p1​ and p2p_{2}p2​ over a discrete set is defined as $D_{f}( p_{1}||p_{2}) :=\sum_{x}p_{2}(x) f\left(p_{1}(x)/p_{2}( x) \right) $. For example, Kullback-Leibler divergence and Renyi type relative entropy are well-known examples with good operational meanings. Thus, finding the maximal value Dfmin⁡D_{f}^{\min}Dfmin​ of measured measured fff-divergence is also an interesting question. But so far the question is solved only for very restricted example of fff. \ The purposes of the present paper is to advance the study further, by investigating its properties, rewriting the maximization problem to more tractable form, and giving closed formulas of the quantity in some special cases.
In this paper it was proved that the quantum relative entropy D(k) can be asymptotically attained by Kullback Leibler divergences of probabilities given by a certain sequence of measurements. The sequence of measurements depends on , but is independent of the choice of . In classical statistical theory the relative entropy D(pkq) is an information quantity which means the statistical eÆciency in order to distinguish a probability measure p of a measurable space from another probability measure q of the same measurable space. The states correspond to measures on measurable space. When p; q are discrete probabilities, the relative entropy (called also information divergence) introduced by Kullback and Leibler is dened by [1]: D(pkq) := X i p i log p i q i : In general, when p; q are measures on measurable space the relative entropy is dened by: D(pkq) := Z log dq dp (!)p( d!); where dq dp (!) is Radon-Nikodym derivative of q with respect to p. In this paper, we co...
Abstract In this letter, we propose a novel statistical method to measure which system is better suited to probe small deviations from the usual quantum behavior. Such deviations are motivated by a number of theoretical and phenomenological motivations, and various systems have been proposed to test them. We propose that measuring deviations from quantum mechanics for a system would be easier if it had a higher Kullback-Leibler divergence. We show this explicitly for a non-local Scrödinger equation and argue that it will hold for any modification to standard quantum behavior. Thus, the results of this letter can be used to classify a wide range of theoretical and phenomenological models.
The Kullback-Leibler divergence offers an information-theoretic basis for measuring the difference between two given distributions. Its quantum analog, however, fails to play a corresponding role for comparing two density matrices, if the reference states are pure states. Here it is shown that nonadditive quantum information theory inspired by nonextensive statistical mechanics is free from such a difficulty and the associated quantity, termed the quantum q-divergence, can in fact be a good information-theoretic measure of the degree of state purification. The correspondence relation between the ordinary divergence and the q-divergence is violated for the pure reference states, in general.