Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

International Journal of Theoretical Physics

On Informational Divergences for General Statistical Theories

Stephan Zanzinger

Published Jan 1, 1998• 1 citation
Publisher
DOI
10.1023/a:1026635322144

Related papers

Generalizations of statistical mechanics on the basis of an incomplete information theory

Qiuping Alexandre Wang

•Sep 22, 2000•1 citation

Fundamental Statistical Theories

William Demopoulos

Springer eBooks•Jan 1, 1976•1 citation

Nonadditive generalization of the quantum Kullback-Leibler divergence for measuring the degree of purification

Sumiyoshi Abe

The Kullback-Leibler divergence offers an information-theoretic basis for measuring the difference between two given distributions. Its quantum analog, however, fails to play a corresponding role for comparing two density matrices, if the reference states are pure states. Here it is shown that nonadditive quantum information theory inspired by nonextensive statistical mechanics is free from such a difficulty and the associated quantity, termed the quantum q-divergence, can in fact be a good information-theoretic measure of the degree of state purification. The correspondence relation between the ordinary divergence and the q-divergence is violated for the pure reference states, in general.

arXiv:quant-ph/0301136•Physical Review A•Sep 10, 2003•68 citations

Information Theory and Statistical Entropy

Roger Balian

Springer eBooks•Jan 1, 1991•2 citations

On the Relation between Kullback Divergence and Fisher Information: From Classical Systems to Quantum Systems

Hiroshi Nagaoka

Kullback divergence D(p ∥ q) for a couple of probability distributions {p, q} and Fisher information J(θ) for a parametric family of probability distributions {p θ } are very important notions in the classical theory of statistical inference. Quantum analogues of these notions are known as Umegaki's relative entropy D(ρ ‖ σ) for a couple of density operators {ρ, σ} and the quantum Fisher information J(θ) based on the pymmetric logarithmic derivatives for a parametric family of density operators {ρ Θ }. In the classical case, the relation holds, which connects the asymptotic theory of hypothesis testing and that of parameter estimation. In the quantum case, the relation defines , which is not equal to J(θ) in general and is another quantum analogue of Fisher information. We show the inequality and elucidate its meaning in connection with the statistical inference for quantum states.

WORLD SCIENTIFIC eBooks•Feb 1, 2005•8 citations

Distances Measures for Probability Distributions

Many problems of statistical and quantum mechanics can be established in terms of a distance between probability distributions. The present work is devoted to review some of the most relevant applications of the notion of distance in the context of statistical mechanics, quantum mechanics and information theory. Although we make a general overview of the most frequently used distances between probability distributions, we will center our presentation in a distance known as the Jensen-Shannon divergence both in their classical and quantum versions. For the classical one we present its main properties and we discuss its relevance as a segmentation tool for symbolic sequences. In the quantum case we show that the quantum Jensen-Shannon divergence is an adequate measure of entanglement.

BENTHAM SCIENCE PUBLISHERS eBooks•Dec 11, 2013•1 citation
The Kullback-Leibler divergence offers an information-theoretic basis for measuring the difference between two given distributions. Its quantum analog, however, fails to play a corresponding role for comparing two density matrices, if the reference states are pure states. Here it is shown that nonadditive quantum information theory inspired by nonextensive statistical mechanics is free from such a difficulty and the associated quantity, termed the quantum q-divergence, can in fact be a good information-theoretic measure of the degree of state purification. The correspondence relation between the ordinary divergence and the q-divergence is violated for the pure reference states, in general.
Kullback divergence D(p ∥ q) for a couple of probability distributions {p, q} and Fisher information J(θ) for a parametric family of probability distributions {p θ } are very important notions in the classical theory of statistical inference. Quantum analogues of these notions are known as Umegaki's relative entropy D(ρ ‖ σ) for a couple of density operators {ρ, σ} and the quantum Fisher information J(θ) based on the pymmetric logarithmic derivatives for a parametric family of density operators {ρ Θ }. In the classical case, the relation holds, which connects the asymptotic theory of hypothesis testing and that of parameter estimation. In the quantum case, the relation defines , which is not equal to J(θ) in general and is another quantum analogue of Fisher information. We show the inequality and elucidate its meaning in connection with the statistical inference for quantum states.
Many problems of statistical and quantum mechanics can be established in terms of a distance between probability distributions. The present work is devoted to review some of the most relevant applications of the notion of distance in the context of statistical mechanics, quantum mechanics and information theory. Although we make a general overview of the most frequently used distances between probability distributions, we will center our presentation in a distance known as the Jensen-Shannon divergence both in their classical and quantum versions. For the classical one we present its main properties and we discuss its relevance as a segmentation tool for symbolic sequences. In the quantum case we show that the quantum Jensen-Shannon divergence is an adequate measure of entanglement.