Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Cambridge University Press eBooks

Entropies and Relative Entropies

Gilad Gour

Published Apr 10, 2025• 0 citations
Publisher

Abstract

Chapter 6 builds upon the foundation of divergences from Chapter 5, advancing into entropies and relative entropies with an axiomatic approach, and the inclusion of the additivity axiom. The chapter delves into the classical and quantum relative entropies, establishing their core properties and revealing the significance of the KL-divergence introduced in Chapter 5, notably characterized by asymptotic continuity. Quantum relative entropies are addressed as generalizations of classical ones, with a focus on the conditions necessary for these measures in the quantum framework. Several variants of relative entropies are discussed, including Renyi relative entropies and their extensions to quantum domain such as the Petz quantum Renyi divergence, minimal quantum Renyi divergence, and the maximal quantum Renyi divergence. This discourse underlines the relevance of continuity and its relation to faithfulness in relative entropies. The concept of entropy is portrayed as a measure with a broad spectrum of interpretations and applications across fields, from thermodynamics and information theory to cosmology and economics.

DOI
10.1017/9781009560870.006

Related papers

α - z -Rényi relative entropies

Koenraad M. R. Audenaert, Nilanjana Datta

We consider a two-parameter family of Rényi relative entropies Dα,z(ρ ∥ σ) that are quantum generalisations of the classical Rényi divergence Dα(p ∥ q). This family includes many known relative entropies (or divergences) such as the quantum relative entropy, the recently defined quantum Rényi divergences, as well as the quantum Rényi relative entropies. All its members satisfy the quantum generalizations of Rényi’s axioms for a divergence. We consider the range of the parameters α, z for which the data-processing inequality holds. We also investigate a variety of limiting cases for the two parameters, obtaining explicit formulas for each one of them.

arXiv:1310.7178•Journal of Mathematical Physics•Feb 1, 2015•158 citations

Relative entropy via distribution of observables

George Androulakis, Tiju Cherian John

We obtain formulas for Petz–Rényi and Umegaki relative entropy from the idea of distribution of a positive self-adjoint operator. Classical results on Rényi and Kullback–Leibler divergences are applied to obtain new results and new proofs for some known results about Petz–Rényi and Umegaki relative entropy. Most important among these, is a necessary and sufficient condition for the finiteness of the Petz–Rényi [Formula: see text]-relative entropy. All of the results presented here are valid in both finite and infinite dimensions. In particular, these results are valid for states in Fock spaces and thus are applicable to continuous variable quantum information theory.

arXiv:2203.01964•Infinite Dimensional Analysis Quantum Probability and Related Topics•Aug 12, 2023•7 citations

On quantum Rényi entropies: A new generalization and some properties

Martin Müller-Lennert, Frédéric Dupuis, Oleg Szehr +2 more

The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.

arXiv:1306.3142•Journal of Mathematical Physics•Dec 1, 2013•811 citations

Entropic measures of quantum information

Roberto Rubboli, Bartosz Regula, Mario Berta +2 more

Entropy has played a pivotal role in physics ever since its inception by Clausius in the early industrial age. Shannon ushered the concept into the information age by using it to describe fundamental limits of information processing, founding the field of information theory. Today, a fruitful interaction between information theory and physics is pushing our understanding of entropy forward. It has revealed, in particular, that no single notion of entropy suffices to capture all relevant properties of physical systems, making it necessary to consider a variety of entropic measures of quantum information, each with distinct features and uses. This review surveys these recent advances in a structured way, covering a comprehensive array of information measures, including Rényi and smooth entropies, together with their interrelations. Starting with a systematic characterization of entropies that motivates their definitions from natural physical principles, we discuss their applications ranging from quantum communication and cryptography to resource theories, thermodynamics, and many-body physics.

arXiv:2611.08254•Nov 5, 2026•0 citations

Quantum Relative-alpha-Entropies: A Structural and Geometric Perspective

Sayantan Roy, Atin Gayen, Aditi Kar Gangopadhyay +1 more

Most quantum divergences derive their structure from classical f-divergences or Renyi-type constructions, a dependence that obscures several quantum geometric effects. We introduce a quantum relative-alpha-entropy that extends Umegaki's relative entropy while falling outside the f-divergence class. The proposed divergence exhibits a nonlinear convexity property, which yields a generalized convexity result for the Petz-Renyi divergence for alpha greater than one, complementing the known convexity for alpha less than one. It is additive under tensor products, invariant under unitary transformations, and depends only on the relative geometry of quantum states rather than their absolute magnitudes. Using Nussbaum-Szkola-type distributions, we also establish an exact correspondence of this divergence with classical relative-alpha-entropy. This reveals relative-alpha-entropy as a fundamentally geometric notion of quantum distinguishability not captured by existing divergence frameworks.

quant-pharXiv:2604.06908•Apr 9, 2026•0 citations

On quantum R\'enyi entropies: a new definition, some properties and several conjectures

Martin Müller-Lennert, Frédéric Dupuis, Oleg Szehr +2 more

The R\'enyi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies or mutual information, and have found many applications in information theory and beyond. Various generalizations of R\'enyi entropies to the quantum setting have been proposed, most notably Petz's quasi-entropies and Renner's conditional min-, max- and collision entropy. Here, we argue that previous quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of R\'enyi entropies and the corresponding relative entropies that contains the min-entropy, collision entropy, von Neumann entropy as well as the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities and a limited duality relation. We conclude that the treatment of these entropies is technically challenging and requires sophisticated tools from linear algebra. We share several conjectured properties which we were unable to prove.

•Jun 13, 2013•8 citations
Chapter 6 builds upon the foundation of divergences from Chapter 5, advancing into entropies and relative entropies with an axiomatic approach, and the inclusion of the additivity axiom. The chapter delves into the classical and quantum relative entropies, establishing their core properties and revealing the significance of the KL-divergence introduced in Chapter 5, notably characterized by asymptotic continuity. Quantum relative entropies are addressed as generalizations of classical ones, with a focus on the conditions necessary for these measures in the quantum framework. Several variants of relative entropies are discussed, including Renyi relative entropies and their extensions to quantum domain such as the Petz quantum Renyi divergence, minimal quantum Renyi divergence, and the maximal quantum Renyi divergence. This discourse underlines the relevance of continuity and its relation to faithfulness in relative entropies. The concept of entropy is portrayed as a measure with a broad spectrum of interpretations and applications across fields, from thermodynamics and information theory to cosmology and economics.
We consider a two-parameter family of Rényi relative entropies Dα,z(ρ ∥ σ) that are quantum generalisations of the classical Rényi divergence Dα(p ∥ q). This family includes many known relative entropies (or divergences) such as the quantum relative entropy, the recently defined quantum Rényi divergences, as well as the quantum Rényi relative entropies. All its members satisfy the quantum generalizations of Rényi’s axioms for a divergence. We consider the range of the parameters α, z for which the data-processing inequality holds. We also investigate a variety of limiting cases for the two parameters, obtaining explicit formulas for each one of them.
We obtain formulas for Petz–Rényi and Umegaki relative entropy from the idea of distribution of a positive self-adjoint operator. Classical results on Rényi and Kullback–Leibler divergences are applied to obtain new results and new proofs for some known results about Petz–Rényi and Umegaki relative entropy. Most important among these, is a necessary and sufficient condition for the finiteness of the Petz–Rényi [Formula: see text]-relative entropy. All of the results presented here are valid in both finite and infinite dimensions. In particular, these results are valid for states in Fock spaces and thus are applicable to continuous variable quantum information theory.
The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.
Entropy has played a pivotal role in physics ever since its inception by Clausius in the early industrial age. Shannon ushered the concept into the information age by using it to describe fundamental limits of information processing, founding the field of information theory. Today, a fruitful interaction between information theory and physics is pushing our understanding of entropy forward. It has revealed, in particular, that no single notion of entropy suffices to capture all relevant properties of physical systems, making it necessary to consider a variety of entropic measures of quantum information, each with distinct features and uses. This review surveys these recent advances in a structured way, covering a comprehensive array of information measures, including Rényi and smooth entropies, together with their interrelations. Starting with a systematic characterization of entropies that motivates their definitions from natural physical principles, we discuss their applications ranging from quantum communication and cryptography to resource theories, thermodynamics, and many-body physics.
Most quantum divergences derive their structure from classical f-divergences or Renyi-type constructions, a dependence that obscures several quantum geometric effects. We introduce a quantum relative-alpha-entropy that extends Umegaki's relative entropy while falling outside the f-divergence class. The proposed divergence exhibits a nonlinear convexity property, which yields a generalized convexity result for the Petz-Renyi divergence for alpha greater than one, complementing the known convexity for alpha less than one. It is additive under tensor products, invariant under unitary transformations, and depends only on the relative geometry of quantum states rather than their absolute magnitudes. Using Nussbaum-Szkola-type distributions, we also establish an exact correspondence of this divergence with classical relative-alpha-entropy. This reveals relative-alpha-entropy as a fundamentally geometric notion of quantum distinguishability not captured by existing divergence frameworks.
The R\'enyi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies or mutual information, and have found many applications in information theory and beyond. Various generalizations of R\'enyi entropies to the quantum setting have been proposed, most notably Petz's quasi-entropies and Renner's conditional min-, max- and collision entropy. Here, we argue that previous quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of R\'enyi entropies and the corresponding relative entropies that contains the min-entropy, collision entropy, von Neumann entropy as well as the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities and a limited duality relation. We conclude that the treatment of these entropies is technically challenging and requires sophisticated tools from linear algebra. We share several conjectured properties which we were unable to prove.