Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1808.01172 · Physical Review Letters

Maximum Entropy Principle in Statistical Inference: Case for Non-Shannonian Entropies

Petr Jizba, Jan Korbel

Published Mar 26, 2019• 89 citations
arXivHTMLPDF

Abstract

In this Letter, we show that the Shore-Johnson axioms for the maximum entropy principle in statistical estimation theory account for a considerably wider class of entropic functional than previously thought. Apart from a formal side of the proof where a one-parameter class of admissible entropies is identified, we substantiate our point by analyzing the effect of weak correlations and by discussing two pertinent examples: two-qubit quantum system and transverse-momentum behavior of hadrons in high-energy proton-proton collisions.

DOI
10.1103/physrevlett.122.120601

Related papers

Uncertainty, Entropy, and the Statistical Mechanics of Microscopic Systems

R. Blankenbecler, M. Hossein Partovi

Noting that quantum measurements are in general incomplete, we develop, starting from a recent entropic formulation of uncertainty, a maximum uncertainty principle to define the statistical mechanics of microscopic systems. The resulting ensemble entropy coincides with the expression of von Neumann, thus providing a unified, quantum basis for statistical physics of all systems. Examples involving momentum and position measurements are discussed.

Physical Review Letters•Feb 4, 1985•44 citations

Information Theory and Statistical Mechanics Revisited

Jian Zhou

We derive Bose-Einstein statistics and Fermi-Dirac statistics by Principle of Maximum Entropy applied to two families of entropy functions different from the Boltzmann-Gibbs-Shannon entropy. These entropy functions are identified with special cases of modified Naudts' $ϕ$-entropy.

arXiv:1604.08739•Apr 29, 2016•4 citations

Quantum entanglement inferred by the principle of maximum nonadditive entropy

Sumiyoshi Abe, A. K. Rajagopal

The problem of quantum-state inference and the concept of quantum entanglement are studied using a nonadditive measure in the form of the Tsallis entropy indexed by the positive parameter q. The maximum entropy principle associated with this entropy along with its thermodynamic interpretation are discussed in detail for the Einstein-Podolsky-Rosen pair of two spin-$\frac{1}{2}$ particles. Given the data on the Bell-Clauser-Horne-Shimony-Holt observable, the analytic expression is presented for the inferred quantum entangled state. It is shown that for $q>1,$ indicating the subadditive feature of the Tsallis entropy, the entangled region is small and enlarges as one goes into the superadditive regime where $q<1.$ It is also shown that quantum entanglement can be quantified by the generalized (Kullback-Leibler) relative entropy.

arXiv:quant-ph/9904088•Physical Review A•Nov 1, 1999•83 citations

Information Theoretical Approaches to Quantum Chemistry

Shridhar Ramachandra Gadre

The development of the concept of entropy is traced briefly from the time of Boltzmann to the present. The axiomatic formulation of the Shannon information entropy functional [C. E. Shannon, Bell System Tech. J. 27 , 379 (1948)], viz. S = - k Σ p i ln p i is presented. The maximum entropy principle (MEP) due to Jaynes [E.T. Jaynes, Phys. Rev. 106 , 620 (1957)] is summarized and the existence and uniqueness of such maximum entropy solution with the constraints of moments of the distribution is discussed. This is followed by an account of the practical reconstruction of the electron momentum distributions and Compton profiles by employing the first and second moment constraints. Connections of information entropy encompassing kinetic energy functional, reaction dynamics, loges as well as surprisal analysis are brought out. The pioneering contribution of Białynicki-Birula and Mycielski [I. Białynicki-Birula, and J. Mycielski, Commun. Math. Phys. 44 , 129 (1975)] highlighting the connection between the sum of information entropies in conjugate spaces and the Heisenberg uncertainty relation is outlined. The problem of characterizing the quality of atomic and molecular wave functions has been considered in terms of the sum of information entropies in conjugate spaces. This is followed by the discussion of a new maximum entropy principle [S. R. Gadre and R. D. Bendale, Int. J. Quantum Chem. 28 , 311 (1985)] stipulating the maximization of the sum of the Shannon entropies in conjugate spaces. Some applications of this new maximum entropy principle for obtaining the probability distributions in conjugate spaces are summarized.

WORLD SCIENTIFIC eBooks•Dec 1, 2002•31 citations

From Entropic Dynamics to Quantum Theory

Ariel Caticha, Paul M. Goggans, Chun-Yong Chan

Non-relativistic quantum theory is derived from information codified into an appropriate statistical model. The basic assumption is that there is an irreducible uncertainty in the location of particles: positions constitute a configuration space and the corresponding probability distributions constitute a statistical manifold. The dynamics follows from a principle of inference, the method of Maximum Entropy. The concept of time is introduced as a convenient way to keep track of change. A welcome feature is that the entropic dynamics notion of time incorporates a natural distinction between past and future. The statistical manifold is assumed to be a dynamical entity: its curved and evolving geometry determines the evolution of the particles which, in their turn, react back and determine the evolution of the geometry. Imposing that the dynamics conserve energy leads to the Schroedinger equation and to a natural explanation of its linearity, its unitarity, and of the role of complex numbers. The phase of the wave function is explained as a feature of purely statistical origin. There is a quantum analogue to the gravitational equivalence principle.

arXiv:0907.4335•AIP conference proceedings•Jan 1, 2009•8 citations

The Entropic Law of Critical Universality

Revista, Zen, PHYSICS, 10

Critical phenomena, characterized by abrupt changes in the macroscopic properties of a system, exhibit a profound degree of universality, meaning that vastly different physical systems can display identical behavior near their critical points. This universality is typically understood through the lens of scaling laws and the Renormalization Group theory, which classify critical points into distinct universality classes. This paper proposes and explores the "Entropic Law of Critical Universality," an overarching principle positing that not only do thermodynamic quantities scale universally, but the fundamental information-theoretic measures of a system, particularly entropy in its various forms (thermodynamic entropy, entanglement entropy, Renyi entropy), also conform to universal scaling behaviors that uniquely characterize these universality classes. We review how entanglement entropy exhibits universal logarithmic corrections at quantum critical points, linked to the central charge of underlying conformal field theories. We also discuss how specific entropy behaves non-monotonically near quantum chromodynamics critical points and how entropic measures can identify phase transitions and their classes in various condensed matter systems, including graphene and spin models. The paper synthesizes theoretical frameworks and empirical evidence to demonstrate that entropy serves as a powerful and often more direct probe of the universal properties underlying critical phenomena, offering a comprehensive perspective on the shared information landscape of diverse critical systems.

•Nov 28, 2025•0 citations
In this Letter, we show that the Shore-Johnson axioms for the maximum entropy principle in statistical estimation theory account for a considerably wider class of entropic functional than previously thought. Apart from a formal side of the proof where a one-parameter class of admissible entropies is identified, we substantiate our point by analyzing the effect of weak correlations and by discussing two pertinent examples: two-qubit quantum system and transverse-momentum behavior of hadrons in high-energy proton-proton collisions.
We derive Bose-Einstein statistics and Fermi-Dirac statistics by Principle of Maximum Entropy applied to two families of entropy functions different from the Boltzmann-Gibbs-Shannon entropy. These entropy functions are identified with special cases of modified Naudts' ϕϕϕ-entropy.
The problem of quantum-state inference and the concept of quantum entanglement are studied using a nonadditive measure in the form of the Tsallis entropy indexed by the positive parameter q. The maximum entropy principle associated with this entropy along with its thermodynamic interpretation are discussed in detail for the Einstein-Podolsky-Rosen pair of two spin-12\frac{1}{2}21​ particles. Given the data on the Bell-Clauser-Horne-Shimony-Holt observable, the analytic expression is presented for the inferred quantum entangled state. It is shown that for q>1,q>1,q>1, indicating the subadditive feature of the Tsallis entropy, the entangled region is small and enlarges as one goes into the superadditive regime where q<1.q<1.q<1. It is also shown that quantum entanglement can be quantified by the generalized (Kullback-Leibler) relative entropy.
The development of the concept of entropy is traced briefly from the time of Boltzmann to the present. The axiomatic formulation of the Shannon information entropy functional [C. E. Shannon, Bell System Tech. J. 27 , 379 (1948)], viz. S = - k Σ p i ln p i is presented. The maximum entropy principle (MEP) due to Jaynes [E.T. Jaynes, Phys. Rev. 106 , 620 (1957)] is summarized and the existence and uniqueness of such maximum entropy solution with the constraints of moments of the distribution is discussed. This is followed by an account of the practical reconstruction of the electron momentum distributions and Compton profiles by employing the first and second moment constraints. Connections of information entropy encompassing kinetic energy functional, reaction dynamics, loges as well as surprisal analysis are brought out. The pioneering contribution of Białynicki-Birula and Mycielski [I. Białynicki-Birula, and J. Mycielski, Commun. Math. Phys. 44 , 129 (1975)] highlighting the connection between the sum of information entropies in conjugate spaces and the Heisenberg uncertainty relation is outlined. The problem of characterizing the quality of atomic and molecular wave functions has been considered in terms of the sum of information entropies in conjugate spaces. This is followed by the discussion of a new maximum entropy principle [S. R. Gadre and R. D. Bendale, Int. J. Quantum Chem. 28 , 311 (1985)] stipulating the maximization of the sum of the Shannon entropies in conjugate spaces. Some applications of this new maximum entropy principle for obtaining the probability distributions in conjugate spaces are summarized.
Non-relativistic quantum theory is derived from information codified into an appropriate statistical model. The basic assumption is that there is an irreducible uncertainty in the location of particles: positions constitute a configuration space and the corresponding probability distributions constitute a statistical manifold. The dynamics follows from a principle of inference, the method of Maximum Entropy. The concept of time is introduced as a convenient way to keep track of change. A welcome feature is that the entropic dynamics notion of time incorporates a natural distinction between past and future. The statistical manifold is assumed to be a dynamical entity: its curved and evolving geometry determines the evolution of the particles which, in their turn, react back and determine the evolution of the geometry. Imposing that the dynamics conserve energy leads to the Schroedinger equation and to a natural explanation of its linearity, its unitarity, and of the role of complex numbers. The phase of the wave function is explained as a feature of purely statistical origin. There is a quantum analogue to the gravitational equivalence principle.
Critical phenomena, characterized by abrupt changes in the macroscopic properties of a system, exhibit a profound degree of universality, meaning that vastly different physical systems can display identical behavior near their critical points. This universality is typically understood through the lens of scaling laws and the Renormalization Group theory, which classify critical points into distinct universality classes. This paper proposes and explores the "Entropic Law of Critical Universality," an overarching principle positing that not only do thermodynamic quantities scale universally, but the fundamental information-theoretic measures of a system, particularly entropy in its various forms (thermodynamic entropy, entanglement entropy, Renyi entropy), also conform to universal scaling behaviors that uniquely characterize these universality classes. We review how entanglement entropy exhibits universal logarithmic corrections at quantum critical points, linked to the central charge of underlying conformal field theories. We also discuss how specific entropy behaves non-monotonically near quantum chromodynamics critical points and how entropic measures can identify phase transitions and their classes in various condensed matter systems, including graphene and spin models. The paper synthesizes theoretical frameworks and empirical evidence to demonstrate that entropy serves as a powerful and often more direct probe of the universal properties underlying critical phenomena, offering a comprehensive perspective on the shared information landscape of diverse critical systems.