Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2308.04472 · Entropy

Entropy of the Canonical Occupancy (Macro) State in the Quantum Measurement Theory

A. Spalvieri

Published Jan 24, 2024• 3 citations
arXivHTMLPDF

Abstract

The paper analyzes the probability distribution of the occupancy numbers and the entropy of a system at the equilibrium composed by an arbitrary number of non-interacting bosons. The probability distribution is obtained through two approaches: one involves tracing out the environment from a bosonic eigenstate of the combined environment and system of interest (the empirical approach), while the other involves tracing out the environment from the mixed state of the combined environment and system of interest (the Bayesian approach). In the thermodynamic limit, the two coincide and are equal to the multinomial distribution. Furthermore, the paper proposes to identify the physical entropy of the bosonic system with the Shannon entropy of the occupancy numbers, fixing certain contradictions that arise in the classical analysis of thermodynamic entropy. Finally, by leveraging an information-theoretic inequality between the entropy of the multinomial distribution and the entropy of the multivariate hypergeometric distribution, Bayesianism of information theory and empiricism of statistical mechanics are integrated into a common "infomechanical" framework.

DOI
10.3390/e26020107

Related papers

Canonical Distribution of the Occupancy Numbers of Bosonic Systems

A. Spalvieri

The paper works out the canonical probability distribution of the occupancy numbers of a bosonic system and shows that canonical typicality applies to the canonical density operator of the occupancy numbers. The result is that, if, as it is today standard, the canonical system's mixed state is obtained by tracing out the environment from any typical pure state of the universe, then asymptotically the canonical probability distribution of system's occupancy numbers tends in probability to the multinomial distribution. The paper also shows that the currently accepted probability distribution of the occupancy numbers of a system with fixed number of particles is not compatible with the commonly accepted notion of canonical system.

arXiv:2512.00950•Nov 30, 2025•0 citations

Occupancy Statistics and Entropy in Bose Systems

A. Spalvieri

In this work, we compare three formulations of thermodynamic entropy for a non-interacting bosonic gas: (i) the grand-canonical Bose-Einstein entropy, (ii) the finite-N canonical entropy obtained from the exact partition function (Ziff, Uhlenbeck, and Kac construction), and (iii) the entropy of a multinomial distribution with Boltzmann categorical probabilities and temperature determined from Clausius' equation. It is well-known that the grand-canonical Bose-Einstein systematically overestimates entropy of canonical systems in regimes where particle-number fluctuations are significant. The exact canonical entropy correctly enforces the particle-number constraint, but recent experimental results suggest that it also overestimates particle-number fluctuations below the crossover temperature. The multinomial distribution is less common in thermodynamics. It addresses in a mathematically exact way the puzzle of the famous -log(N!) term introduced by Gibbs as a deus ex machina in discussions of thermodynamic entropy. One remarkable consequence is that the entropy of the multinomial distribution overcomes the issue of negative entropy at low temperature that affects the Gibbs and the Sackur-Tetrode entropies at low temperature. The analysis presented in the paper shows that the multinomial distribution, equipped with a categorical distribution calibrated in such a way that the resulting multinomial entropy fits Clausius' equation, provides accurate approximations to the canonical entropy in the classical regime, while it is smaller than the canonical entropy below the crossover temperature. One feature of the multinomial distribution is that it predicts lower peak variance of the number of particles in the ground state than the canonical distribution. This is in agreement with recent experimental results; hence, this paper identifies the thermodynamically calibrated multinomial distribution as a candidate alternative to the canonical distribution for thermodynamic bosonic entropy in finite systems.

Entropy•Aug 13, 2026•0 citations

The Exact Entropy Formula of the Ideal Gas and its Information-Theoretic Interpretation

A. Spalvieri

The paper analyzes the entropy of a system composed by non-interacting and indistinguishable particles whose quantum state numbers are modelled as independent and identically distributed classical random variables. The crucial observation is that, under this assumption, whichever is the number of particles that constitute the system, the occupancy numbers of system's quantum (micro)states are multinomially distributed. This observation leads to an entropy formula for the physical system, which is nothing else than the entropy formula of the multinomial distribution, for which we claim novelty, in the sense that it is proposed here for the first time that the entropy of the multinomial distribution is the entropy of the physical system. The entropy formula of the multinomial distribution unveils yet unexplored connections between information theory and statistical mechanics, among which we mention the connection between conditional entropy of the random microstate given the random occupancy numbers and the Boltzmann-Planck entropy $\log(W)$ and between these two and the Gibbs correction term $\log(N!)$, thermalization and communication-theoretic preparation of a thermal state, accessible information of the thermal state and physical entropy of the thermalized system. A noticeable specific result that descends from our approach is the exact quantum correction to the textbook Sackur-Tetrode formula for the entropy of an ideal gas at the thermal equilibrium in a container.

arXiv:2305.04652•May 8, 2023•1 citation

Information, Entropy, and the Classical Ideal Gas

David Sands, Jeremy Dunning-Davies

The physical basis of the canonical and grand canonical distributions is questioned. In particular, we question the usual methods by which these distributions are derived, namely that fluctuations in entropy around energy and particle number are assumed to occur when the entropy depends only on variables which cannot themselves fluctuate. We show, starting from the Maxwellian velocity distribution, that the probability that a classical ideal gas at a fixed temperature occupies a given energy state corresponds not to the canonical ensemble of classical statistical mechanics but to the Gamma distribution. Computer simulations of a hard-sphere fluid demonstrate the principles. The analysis is extended to open systems in which the number of particles fluctuates and we show that for a system connected to a particle reservoir the Poisson distribution governs the probability of finding a given number of particles. The resulting probability distributions are used to calculate the Shannon information entropy which is then compared with the thermodynamic entropy. We argue that information theoretic entropy and thermodynamic entropy, whilst related, are not necessarily identical and that the information entropy contains non-thermodynamic components.

International Symposium Honoring Mathematical Physicist Jean-Pierre Vigier•Oct 16, 2013•0 citations

Non-Classical Information Entropy: A Statistical Physics Perspective

Jincheng Zhang

This paper introduces a novel definition of non-classical information entropy, rooted in the principles of statistical physics, particularly quantum mechanics. The core premise is that traditional information entropy, derived from classical probability theory, is insufficient to capture the essence of information within non-classical systems exhibiting phenomena such as superposition and entanglement. We propose a definition based on the concept of accessible states and their associated probabilities, extending the notion of entropy beyond the realm of purely deterministic systems. The paper details the mathematical formulation of this non-classical information entropy, denoted as *Hnc*, and presents a method for its calculation. The method relies on identifying the set of accessible states for a given system and then applying a generalized form of Shannon's entropy formula, modified to account for the inherent uncertainties associated with quantum mechanics. The resulting *Hnc* provides a quantitative measure of the information content within non-classical systems, offering a potential framework for studying information processing and dynamics in quantum environments. The key contribution lies in bridging the gap between information theory and non-classical statistical physics, offering a new lens through which to understand information in quantum systems.

•Sep 3, 2026•0 citations

Towards thermodynamics of quantum systems away from equilibrium

Tanapat Deesuwan

A probability distribution encodes all the statistics of its corresponding random variable, hence it encodes all one can learn about the system via the random variable. In the theoretical part of this thesis, we discuss several equivalent representations of probability distributions in physics which establishes their roles as complete information measures in their own contexts. In particular, we show how Rényi entropies (as well as relative Rényi entropies) completely characterise the uncertainty of a system, hence implies the insufficiency of Shannon entropy (as well as relative entropy) in capturing the information in the presence of strong fluctuation. We also generalise Jarzynski equality in terms of relative Rényi entropies and show the equivalence between the generalised equality and the work distribution. As a consequence, an equivalence between a monotonic property of relative Rényi entropies and a kind of second law relations is revealed. In the experimental part, we study the non-equilibrium dynamics of an optically levitated nanosphere system in Knudsen regime and discover that, even though the system is not in equilibrium, the dynamics can still be treated as a Brownian motion with an effective temperature and an effective coefficient. Due to the Gaussian statistics of the levitated sphere, we show how some relevant non-equilibrium properties of the system, including several local temperatures, can be analysed from its power spectrum.

•Aug 1, 2016•0 citations
The paper analyzes the probability distribution of the occupancy numbers and the entropy of a system at the equilibrium composed by an arbitrary number of non-interacting bosons. The probability distribution is obtained through two approaches: one involves tracing out the environment from a bosonic eigenstate of the combined environment and system of interest (the empirical approach), while the other involves tracing out the environment from the mixed state of the combined environment and system of interest (the Bayesian approach). In the thermodynamic limit, the two coincide and are equal to the multinomial distribution. Furthermore, the paper proposes to identify the physical entropy of the bosonic system with the Shannon entropy of the occupancy numbers, fixing certain contradictions that arise in the classical analysis of thermodynamic entropy. Finally, by leveraging an information-theoretic inequality between the entropy of the multinomial distribution and the entropy of the multivariate hypergeometric distribution, Bayesianism of information theory and empiricism of statistical mechanics are integrated into a common "infomechanical" framework.
The paper works out the canonical probability distribution of the occupancy numbers of a bosonic system and shows that canonical typicality applies to the canonical density operator of the occupancy numbers. The result is that, if, as it is today standard, the canonical system's mixed state is obtained by tracing out the environment from any typical pure state of the universe, then asymptotically the canonical probability distribution of system's occupancy numbers tends in probability to the multinomial distribution. The paper also shows that the currently accepted probability distribution of the occupancy numbers of a system with fixed number of particles is not compatible with the commonly accepted notion of canonical system.
In this work, we compare three formulations of thermodynamic entropy for a non-interacting bosonic gas: (i) the grand-canonical Bose-Einstein entropy, (ii) the finite-N canonical entropy obtained from the exact partition function (Ziff, Uhlenbeck, and Kac construction), and (iii) the entropy of a multinomial distribution with Boltzmann categorical probabilities and temperature determined from Clausius' equation. It is well-known that the grand-canonical Bose-Einstein systematically overestimates entropy of canonical systems in regimes where particle-number fluctuations are significant. The exact canonical entropy correctly enforces the particle-number constraint, but recent experimental results suggest that it also overestimates particle-number fluctuations below the crossover temperature. The multinomial distribution is less common in thermodynamics. It addresses in a mathematically exact way the puzzle of the famous -log(N!) term introduced by Gibbs as a deus ex machina in discussions of thermodynamic entropy. One remarkable consequence is that the entropy of the multinomial distribution overcomes the issue of negative entropy at low temperature that affects the Gibbs and the Sackur-Tetrode entropies at low temperature. The analysis presented in the paper shows that the multinomial distribution, equipped with a categorical distribution calibrated in such a way that the resulting multinomial entropy fits Clausius' equation, provides accurate approximations to the canonical entropy in the classical regime, while it is smaller than the canonical entropy below the crossover temperature. One feature of the multinomial distribution is that it predicts lower peak variance of the number of particles in the ground state than the canonical distribution. This is in agreement with recent experimental results; hence, this paper identifies the thermodynamically calibrated multinomial distribution as a candidate alternative to the canonical distribution for thermodynamic bosonic entropy in finite systems.
The paper analyzes the entropy of a system composed by non-interacting and indistinguishable particles whose quantum state numbers are modelled as independent and identically distributed classical random variables. The crucial observation is that, under this assumption, whichever is the number of particles that constitute the system, the occupancy numbers of system's quantum (micro)states are multinomially distributed. This observation leads to an entropy formula for the physical system, which is nothing else than the entropy formula of the multinomial distribution, for which we claim novelty, in the sense that it is proposed here for the first time that the entropy of the multinomial distribution is the entropy of the physical system. The entropy formula of the multinomial distribution unveils yet unexplored connections between information theory and statistical mechanics, among which we mention the connection between conditional entropy of the random microstate given the random occupancy numbers and the Boltzmann-Planck entropy log⁡(W)\log(W)log(W) and between these two and the Gibbs correction term log⁡(N!)\log(N!)log(N!), thermalization and communication-theoretic preparation of a thermal state, accessible information of the thermal state and physical entropy of the thermalized system. A noticeable specific result that descends from our approach is the exact quantum correction to the textbook Sackur-Tetrode formula for the entropy of an ideal gas at the thermal equilibrium in a container.
The physical basis of the canonical and grand canonical distributions is questioned. In particular, we question the usual methods by which these distributions are derived, namely that fluctuations in entropy around energy and particle number are assumed to occur when the entropy depends only on variables which cannot themselves fluctuate. We show, starting from the Maxwellian velocity distribution, that the probability that a classical ideal gas at a fixed temperature occupies a given energy state corresponds not to the canonical ensemble of classical statistical mechanics but to the Gamma distribution. Computer simulations of a hard-sphere fluid demonstrate the principles. The analysis is extended to open systems in which the number of particles fluctuates and we show that for a system connected to a particle reservoir the Poisson distribution governs the probability of finding a given number of particles. The resulting probability distributions are used to calculate the Shannon information entropy which is then compared with the thermodynamic entropy. We argue that information theoretic entropy and thermodynamic entropy, whilst related, are not necessarily identical and that the information entropy contains non-thermodynamic components.
This paper introduces a novel definition of non-classical information entropy, rooted in the principles of statistical physics, particularly quantum mechanics. The core premise is that traditional information entropy, derived from classical probability theory, is insufficient to capture the essence of information within non-classical systems exhibiting phenomena such as superposition and entanglement. We propose a definition based on the concept of accessible states and their associated probabilities, extending the notion of entropy beyond the realm of purely deterministic systems. The paper details the mathematical formulation of this non-classical information entropy, denoted as *Hnc*, and presents a method for its calculation. The method relies on identifying the set of accessible states for a given system and then applying a generalized form of Shannon's entropy formula, modified to account for the inherent uncertainties associated with quantum mechanics. The resulting *Hnc* provides a quantitative measure of the information content within non-classical systems, offering a potential framework for studying information processing and dynamics in quantum environments. The key contribution lies in bridging the gap between information theory and non-classical statistical physics, offering a new lens through which to understand information in quantum systems.
A probability distribution encodes all the statistics of its corresponding random variable, hence it encodes all one can learn about the system via the random variable. In the theoretical part of this thesis, we discuss several equivalent representations of probability distributions in physics which establishes their roles as complete information measures in their own contexts. In particular, we show how Rényi entropies (as well as relative Rényi entropies) completely characterise the uncertainty of a system, hence implies the insufficiency of Shannon entropy (as well as relative entropy) in capturing the information in the presence of strong fluctuation. We also generalise Jarzynski equality in terms of relative Rényi entropies and show the equivalence between the generalised equality and the work distribution. As a consequence, an equivalence between a monotonic property of relative Rényi entropies and a kind of second law relations is revealed. In the experimental part, we study the non-equilibrium dynamics of an optically levitated nanosphere system in Knudsen regime and discover that, even though the system is not in equilibrium, the dynamics can still be treated as a Brownian motion with an effective temperature and an effective coefficient. Due to the Gaussian statistics of the levitated sphere, we show how some relevant non-equilibrium properties of the system, including several local temperatures, can be analysed from its power spectrum.