Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:cond-mat/0109324 · AIP conference proceedings

Yet another resolution of the Gibbs paradox: an information theory approach

Chih‐Yuan Tseng

Published Jan 1, 2002• 20 citations
arXivHTMLPDF

Abstract

The “Gibbs Paradox” refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to count states in systems of identical particles. Several authors have recognized that the paradox is resolved once it is realized that there is no such thing as the entropy of a system, that there are many entropies, and that the choice between treating particles as being distinguishable or not depends on the resolution of the experiment. The purpose of this note is essentially pedagogical; we add to their analysis by examining the paradox from the point of view of information theory. Our argument is based on that ‘grouping’ property of entropy that Shannon recognized, by including it among his axioms, as an essential requirement on any measure of information. Not only does it provide the right connection between different entropies but, in addition, it draws our attention to the obvious fact that addressing issues of distinguishability and of counting states requires a clear idea about what precisely do we mean by a state.

DOI
10.1063/1.1477057

Related papers

The Gibbs Paradox: Lessons from Thermodynamics

Janneke van Lith

The Gibbs paradox in statistical mechanics is often taken to indicate that already in the classical domain particles should be treated as fundamentally indistinguishable. This paper shows, on the contrary, how one can recover the thermodynamical account of the entropy of mixing, while treating states that only differ by permutations of similar particles as distinct. By reference to the orthodox theory of thermodynamics, it is argued that entropy differences are only meaningful if they are related to reversible processes connecting the initial and final state. For mixing processes, this means that processes should be considered in which particle number is allowed to vary. Within the context of statistical mechanics, the Gibbsian grandcanonical ensemble is a suitable device for describing such processes. It is shown how the grandcanonical entropy relates in the appropriate way to changes of other thermodynamical quantities in reversible processes, and how the thermodynamical account of the entropy of mixing is recovered even when treating the particles as distinguishable.

Entropy•Apr 30, 2018•8 citations

The Gibbs paradox and the physical criteria for indistinguishability of identical particles

C. S. Unnikrishnan

Gibbs paradox in the context of statistical mechanics addresses the issue of additivity of entropy of mixing gases. The usual discussion attributes the paradoxical situation to classical distinguishability of identical particles and credits quantum theory for enabling indistinguishability of identical particles to solve the problem. We argue that indistinguishability of identical particles is already a feature in classical mechanics and this is clearly brought out when the problem is treated in the language of information and associated entropy. We pinpoint the physical criteria for indistinguishability that is crucial for the treatment of the Gibbs’ problem and the consistency of its solution with conventional thermodynamics. Quantum mechanics provides a quantitative criterion, not possible in the classical picture, for the degree of indistinguishability in terms of visibility of quantum interference, or overlap of the states as pointed out by von Neumann, thereby endowing the entropy expression with mathematical continuity and physical reasonableness.

arXiv:1811.03967•International Journal of Quantum Information•Aug 18, 2016•2 citations

The Gibbs Paradox. About the paradox and the indistinguishability of identical particles

S.C. van Berkum

The Gibbs Paradox is an important question in thermodynamics. In this thesis I search for a solution for the paradox from a classical, philosophical and quantum mechanical point of view. A common way to solve the Gibbs Paradox is by using the reduced entropy. However, this definition of entropy should not be interpreted as an argument for the indistinguishability of identical particles, because all other particles which have unique trajectories through space-time are distinguishable in principle. The Gibbs paradox could be solved in a few ways, but each solution has certain constrains.

•May 26, 2014•0 citations

Comment on “The Gibbs paradox and the distinguishability of identical particles,” by M. A. M. Versteegh and D. Dieks [Am. J. Phys. 79, 741–746 (2011)]

David S. Corti

We revisit recent discussions concerning the Gibbs paradox—the apparent discrepancy between the entropy change upon mixing identical gases as evaluated from the statistical mechanics of classical distinguishable particles and macroscopic thermodynamics. Contrary to what is often stated, we show that thermodynamics does not require this entropy of mixing to be zero. A zero value follows from the implicit assumption that the identical gas particles are indistinguishable. If the identical particles are explicitly assumed to be distinguishable, thermodynamics yields the same entropy of mixing as classical statistical mechanics.

American Journal of Physics•Jan 20, 2012•7 citations

Resolution of the Gibbs paradox via quantum thermodynamics

ARMEN E. ALLAHVERDYAN, Theo M. Nieuwenhuizen

The issue of the Gibbs paradox is that when considering the mixing of two gases within classical thermodynamics, the entropy of mixing is a discontinuous function of the difference between the gases: it is finite for no matter how small difference, but vanishes for identical gases. The resolution offered in literature with help of quantum mixing entropy was later on shown to be unsatisfactory precisely where it sought to resolve the paradox. Within quantum thermodynamics entropy looses its dominant place. It is argued that the target of the paradox is shifted to the decrease of the available work upon mixing (mixing work), which in contrast to entropy is an unambiguous quantity. For almost identical gases the mixing work continuously goes to zero, thus resolving the paradox. In this approach the concept of ``difference between the gases'' attains a clear operational meaning related to possibilities of controlling the involved quantum states. The difficulties which prevent the resolution of the paradox in its entropic formulation do not arise here. The mixing work can increase when less precise operations are allowed. In contrast to the classical situation, in the quantum case the amount of mixing work can also increase when decreasing the degree of mixing between the gases, or when decreasing their distinguishability. These points go against a direct quantitative association of physical irreversibility with lack of information.

•Jul 15, 2005•0 citations

The Gibbs paradox and the distinguishability of identical particles

Marijn A. M. Versteegh, Dennis Dieks

Identical classical particles are distinguishable. This distinguishability affects the number of ways W a macrostate can be realized on the microlevel, and from the relation S=k ln W leads to a nonextensive expression for the entropy. This result is usually considered incorrect because of its inconsistency with thermodynamics. It is sometimes concluded from this inconsistency that identical particles are fundamentally indistinguishable and that quantum mechanics is indispensable for making sense of this inconsistency. In contrast, we argue that the classical statistics of distinguishable particles and the resulting nonextensive entropy function are perfectly acceptable from both a theoretical and an experimental perspective. The inconsistency with thermodynamics can be removed by taking into account that the entropy concept in statistical mechanics is not completely identical to the thermodynamical one. We observe that even identical quantum particles are in some cases distinguishable, and conclude that quantum mechanics is irrelevant to the Gibbs paradox.

arXiv:1012.4111•American Journal of Physics•Jun 17, 2011•45 citations
The “Gibbs Paradox” refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to count states in systems of identical particles. Several authors have recognized that the paradox is resolved once it is realized that there is no such thing as the entropy of a system, that there are many entropies, and that the choice between treating particles as being distinguishable or not depends on the resolution of the experiment. The purpose of this note is essentially pedagogical; we add to their analysis by examining the paradox from the point of view of information theory. Our argument is based on that ‘grouping’ property of entropy that Shannon recognized, by including it among his axioms, as an essential requirement on any measure of information. Not only does it provide the right connection between different entropies but, in addition, it draws our attention to the obvious fact that addressing issues of distinguishability and of counting states requires a clear idea about what precisely do we mean by a state.
The Gibbs paradox in statistical mechanics is often taken to indicate that already in the classical domain particles should be treated as fundamentally indistinguishable. This paper shows, on the contrary, how one can recover the thermodynamical account of the entropy of mixing, while treating states that only differ by permutations of similar particles as distinct. By reference to the orthodox theory of thermodynamics, it is argued that entropy differences are only meaningful if they are related to reversible processes connecting the initial and final state. For mixing processes, this means that processes should be considered in which particle number is allowed to vary. Within the context of statistical mechanics, the Gibbsian grandcanonical ensemble is a suitable device for describing such processes. It is shown how the grandcanonical entropy relates in the appropriate way to changes of other thermodynamical quantities in reversible processes, and how the thermodynamical account of the entropy of mixing is recovered even when treating the particles as distinguishable.
Gibbs paradox in the context of statistical mechanics addresses the issue of additivity of entropy of mixing gases. The usual discussion attributes the paradoxical situation to classical distinguishability of identical particles and credits quantum theory for enabling indistinguishability of identical particles to solve the problem. We argue that indistinguishability of identical particles is already a feature in classical mechanics and this is clearly brought out when the problem is treated in the language of information and associated entropy. We pinpoint the physical criteria for indistinguishability that is crucial for the treatment of the Gibbs’ problem and the consistency of its solution with conventional thermodynamics. Quantum mechanics provides a quantitative criterion, not possible in the classical picture, for the degree of indistinguishability in terms of visibility of quantum interference, or overlap of the states as pointed out by von Neumann, thereby endowing the entropy expression with mathematical continuity and physical reasonableness.
The Gibbs Paradox is an important question in thermodynamics. In this thesis I search for a solution for the paradox from a classical, philosophical and quantum mechanical point of view. A common way to solve the Gibbs Paradox is by using the reduced entropy. However, this definition of entropy should not be interpreted as an argument for the indistinguishability of identical particles, because all other particles which have unique trajectories through space-time are distinguishable in principle. The Gibbs paradox could be solved in a few ways, but each solution has certain constrains.
We revisit recent discussions concerning the Gibbs paradox—the apparent discrepancy between the entropy change upon mixing identical gases as evaluated from the statistical mechanics of classical distinguishable particles and macroscopic thermodynamics. Contrary to what is often stated, we show that thermodynamics does not require this entropy of mixing to be zero. A zero value follows from the implicit assumption that the identical gas particles are indistinguishable. If the identical particles are explicitly assumed to be distinguishable, thermodynamics yields the same entropy of mixing as classical statistical mechanics.
The issue of the Gibbs paradox is that when considering the mixing of two gases within classical thermodynamics, the entropy of mixing is a discontinuous function of the difference between the gases: it is finite for no matter how small difference, but vanishes for identical gases. The resolution offered in literature with help of quantum mixing entropy was later on shown to be unsatisfactory precisely where it sought to resolve the paradox. Within quantum thermodynamics entropy looses its dominant place. It is argued that the target of the paradox is shifted to the decrease of the available work upon mixing (mixing work), which in contrast to entropy is an unambiguous quantity. For almost identical gases the mixing work continuously goes to zero, thus resolving the paradox. In this approach the concept of ``difference between the gases'' attains a clear operational meaning related to possibilities of controlling the involved quantum states. The difficulties which prevent the resolution of the paradox in its entropic formulation do not arise here. The mixing work can increase when less precise operations are allowed. In contrast to the classical situation, in the quantum case the amount of mixing work can also increase when decreasing the degree of mixing between the gases, or when decreasing their distinguishability. These points go against a direct quantitative association of physical irreversibility with lack of information.
Identical classical particles are distinguishable. This distinguishability affects the number of ways W a macrostate can be realized on the microlevel, and from the relation S=k ln W leads to a nonextensive expression for the entropy. This result is usually considered incorrect because of its inconsistency with thermodynamics. It is sometimes concluded from this inconsistency that identical particles are fundamentally indistinguishable and that quantum mechanics is indispensable for making sense of this inconsistency. In contrast, we argue that the classical statistics of distinguishable particles and the resulting nonextensive entropy function are perfectly acceptable from both a theoretical and an experimental perspective. The inconsistency with thermodynamics can be removed by taking into account that the entropy concept in statistical mechanics is not completely identical to the thermodynamical one. We observe that even identical quantum particles are in some cases distinguishable, and conclude that quantum mechanics is irrelevant to the Gibbs paradox.