Although Gödel's incompleteness theorem made mathematician recognize that no axiomatic system could completely prove its correctness and that there is an eternal hole between our knowledge and the world, physicists so far continue to work on the approaches based on the hypothesis to completely or approximately know the systems of interest. In this paper, however, I review the recent development of a different approach, a statistical theory based upon the notion of incomplete information. This consideration leads to generalized statistical mechanics characterized by an incompleteness parameter which equals unity when information is complete. The mathematical and physical bases of the information incompleteness are discussed. The application of the concomitant incomplete quantum distribution to correlated electron systems is reviewed.
Although Gödel's incompleteness theorem made mathematician recognize that no axiomatic system could completely prove its correctness and that there is an eternal hole between our knowledge and the world, physicists so far continue to work on the approaches based on the hypothesis to completely or approximately know the systems of interest. In this paper, however, I review the recent development of a different approach, a statistical theory based upon the notion of incomplete information. This consideration leads to generalized statistical mechanics characterized by an incompleteness parameter which equals unity when information is complete. The mathematical and physical bases of the information incompleteness are discussed. The application of the concomitant incomplete quantum distribution to correlated electron systems is reviewed.
Abstract The reconstruction of quantum physics has been connected with the interpretation of the quantum formalism, and has continued to be so with the recent deeper consideration of the relation of information to quantum states and processes. This recent form of reconstruction has mainly involved conceiving quantum theory on the basis of informational principles, providing new perspectives on physical correlations and entanglement that can be used to encode information. By contrast to the traditional, interpretational approach to the foundations of quantum mechanics, which attempts directly to establish the meaning of the elements of the theory and often touches on metaphysical issues, the newer, more purely reconstructive approach sometimes defers this task, focusing instead on the mathematical derivation of the theoretical apparatus from simple principles or axioms. In its most pure form, this sort of theory reconstruction is fundamentally the mathematical derivation of the elements of theory from explicitly presented, often operational principles involving a minimum of extra‐mathematical content. Here, a representative series of specifically information‐based treatments—from partial reconstructions that make connections with information to rigorous axiomatizations, including those involving the theories of generalized probability and abstract systems—is reviewed.
We show how Gödel's first incompleteness theorem has an analog in quantum theory. Gödel's theorem implies endless opportunities for appending axioms to arithmetic, implicitly showing a role for an agent, namely an agent that asserts an axiom. There is an analog of this theorem in physics, to do with the set of explanations of given evidence. We prove that the set of explanations of given evidence is uncountably infinite, thereby showing how contact between theory and experiment depends on activity beyond computation and measurement -- physical activity characterized as agency.
A survey of recent ideas and goals, along with a brief history behind the quantification of uncertainties and statistical correlation in quantum systems is presented. The focus is on ideas and connections taken from information theory, in particular, the quantification of uncertainties via Shannon entropies, the entropic uncertainty relation, and statistical correlation by mutual information. A discussion of phase-space distributions and their use in information theory is also given. An incomplete list of applications, with emphasis on confined quantum systems, is provided. The article concludes by addressing future challenges in these directions.
We formulate incomplete classical statistics for situations where the knowledge about the probability distribution outside a local region is limited. The information needed to compute expectation values of local observables can be collected in a quantum mechanical state vector, whereas further statistical information about the probability distribution outside the local region becomes irrelevant. The translation of the available information between neighboring local regions is expressed by a Hamilton operator. A quantum mechanical operator can be associated to each local observable, such that expectation values of ``classical'' observables can be computed by the usual quantum mechanical rules. The requirement that correlation functions should respect equivalence relations for local obeservables induces a non-commutative product in classical statistics, in complete correspondence to the quantum mechanical operator product. We also discuss the issue of interference and the complex structure of quantum mechanics within our classical statistical setting.
Quantum mechanics has irked physicists ever since its conception more than 100 years ago. While some of the misgivings, such as it being unintuitive, are merely aesthetic, quantum mechanics has one serious shortcoming: it lacks a physical description of the measurement process. This ``measurement problem'' indicates that quantum mechanics is at least an incomplete theory -- good as far as it goes, but missing a piece -- or, more radically, is in need of complete overhaul. Here we describe an approach which may provide this sought-for completion or replacement: Superdeterminism. A superdeterministic theory is one which violates the assumption of Statistical Independence (that distributions of hidden variables are independent of measurement settings). Intuition suggests that Statistical Independence is an essential ingredient of any theory of science (never mind physics), and for this reason Superdeterminism is typically discarded swiftly in any discussion of quantum foundations. The purpose of this paper is to explain why the existing objections to Superdeterminism are based on experience with classical physics and linear systems, but that this experience misleads us. Superdeterminism is a promising approach not only to solve the measurement problem, but also to understand the apparent nonlocality of quantum physics. Most importantly, we will discuss how it may be possible to test this hypothesis in an (almost) model independent way.
This paper addresses the question of how we should regard the probability distributions introduced into statistical mechanics. It will be argued that it is problematic to take them either as purely ontic, or purely epistemic. I will propose a third alternative: they are almost objective probabilities, or epistemic chances. The definition of such probabilities involves an interweaving of epistemic and physical considerations, and thus they cannot be classified as either purely epistemic or purely ontic. This conception, it will be argued, resolves some of the puzzles associated with statistical mechanical probabilities: it explains how probabilistic posits introduced on the basis of incomplete knowledge can yield testable predictions, and it also bypasses the problem of disastrous retrodictions, that is, the fact the standard equilibrium measures yield high probability of the system being in equilibrium in the recent past, even when we know otherwise. As the problem does not arise on the conception of probabilities considered here, there is no need to invoke a Past Hypothesis as a special posit to avoid it.