The quantum mechanical concepts of states and operators arise naturally from the question how expectation values of observables can be computed in classical statistical systems where only incomplete local information about the probability distribution is available. The notions of evolution and time are related to the translation of the available information between neighboring local regions. The complex structure of quantum mechanics, the superposition of states and the interference effects characteristic for quantum statistics find a simple origin. This suggests the emergence of quantum mechanics from classical statistics with infinitely many degrees of freedom.
The quantum mechanical concepts of states and operators arise naturally from the question how expectation values of observables can be computed in classical statistical systems where only incomplete local information about the probability distribution is available. The notions of evolution and time are related to the translation of the available information between neighboring local regions. The complex structure of quantum mechanics, the superposition of states and the interference effects characteristic for quantum statistics find a simple origin. This suggests the emergence of quantum mechanics from classical statistics with infinitely many degrees of freedom.
The conceptual setting of quantum mechanics is subject to an ongoing debate from its beginnings until now. The consequences of the apparent differences between quantum statistics and classical statistics range from the philosophical interpretations to practical issues as quantum computing. In this note we demonstrate how quantum mechanics can emerge from classical statistical systems. We discuss conditions and circumstances for this to happen. Quantum systems describe isolated subsystems of classical statistical systems with infinitely many states. While infinitely many classical observables "measure" properties of the subsystem and its environment, the state of the subsystem can be characterized by the expectation values of only a few probabilistic observables. They define a density matrix, and all the usual laws of quantum mechanics follow. No concepts beyond classical statistics are needed for quantum physics – the differences are only apparent and result from the particularities of those classical statistical systems which admit a quantum mechanical description. In particular, we show how the non-commuting properties of quantum operators are associated to the use of conditiona probabilities within the classical system, and how a unitary time evolution reflects the isolation of the subsystem.
It is shown that Schrödinger's equation may be derived from three postulates. The first is a kind of statistical metamorphosis of classical mechanics, a set of two relations which are obtained from the canonical equations of particle mechanics by replacing all observables by statistical averages. The second is a local conservation law of probability with a probability current which takes the form of a gradient. The third is a principle of maximal disorder as realized by the requirement of minimal Fisher information. The rule for calculating expectation values is obtained from a fourth postulate, the requirement of energy conservation in the mean. The fact that all these basic relations of quantum theory may be derived from premises which are statistical in character is interpreted as a strong argument in favor of the statistical interpretation of quantum mechanics. The structures of quantum theory and classical statistical theories are compared, and some fundamental differences are identified.
In classical mechanics, the state of a physical object is determined by quantities such as mass, momentum, and angular momentum. According to Newton’s laws, for a given initial state, the evolution of the system is deterministic—that is, the state of the object (i.e., its parameters) can be precisely predicted at any future time. In quantum mechanics, however, based on the theory of matter waves, the state of a system is described by a probability wave function. Given an initial state, the time evolution of the system is governed by the Schrödinger equation, which determines the probability distribution of the particle’s position (or other observables) in space over time. The probabilistic nature of the quantum state implies that prior to measurement, the system may exist in a superposition of possible states, each associated with a certain probability amplitude. In physics, measurement refers to the experimental determination of mechanical quantities such as position, momentum, energy, and angular momentum. In classical mechanics, the act of measurement does not influence the physical state of the object; the system remains unaffected by the observation. In contrast, quantum measurement fundamentally alters the state: once a definite value of an observable is measured, the wave function collapses to the corresponding eigenstate. This signifies that the probabilistic description of the system with respect to that observable becomes a definite state—the system’s wave function is projected accordingly. Thus, the state of a quantum system is inherently measurement-dependent, and by measuring a mechanical quantity, one effectively determines the corresponding probability distribution, or wave function, associated with that observable. Therefore, the relationship between observables (mechanical quantities) and state wave functions, as well as the mathematical structure connecting them, constitutes one of the central concerns of quantum theory. As previously discussed, the Schrödinger equation involves expressions for energy and momentum that act on wave functions in the form of operators. Accordingly, we now proceed to explore the formalism of quantum mechanics based on the concept of operators.
We argue that (1) our perception of time through change and (2) the gap between reality and our observation of it are at the heart of both quantum mechanics and the dynamical mechanism of physical systems. We suggest that the origin of quantum uncertainty lies with the absence of infinities or infinitesimals in observational data and that our concept of time derives from observing changing data (events). We argue that the fundamentally important content of the Superposition Principle is not the "probability amplitude" of posterior state observation but future state availability conditional only on prior information. Since event detection also implies posterior conditions (e.g. a specific type of detectable event occurred) as well as prior conditions, the probabilities of detected outcomes are also conditional on properties of the posterior properties of the observation. Such posterior conditions cannot affect the prior state availabilities and this implies violation of counter-factual definiteness. A component of a quantum system may be chosen to represent a clock and changes in other components can then be expected to be correlated with clocks with which they are entangled. Instead of traditional time-dependent equations of motion we provide a specific mechanism whereby evolution of data is instead quasi-causally related to the relative \availability\ of states and equations of motion are expressed in terms of quantized clock variables. We also suggest that time-reversal symmetry-breaking in weak interactions is an artifice of a conventional choice of co-ordinate time-function. Analysis of a "free" particle suggests that conventional co-ordinate space-time emerges from how we measure the separation of objects and events.
From this chapter we start our exposition of quantum mechanics. First, we lay down the typical setting of a quantum mechanical problem. The fundamental feature of quantum indeterminism and the probabilistic nature of quantum mechanics is emphasized. We proceed by constructing, from the single notion of measurement, all the essential conceptual ingredients of quantum mechanics (i.e., the concepts of observable, state and system). Then we formulate the target questions that quantum mechanics aims to solve. Next, we proceed to state the specific laws that constitute the logical premise of the subject. Finally, we demonstrate how the laws, most dominantly, the superposition principle (the fact that quantum probabilities interfere) provides an improved recipe for obtaining the answers to the target questions of quantum mechanics. This also leads to a more refined definition of the quantum state. In order to be able to quickly introduce the basic framework of quantum mechanics, we restrict the discussion to a simple scenario of “instantaneously subsequent measurements” (where there is no time evolution), and where states can be prepared by a single measurement (in the standard jargon, this would be called, “quantum mechanics without degeneracy”; these are descriptions involving CSCOs comprising just one observable).
We formulate incomplete classical statistics for situations where the knowledge about the probability distribution outside a local region is limited. The information needed to compute expectation values of local observables can be collected in a quantum mechanical state vector, whereas further statistical information about the probability distribution outside the local region becomes irrelevant. The translation of the available information between neighboring local regions is expressed by a Hamilton operator. A quantum mechanical operator can be associated to each local observable, such that expectation values of ``classical'' observables can be computed by the usual quantum mechanical rules. The requirement that correlation functions should respect equivalence relations for local obeservables induces a non-commutative product in classical statistics, in complete correspondence to the quantum mechanical operator product. We also discuss the issue of interference and the complex structure of quantum mechanics within our classical statistical setting.