The three main points of this article are: 1. Quantum mechanical data differ from conventional data: for example, joint distributions usually cannot be defined conventionally; 2. rigorous methods have been developed for analyzing such data; the methods often use quantum-consistent analogs of classical statistical procedures; 3. with these procedures, statisticians, both data-analytic and more theoretically oriented, can become active participants in many new and emerging areas of science and biotechnology. In the physical realm described by quantum mechanics, many conventional statistical and probabilistic assumptions no longer hold. Probabilistic ideas are central to quantum theory but the standard Kolmogorov axioms are not uniformly applicable. Studying such phenomena requires an altered model for sample spaces, for random variables and for inference and decision making. The appropriate decision theory has been in development since the mid-1960s. It is both mathematically and statistically rigorous and conforms to the requirements of the known physical results. This article provides a tour of the structure and current applications of quantum-consistent statistical inference and decision theory. It presents examples, outlines the theory and considers applications and open problems. Certain central concepts of quantum theory are more clearly apprehended in terms of the quantum-consistent statistical decision theory. For example, the Heisenberg uncertainty principle can be obtained as a consequence of the quantum version of the Cramer-Rao inequality. This places concepts of statistical estimation and decision theory, and thus the statistician, at the center of the quantum measurement process. Quantum statistical inference offers considerable scope for participation by the statistical community, in both applications and foundational questions.
The three main points of this article are: 1. Quantum mechanical data differ from conventional data: for example, joint distributions usually cannot be defined conventionally; 2. rigorous methods have been developed for analyzing such data; the methods often use quantum-consistent analogs of classical statistical procedures; 3. with these procedures, statisticians, both data-analytic and more theoretically oriented, can become active participants in many new and emerging areas of science and biotechnology. In the physical realm described by quantum mechanics, many conventional statistical and probabilistic assumptions no longer hold. Probabilistic ideas are central to quantum theory but the standard Kolmogorov axioms are not uniformly applicable. Studying such phenomena requires an altered model for sample spaces, for random variables and for inference and decision making. The appropriate decision theory has been in development since the mid-1960s. It is both mathematically and statistically rigorous and conforms to the requirements of the known physical results. This article provides a tour of the structure and current applications of quantum-consistent statistical inference and decision theory. It presents examples, outlines the theory and considers applications and open problems. Certain central concepts of quantum theory are more clearly apprehended in terms of the quantum-consistent statistical decision theory. For example, the Heisenberg uncertainty principle can be obtained as a consequence of the quantum version of the Cramer-Rao inequality. This places concepts of statistical estimation and decision theory, and thus the statistician, at the center of the quantum measurement process. Quantum statistical inference offers considerable scope for participation by the statistical community, in both applications and foundational questions.
In this chapter, we consider the way quantum theory represents deterministic, statistical, and probabilistic aspects of Nature. After a discussion in Section 3.1 of uncertainty in general, we discuss in Sections 3.2-3.4 several formal notions of classical probability, their relation to the probability concept used in applied statistics, and their dependence on the description used. Section 3.5 briefly discusses various examples, where probabilistic features emerge from fully deterministic situations-a theme to be taken up in much more detail in Chapter 11. Section 3.6 then shows how the statistical aspects of the quantum formalism naturally follow from the weak law of large numbers. The notions of c-probability in the classical case and of q-probability in the quantum case are formally defined in Section 3.7. Historically, the concept of classical probability (including its use in stochastic processes) was given an undisputed formal mathematical foundation in 1933 in terms of the measure-theoretic setting of Kolmogorov [164]. Apart from this traditional axiomatic foundation of classical probability theory, there is a less well-known equivalent axiomatic treatment by Whittle [302] in terms of expectations. Here probabilities appear as the expectations of statements, {0, 1}-valued random variables. von Plato [240] discusses the history of the concept of probability. Krüger et al. [169] discuss the history of probability in the various fields of application. Sklar [275] discusses the philosophical problems of the probability concept, with an emphasis on statistical mechanics.
Originally, quantum probability theory was developed to analyze statistical phenomena in quantum systems, where classical probability theory does not apply, because the lattice of measurable sets is not necessarily distributive. On the other hand, it is well known that the lattices of concepts, that arise in data analysis, are in general also non-distributive, albeit for completely different reasons. In his recent book, van Rijsbergen argues that many of the logical tools developed for quantum systems are also suitable for applications in information retrieval. I explore the mathematical support for this idea on an abstract vector space model, covering several forms of data analysis (information retrieval, data mining, collaborative filtering, formal concept analysis...), and roughly based on an idea from categorical quantum mechanics. It turns out that quantum (i.e., noncommutative) probability distributions arise already in this rudimentary mathematical framework. We show that a Bell-type inequality must be satisfied by the standard similarity measures, if they are used for preference predictions. The fact that already a very general, abstract version of the vector space model yields simple counterexamples for such inequalities seems to be an indicator of a genuine need for quantum statistics in data analysis.
Quantum mechanics is basically a mathematical recipe on how to construct physical models. Historically its origin and main domain of application has been in the microscopic regime, although it strictly seen constitutes a general mathematical framework not limited to this regime. Since it is a statistical theory, the meaning and role of probabilities in it need to be defined and understood in order to gain an understanding of the predictions and validity of quantum mechanics. The interpretational problems of quantum mechanics are also connected with the interpretation of the concept of probability. In this thesis the use of probability theory as extended logic, in particular in the way it was presented by E. T. Jaynes, will be central. With this interpretation of probabilities they become a subjective notion, always dependent on one's state of knowledge or the context in which they are assigned, which has consequences on how things are to be viewed, understood and tackled in quantum mechanics. For instance, the statistical operator or density operator, is usually defined in terms of probabilities and therefore also needs to be updated when the probabilities are updated by acquisition of additional data. Furthermore, it is a context dependent notion, meaning, e.g., that two observers will in general assign different statistical operators to the same phenomenon, which is demonstrated in the papers of the thesis. It is also presented an alternative and conceptually clear approach to the problematic notion of "probabilities of probabilities", which is related to such things as probability distributions on statistical operators. In connection to this, we consider concrete numerical applications of Bayesian quantum state assignment methods to a three-level quantum system, where prior knowledge and various kinds of measurement data are encoded into a statistical operator, which can then be used for deriving probabilities of other measurements. The thesis also offers examples of an alternative quantum state assignment technique, using maximum entropy methods, which in some cases are compared with the Bayesian quantum state assignment methods. Finally, the interesting and important problem whether the statistical operator, or more generally quantum mechanics, gives a complete description of "objective physical reality" is considered. A related concern is here the possibility of finding a "local hidden-variable theory" underlying the quantum mechanical description. There have been attempts to prove that such a theory cannot be constructed, where the most well-known impossibility proof claiming to show this was given by J. S. Bell. In connection to this, the thesis presents an idea for an interpretation or alternative approach to quantum mechanics based on the concept of space-time.
The history of mathematical modeling outside physics has been dominated by the use of classical mathematical models, C-models, primarily those of a probabilistic or statistical nature. More recently, however, quantum mathematical models, Q-models, based in the mathematical formalism of quantum theory have become more prominent in psychology, economics, and decision science. The use of Q-models in these fields remains controversial, in part because it is not entirely clear whether Q-models are necessary for dealing with the phenomena in question or whether C-models would still suffice. My aim, however, is not to assess the necessity of Q-models in these fields, but instead to reflect on what the possible applicability of Q-models may tell us about the corresponding phenomena there, vis-à-vis quantum phenomena in physics. In order to do so, I shall first discuss the key reasons for the use of Q-models in physics. In particular, I shall examine the fundamental principles that led to the development of quantum mechanics. Then I shall consider a possible role of similar principles in using Q-models outside physics. Psychology, economics, and decision science borrow already available Q-models from quantum theory, rather than derive them from their own internal principles, while quantum mechanics was derived from such principles, because there was no readily available mathematical model to handle quantum phenomena, although the mathematics ultimately used in quantum did in fact exist then. I shall argue, however, that the principle perspective on mathematical modeling outside physics might help us to understand better the role of Q-models in these fields and possibly to envision new models, conceptually analogous to but mathematically different from those of quantum theory, helpful or even necessary there or in physics itself. I shall suggest one possible type of such models, singularized probabilistic, SP, models, some of which are time-dependent, TDSP-models. The necessity of using such models may change the nature of mathematical modeling in science and, thus, the nature of science, as it happened in the case of Q-models, which not only led to a revolutionary transformation of physics but also opened new possibilities for scientific thinking and mathematical modeling beyond physics.
As we enter the era of quantum technologies, quantum estimation theory provides an operationally motivating framework for determining high precision devices in modern technological applications. The aim of any estimation process is to extract information from an unknown parameter embedded in a physical system such as the estimation converges to the true value of the parameter. According to the Cramér-Rao inequality in mathematical statistics, the Fisher information in the case of single-parameter estimation procedures, and the Fisher information matrix in the case of multi-parameter estimation, are the key quantities representing the ultimate precision of the parameters specifying a given statistical model. In quantum estimation strategies, it is usually difficult to derive the analytical expressions of such quantities in a given quantum state. This review provides comprehensive techniques on the analytical calculation of the quantum Fisher information as well as the quantum Fisher information matrix in various scenarios and via several methods. Furthermore, it provides a mathematical transition from classical to quantum estimation theory applied to many freedom quantum systems. To clarify these results, we examine these developments using some examples. Other challenges, including their links to quantum correlations and saturating the quantum Cramér-Rao bound, are also addressed.
Quantum mechanics has achieved unparalleled success as an operational theory, describing a wide range of experiments to remarkable accuracy. However, the physical foundations on which it rests remain as puzzling as they were a century ago, and a concise statement of the physical principles that underlie quantum mechanics is still outstanding. One promising approach holds that these principles should be formulated in terms of information, since many of the counter-intuitive effects in quantum theory concern questions such as what one can know about a quantum system and how the information encoded therein can be processed and distributed between parties. Another challenging feature of quantum theory is its incompatibility with the other cornerstone of modern physics, general relativity. In order to reconcile the two, one must identify and retain only the essential concepts and principles of each theory, and in the case of general relativity, causality has been identified as such a concept. This raises the question of how our classical understanding of causality must change when quantum theory is taken into account. In order to address these questions about information, knowledge and causality, I turn to the framework of causal models. In classical statistics, causal models explain the relations among a set of variables in terms of causal influences, which makes them a powerful tool for structuring our knowledge about complex systems and developing strategies for interacting with them. More importantly, the framework provides the conceptual underpinnings and mathematical methods for addressing questions about causation, information and knowledge in a rigorous manner. In this thesis, I develop a version of the classical causal models framework that is compatible with quantum theory and explore its physical implications. \n \n \nA first step is to define quantum versions of fundamental elements such as variables, conditionals and belief propagation rules. This allows one to consider the question of what one can come to know about a quantum variable from the point of view of causal modelling. The conditionals relating quantum variables are found to have a richer structure than their classical counterparts, which can be exploited for the task of discerning causal relations given limited data -- a central problem in classical causal modelling. The mathematical properties of quantum conditionals also establish a correspondence between various classes of two-party correlations, such as bound and distillable entanglement, and the types of causal structures that can give rise to them, which may become a useful tool for entanglement theory and quantum information processing. In the context of open quantum systems dynamics, quantum causal models provide a clear physical explanation of not completely positive maps and, more broadly, of non-Markovian quantum dynamics. Finally, I consider the possibility of non-classical effects in the way that different causal mechanisms are combined -- that is, non-classical causal structures. For the simple case of two causally ordered variables, I propose indicators that witness different classes of combinations of causal mechanisms, including a non-classical mixture, and describe an experiment realizing examples of the different classes. \n \n \nAs these results illustrate, the framework of quantum causal models provides both greater conceptual clarity and a comprehensive mathematical formalism for studying a diverse set of problems, ranging from foundational questions to applications in open systems dynamics and the exploration of non-classical causal structures, which are likely to feature in a future theory of quantum gravity. The material presented in this thesis is intended as a foundation and inspiration for further applications of quantum causal models.