Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2411.16396

Statistical inference for quantum singular models

Hiroshi Yano, Yota Maeda, Naoki Yamamoto

Published Nov 25, 2024• 1 citation
arXivHTMLPDF

Abstract

Deep learning has seen substantial achievements, with numerical and theoretical evidence suggesting that singularities of statistical models are considered a contributing factor to its performance. From this remarkable success of classical statistical models, it is naturally expected that quantum singular models will play a vital role in many quantum statistical tasks. However, while the theory of quantum statistical models in regular cases has been established, theoretical understanding of quantum singular models is still limited. To investigate the statistical properties of quantum singular models, we focus on two prominent tasks in quantum statistical inference: quantum state estimation and model selection. In particular, we base our study on classical singular learning theory and seek to extend it within the framework of Bayesian quantum state estimation. To this end, we define quantum generalization and training loss functions and give their asymptotic expansions through algebraic geometrical methods. The key idea of the proof is the introduction of a quantum analog of the likelihood function using classical shadows. Consequently, we construct an asymptotically unbiased estimator of the quantum generalization loss, the quantum widely applicable information criterion (QWAIC), as a computable model selection metric from given measurement outcomes.

DOI
10.48550/arxiv.2411.16396

Related papers

Quantum information criteria for model selection in quantum state estimation

Hiroshi Yano, Naoki Yamamoto

Abstract Quantum state estimation (or state tomography) is an indispensable task in quantum information processing. Because full state tomography that determines all elements of the density matrix is computationally demanding, one usually takes the strategy of assuming a certain model of quantum states and identifying the model parameters. However, it is difficult to make a valid assumption given little prior knowledge on a quantum state of interest, and thus we need a reasonable model selection method for quantum state estimation. Actually, in the classical statistical estimation theory, several types of information criteria have been established and widely used in practice for appropriately choosing a classical statistical model. In this study, we propose quantum information criteria for evaluating the quality of the estimated quantum state in terms of the quantum relative entropy, which is a natural quantum analogue of the classical information criterion defined in terms of Kullback–Leibler divergence. In particular, we derive two quantum information criteria depending on the type of an estimator for the quantum relative entropy; one uses the log-likelihood and the other uses the classical shadow. The general role of information criteria is to predict the performance of an estimated model for unseen data, although it is a function of only sampled data; this generalization capability of the proposed quantum information criteria is evaluated in numerical simulations.

arXiv:2304.10949•Journal of Physics A Mathematical and Theoretical•Sep 6, 2023•4 citations

Bayesian Quantum Neural Networks

Nam Nguyen, Kwang‐Cheng Chen

The astounding acceleration in Artificial Intelligence and Quantum Computing advances naturally gives rise to a line of research, which unrolls the potential advantages of quantum computing on classical Machine Learning tasks, known as Quantum Machine Learning or Quantum Machine Intelligence. The typical objectives are either (1) exploring the potential quantum advantages on classical learning tasks or (2) levering well-established classical ML algorithms to tackle quantum-related problems on Noisy Intermediate-Scale Quantum (NISQ) devices. Along the second research direction, we study Quantum Neural Networks (QNNs) to accomplish the purpose of Bayesian learning. By observing a wide range of studies on QNNs, in which the sole training method is based on frequentist training, we find that Bayesian learning benefits QNNs from two aspects. First, Bayesian-trained models enjoy a high level of generalization due to the prior and posterior distribution usage compared to frequentist training, which will be justified by this paper’s theoretical study of model capacity. Second, Bayesian Inference offers epistemic uncertainty estimation, which merits the decision-making process. It is worth mentioning that frequentist-trained QNNs generally lack this desirable property. Under the Bayesian training procedure, our derived models can be considered a new class of QNNs (called BayesianQNNs) which possesses both desirable properties of Bayesian Inference while maintaining comparable predictive performance as frequentist counterparts. The proposed Bayesian Quantum Neural Networks is justified by empirical evidence from numerical experiments.

IEEE Access•Jan 1, 2022•43 citations

Quantum Statistical Inference

Zhikuan Zhao

In this thesis, I present several results on quantum statistical inference in the following two directions. Firstly, I demonstrate that quantum algorithms can be applied to enhance the computing and training of Gaussian processes (GPs), a powerful model widely used in classical statistical inference and supervised machine learning. A crucial component of the quantum GP algorithm is solving linear systems with quantum computers, for which I present a novel algorithm that achieves a provable advantage over previously known methods. I will also explicitly address the task of encoding the classical data into a quantum state for machine learning applications. I then apply the quantum enhanced GPs to Bayesian deep learning and present an experimental demonstration on contemporary hardware and simulators. Secondly, I look into the notion of quantum causality and apply it to inferring spatial and temporal quantum correlations, and present an analytical toolkit for causal inference in quantum data. I will also make the connection between causality and quantum communications, and present a general bound for the quantum capacity of noisy communication channels.

arXiv:1812.04877•Dec 12, 2018•1 citation

On the Parameter Estimation Problem for Quantum Statistical Models

Hiroshi Nagaoka

The parameter estimation problem for a quantum statistical model , where {S θ } are quantum states (i.e. density operators) and Θ is an open set in R n , is considered. The problem is to estimate the true state which is unknown but is assumed to lie in . The quantum analogues of various notions developed in the classical statistical estimation theory are studied; e.g., unbiased estimator, lower bound of Craméer-Rao type, efficient estimator, asymptotic efficiency, differential geometrical structures, etc. It is shown that the quantum theory for the one-parameter case (n = 1) is constructed almost in parallel with the classical theory, while several difficulties lie ahead of us to construct the general theory of quantum estimation for the multi-parameter case.

WORLD SCIENTIFIC eBooks•Feb 1, 2005•38 citations

Quantum statistical learning theory: concepts, regimes, and open problems

Ferhat Özgür Çatak

Statistical learning theory provides the mathematical foundations for understanding generalization from finite data. As quantum computing and quantum machine learning continue to develop, there is increasing interest in whether analogous principles can be formulated for learning settings involving quantum data, quantum models, or quantum computation. This paper offers an introductory perspective on quantum statistical learning theory. We begin by recalling the basic ideas of classical statistical learning theory, including empirical risk minimization, hypothesis classes, generalization, and sample complexity, and then discuss how these concepts must be adapted in the quantum setting. In particular, we distinguish between learning with classical data using quantum algorithms, learning with quantum models, and learning directly from quantum data. We then develop a resource-sensitive description that separates population risk, ideal empirical risk, and finite-shot empirical risk. This distinction makes explicit the different roles of training sample size and measurement budget. For a binary measurement-based classifier, we derive a finite-shot condition relating the required measurement budget to the sample size, confidence level, and classification margin. We further discuss how finite-sample generalization, finite-measurement estimation, and hardware imperfections can be represented as distinct contributions to experimentally observed learning performance. We conclude with a discussion of open problems and directions toward a more unified theory of generalization and learnability in quantum learning.

Quantum Information Processing•Oct 5, 2026•0 citations

Information-theoretic generalization bounds for learning from quantum data

Matthias C. Caro, Tom Gur, Cambyse Rouzé +2 more

Learning tasks play an increasingly prominent role in quantum information and computation. They range from fundamental problems such as state discrimination and metrology over the framework of quantum probably approximately correct (PAC) learning, to the recently proposed shadow variants of state tomography. However, the many directions of quantum learning theory have so far evolved separately. We propose a general mathematical formalism for describing quantum learning by training on classical-quantum data and then testing how well the learned hypothesis generalizes to new data. In this framework, we prove bounds on the expected generalization error of a quantum learner in terms of classical and quantum information-theoretic quantities measuring how strongly the learner's hypothesis depends on the specific data seen during training. To achieve this, we use tools from quantum optimal transport and quantum concentration inequalities to establish non-commutative versions of decoupling lemmas that underlie recent information-theoretic generalization bounds for classical machine learning. Our framework encompasses and gives intuitively accessible generalization bounds for a variety of quantum learning scenarios such as quantum state discrimination, PAC learning quantum states, quantum parameter estimation, and quantumly PAC learning classical functions. Thereby, our work lays a foundation for a unifying quantum information-theoretic perspective on quantum learning.

arXiv:2311.05529•Nov 9, 2023•9 citations
Deep learning has seen substantial achievements, with numerical and theoretical evidence suggesting that singularities of statistical models are considered a contributing factor to its performance. From this remarkable success of classical statistical models, it is naturally expected that quantum singular models will play a vital role in many quantum statistical tasks. However, while the theory of quantum statistical models in regular cases has been established, theoretical understanding of quantum singular models is still limited. To investigate the statistical properties of quantum singular models, we focus on two prominent tasks in quantum statistical inference: quantum state estimation and model selection. In particular, we base our study on classical singular learning theory and seek to extend it within the framework of Bayesian quantum state estimation. To this end, we define quantum generalization and training loss functions and give their asymptotic expansions through algebraic geometrical methods. The key idea of the proof is the introduction of a quantum analog of the likelihood function using classical shadows. Consequently, we construct an asymptotically unbiased estimator of the quantum generalization loss, the quantum widely applicable information criterion (QWAIC), as a computable model selection metric from given measurement outcomes.
Abstract Quantum state estimation (or state tomography) is an indispensable task in quantum information processing. Because full state tomography that determines all elements of the density matrix is computationally demanding, one usually takes the strategy of assuming a certain model of quantum states and identifying the model parameters. However, it is difficult to make a valid assumption given little prior knowledge on a quantum state of interest, and thus we need a reasonable model selection method for quantum state estimation. Actually, in the classical statistical estimation theory, several types of information criteria have been established and widely used in practice for appropriately choosing a classical statistical model. In this study, we propose quantum information criteria for evaluating the quality of the estimated quantum state in terms of the quantum relative entropy, which is a natural quantum analogue of the classical information criterion defined in terms of Kullback–Leibler divergence. In particular, we derive two quantum information criteria depending on the type of an estimator for the quantum relative entropy; one uses the log-likelihood and the other uses the classical shadow. The general role of information criteria is to predict the performance of an estimated model for unseen data, although it is a function of only sampled data; this generalization capability of the proposed quantum information criteria is evaluated in numerical simulations.
The astounding acceleration in Artificial Intelligence and Quantum Computing advances naturally gives rise to a line of research, which unrolls the potential advantages of quantum computing on classical Machine Learning tasks, known as Quantum Machine Learning or Quantum Machine Intelligence. The typical objectives are either (1) exploring the potential quantum advantages on classical learning tasks or (2) levering well-established classical ML algorithms to tackle quantum-related problems on Noisy Intermediate-Scale Quantum (NISQ) devices. Along the second research direction, we study Quantum Neural Networks (QNNs) to accomplish the purpose of Bayesian learning. By observing a wide range of studies on QNNs, in which the sole training method is based on frequentist training, we find that Bayesian learning benefits QNNs from two aspects. First, Bayesian-trained models enjoy a high level of generalization due to the prior and posterior distribution usage compared to frequentist training, which will be justified by this paper’s theoretical study of model capacity. Second, Bayesian Inference offers epistemic uncertainty estimation, which merits the decision-making process. It is worth mentioning that frequentist-trained QNNs generally lack this desirable property. Under the Bayesian training procedure, our derived models can be considered a new class of QNNs (called BayesianQNNs) which possesses both desirable properties of Bayesian Inference while maintaining comparable predictive performance as frequentist counterparts. The proposed Bayesian Quantum Neural Networks is justified by empirical evidence from numerical experiments.
In this thesis, I present several results on quantum statistical inference in the following two directions. Firstly, I demonstrate that quantum algorithms can be applied to enhance the computing and training of Gaussian processes (GPs), a powerful model widely used in classical statistical inference and supervised machine learning. A crucial component of the quantum GP algorithm is solving linear systems with quantum computers, for which I present a novel algorithm that achieves a provable advantage over previously known methods. I will also explicitly address the task of encoding the classical data into a quantum state for machine learning applications. I then apply the quantum enhanced GPs to Bayesian deep learning and present an experimental demonstration on contemporary hardware and simulators. Secondly, I look into the notion of quantum causality and apply it to inferring spatial and temporal quantum correlations, and present an analytical toolkit for causal inference in quantum data. I will also make the connection between causality and quantum communications, and present a general bound for the quantum capacity of noisy communication channels.
The parameter estimation problem for a quantum statistical model , where {S θ } are quantum states (i.e. density operators) and Θ is an open set in R n , is considered. The problem is to estimate the true state which is unknown but is assumed to lie in . The quantum analogues of various notions developed in the classical statistical estimation theory are studied; e.g., unbiased estimator, lower bound of Craméer-Rao type, efficient estimator, asymptotic efficiency, differential geometrical structures, etc. It is shown that the quantum theory for the one-parameter case (n = 1) is constructed almost in parallel with the classical theory, while several difficulties lie ahead of us to construct the general theory of quantum estimation for the multi-parameter case.
Statistical learning theory provides the mathematical foundations for understanding generalization from finite data. As quantum computing and quantum machine learning continue to develop, there is increasing interest in whether analogous principles can be formulated for learning settings involving quantum data, quantum models, or quantum computation. This paper offers an introductory perspective on quantum statistical learning theory. We begin by recalling the basic ideas of classical statistical learning theory, including empirical risk minimization, hypothesis classes, generalization, and sample complexity, and then discuss how these concepts must be adapted in the quantum setting. In particular, we distinguish between learning with classical data using quantum algorithms, learning with quantum models, and learning directly from quantum data. We then develop a resource-sensitive description that separates population risk, ideal empirical risk, and finite-shot empirical risk. This distinction makes explicit the different roles of training sample size and measurement budget. For a binary measurement-based classifier, we derive a finite-shot condition relating the required measurement budget to the sample size, confidence level, and classification margin. We further discuss how finite-sample generalization, finite-measurement estimation, and hardware imperfections can be represented as distinct contributions to experimentally observed learning performance. We conclude with a discussion of open problems and directions toward a more unified theory of generalization and learnability in quantum learning.
Learning tasks play an increasingly prominent role in quantum information and computation. They range from fundamental problems such as state discrimination and metrology over the framework of quantum probably approximately correct (PAC) learning, to the recently proposed shadow variants of state tomography. However, the many directions of quantum learning theory have so far evolved separately. We propose a general mathematical formalism for describing quantum learning by training on classical-quantum data and then testing how well the learned hypothesis generalizes to new data. In this framework, we prove bounds on the expected generalization error of a quantum learner in terms of classical and quantum information-theoretic quantities measuring how strongly the learner's hypothesis depends on the specific data seen during training. To achieve this, we use tools from quantum optimal transport and quantum concentration inequalities to establish non-commutative versions of decoupling lemmas that underlie recent information-theoretic generalization bounds for classical machine learning. Our framework encompasses and gives intuitively accessible generalization bounds for a variety of quantum learning scenarios such as quantum state discrimination, PAC learning quantum states, quantum parameter estimation, and quantumly PAC learning classical functions. Thereby, our work lays a foundation for a unifying quantum information-theoretic perspective on quantum learning.