Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Conference on Lasers and Electro-Optics

Regularizing least squares quantum state tomography with classical shadows

Zhihui Zhu, Joseph M. Lukens, Brian T. Kirby

Published Jan 1, 2025• 0 citations
Publisher

Abstract

Classical shadows herald remarkable opportunities for resource-efficient quantum estimation. Although superficially disconnected from traditional inference methods, we show how classical shadows fit under a larger umbrella of least squares regularization, revealing tradeoffs with related methods.
DOI
10.1364/cleo_fs.2025.ff120_6

Related papers

On the connection between least squares, regularization, and classical shadows

Zhihui Zhu, Joseph M. Lukens, Brian T. Kirby

Classical shadows (CS) offer a resource-efficient means to estimate quantum observables, circumventing the need for exhaustive state tomography. Here, we clarify and explore the connection between CS techniques and least squares (LS) and regularized least squares (RLS) methods commonly used in machine learning and data analysis. By formal identification of LS and RLS ``shadows'' completely analogous to those in CS---namely, point estimators calculated from the empirical frequencies of single measurements---we show that both RLS and CS can be viewed as regularizers for the underdetermined regime, replacing the pseudoinverse with invertible alternatives. Through numerical simulations, we evaluate RLS and CS from three distinct angles: the tradeoff in bias and variance, mismatch between the expected and actual measurement distributions, and the interplay between the number of measurements and number of shots per measurement. Compared to CS, RLS attains lower variance at the expense of bias, is robust to distribution mismatch, and is more sensitive to the number of shots for a fixed number of state copies---differences that can be understood from the distinct approaches taken to regularization. Conceptually, our integration of LS, RLS, and CS under a unifying ``shadow'' umbrella aids in advancing the overall picture of CS techniques, while practically our results highlight the tradeoffs intrinsic to these measurement approaches, illuminating the circumstances under which either RLS or CS would be preferred, such as unverified randomness for the former or unbiased estimation for the latter.

arXiv:2310.16921•Quantum•Aug 29, 2024•7 citations

A Bayesian analysis of classical shadows

Joseph M. Lukens, Kody J. H. Law, Ryan S. Bennink

Abstract The method of classical shadows proposed by Huang, Kueng, and Preskill heralds remarkable opportunities for quantum estimation with limited measurements. Yet its relationship to established quantum tomographic approaches, particularly those based on likelihood models, remains unclear. In this article, we investigate classical shadows through the lens of Bayesian mean estimation (BME). In direct tests on numerical data, BME is found to attain significantly lower error on average, but classical shadows prove remarkably more accurate in specific situations—such as high-fidelity ground truth states—which are improbable in a fully uniform Hilbert space. We then introduce an observable-oriented pseudo-likelihood that successfully emulates the dimension-independence and state-specific optimality of classical shadows, but within a Bayesian framework that ensures only physical states. Our research reveals how classical shadows effect important departures from conventional thinking in quantum state estimation, as well as the utility of Bayesian methods for uncovering and formalizing statistical assumptions.

arXiv:2012.08997•npj Quantum Information•Jul 16, 2021•36 citations

High-dimensional subspace expansion using classical shadows

Gregory Boyd, Bálint Koczor, Zhenyu Cai

We introduce a postprocessing technique for classical shadow measurement data that enhances the precision of ground state estimation through high-dimensional subspace expansion; the dimensionality is only limited by the amount of classical postprocessing resources rather than by quantum resources. Crucial steps of our approach are the efficient identification of useful observables from shadow data, followed by our regularized subspace expansion that is designed to be numerically stable even when using noisy data. We analytically investigate noise propagation within our method, and upper bound the statistical fluctuations due to the limited number of snapshots in classical shadows. In numerical simulations, our method can achieve a reduction in the energy estimation errors in many cases, sometimes by more than an order of magnitude. We also demonstrate that our performance improvements are robust against both coherent errors (bad initial state) and gate noise in the state-preparation circuits. Furthermore, performance is guaranteed to be at least as good—and in many cases better—than direct energy estimation without using additional quantum resources, and the approach is thus a very natural alternative for estimating ground state energies directly from classical shadow data.

arXiv:2406.11533•Physical Review A•Feb 13, 2025•10 citations

Classical shadows and Bayesian mean estimation: a comparison

Joseph M. Lukens, Kody J. H. Law, Ryan S. Bennink

Classical shadows enable remarkably efficient estimation of quantum observables, yet their connection to conventional techniques is unclear. In simulated examples we show that Bayesian mean estimation attains lower error on average, whereas classical shadows excel for specific states of interest.

Conference on Lasers and Electro-Optics•Jan 1, 2021•2 citations

Optimizing Shadow Tomography with Generalized Measurements

H. Chau Nguyen, Jan Lennart Bönsel, Jonathan Steinberg +1 more

Advances in quantum technology require scalable techniques to efficiently extract information from a quantum system. Traditional tomography is limited to a handful of qubits, and shadow tomography has been suggested as a scalable replacement for larger systems. Shadow tomography is conventionally analyzed based on outcomes of ideal projective measurements on the system upon application of randomized unitaries. Here, we suggest that shadow tomography can be much more straightforwardly formulated for generalized measurements, or positive operator valued measures. Based on the idea of the least-square estimator shadow tomography with generalized measurements is both more general and simpler than the traditional formulation with randomization of unitaries. In particular, this formulation allows us to analyze theoretical aspects of shadow tomography in detail. For example, we provide a detailed study of the implication of symmetries in shadow tomography. Moreover, with this generalization we also demonstrate how the optimization of measurements for shadow tomography tailored toward a particular set of observables can be carried out.

arXiv:2205.08990•Physical Review Letters•Nov 23, 2022•59 citations

Experimental Estimation of Quantum State Properties from Classical Shadows

G. I. Struchalin, Я.А. Загоровский, E. V. Kovlakov +2 more

Experimental implementation of ``shadow tomography'': Using a limited number of measurements, the method is demonstrated to outperform conventional state reconstruction of a system's property, such as fidelity.

arXiv:2008.05234•PRX Quantum•Jan 13, 2021•103 citations
Classical shadows (CS) offer a resource-efficient means to estimate quantum observables, circumventing the need for exhaustive state tomography. Here, we clarify and explore the connection between CS techniques and least squares (LS) and regularized least squares (RLS) methods commonly used in machine learning and data analysis. By formal identification of LS and RLS ``shadows'' completely analogous to those in CS---namely, point estimators calculated from the empirical frequencies of single measurements---we show that both RLS and CS can be viewed as regularizers for the underdetermined regime, replacing the pseudoinverse with invertible alternatives. Through numerical simulations, we evaluate RLS and CS from three distinct angles: the tradeoff in bias and variance, mismatch between the expected and actual measurement distributions, and the interplay between the number of measurements and number of shots per measurement. Compared to CS, RLS attains lower variance at the expense of bias, is robust to distribution mismatch, and is more sensitive to the number of shots for a fixed number of state copies---differences that can be understood from the distinct approaches taken to regularization. Conceptually, our integration of LS, RLS, and CS under a unifying ``shadow'' umbrella aids in advancing the overall picture of CS techniques, while practically our results highlight the tradeoffs intrinsic to these measurement approaches, illuminating the circumstances under which either RLS or CS would be preferred, such as unverified randomness for the former or unbiased estimation for the latter.
Abstract The method of classical shadows proposed by Huang, Kueng, and Preskill heralds remarkable opportunities for quantum estimation with limited measurements. Yet its relationship to established quantum tomographic approaches, particularly those based on likelihood models, remains unclear. In this article, we investigate classical shadows through the lens of Bayesian mean estimation (BME). In direct tests on numerical data, BME is found to attain significantly lower error on average, but classical shadows prove remarkably more accurate in specific situations—such as high-fidelity ground truth states—which are improbable in a fully uniform Hilbert space. We then introduce an observable-oriented pseudo-likelihood that successfully emulates the dimension-independence and state-specific optimality of classical shadows, but within a Bayesian framework that ensures only physical states. Our research reveals how classical shadows effect important departures from conventional thinking in quantum state estimation, as well as the utility of Bayesian methods for uncovering and formalizing statistical assumptions.
We introduce a postprocessing technique for classical shadow measurement data that enhances the precision of ground state estimation through high-dimensional subspace expansion; the dimensionality is only limited by the amount of classical postprocessing resources rather than by quantum resources. Crucial steps of our approach are the efficient identification of useful observables from shadow data, followed by our regularized subspace expansion that is designed to be numerically stable even when using noisy data. We analytically investigate noise propagation within our method, and upper bound the statistical fluctuations due to the limited number of snapshots in classical shadows. In numerical simulations, our method can achieve a reduction in the energy estimation errors in many cases, sometimes by more than an order of magnitude. We also demonstrate that our performance improvements are robust against both coherent errors (bad initial state) and gate noise in the state-preparation circuits. Furthermore, performance is guaranteed to be at least as good—and in many cases better—than direct energy estimation without using additional quantum resources, and the approach is thus a very natural alternative for estimating ground state energies directly from classical shadow data.
Advances in quantum technology require scalable techniques to efficiently extract information from a quantum system. Traditional tomography is limited to a handful of qubits, and shadow tomography has been suggested as a scalable replacement for larger systems. Shadow tomography is conventionally analyzed based on outcomes of ideal projective measurements on the system upon application of randomized unitaries. Here, we suggest that shadow tomography can be much more straightforwardly formulated for generalized measurements, or positive operator valued measures. Based on the idea of the least-square estimator shadow tomography with generalized measurements is both more general and simpler than the traditional formulation with randomization of unitaries. In particular, this formulation allows us to analyze theoretical aspects of shadow tomography in detail. For example, we provide a detailed study of the implication of symmetries in shadow tomography. Moreover, with this generalization we also demonstrate how the optimization of measurements for shadow tomography tailored toward a particular set of observables can be carried out.