Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2609.35535

Analysis of asymmetric errors in NISQ experiments

Gil Kalai, Tomer Shoham, Carsten Voelkmann

quant-phSubmitted Sep 28, 2026• Announced Sep 29, 2026• 0 citations
arXivHTMLPDF

Abstract

This paper continues our analysis of NISQ experiments and especially the Google 2019 ``quantum supremacy" experiment. In arXiv:2008.05177 we proposed statistical tools to analyze symmetric and asymmetric readout errors, and the symmetric case was extensively developed and studied in arXiv:2404.00935, where we used Fourier methods combined with statistical tools. Here we extend and complement our earlier study and analyze asymmetric readout errors for data from experiments and simulations. Our study was further motivated by a paper by Fefferman et al. arXiv:2306.16659, who showed that the effect of amplitude damping gate errors is to have larger fractions of zeroes in the samples produced by the quantum computer. We show that this effect of gate errors is not observed in the Google experimental data, where, for the entire range of the number of qubits, $12 \le n \le 53$, the fraction of zeroes and ones reflects only the asymmetry of reported readout errors, and report on simulations with $n=12,14$ using IBM's and Google's simulators.

AI Summary

The paper asks whether non-unital gate noise, particularly amplitude damping, produces an excess of measured zeroes beyond that explained by asymmetric readout errors in random-circuit sampling experiments. It extends earlier statistical analyses using the model $R(q_{1\to0},q_{0\to1})[s\mathcal P_C+(1-s)/2^n]$, comparing observed bit frequencies and maximum-likelihood parameter estimates with reported readout calibrations. For Google’s 2019 data across $12\le n\le53$, the observed zero–one imbalance is generally below the calibration-based readout imbalance, with no additional zero bias identified. For 12 qubits, mean fitted rates are $q_{1\to0}=0.046$ and $q_{0\to1}=0.022$, versus calibration values approximately $0.050$ and $0.021$; for 14 qubits, fitted rates are $0.042$ and $0.020$. In 12-qubit IBM Fake Guadalupe simulations, fitted rates are instead $0.081$ and $0.048$, compared with physical readout rates $0.0278$ and $0.0072$. The increased asymmetry is interpreted as potentially reflecting gate noise. Additional analyses cover five-qubit IBM experiments and temporal drift in bit frequencies in Sycamore and Zuchongzhi datasets. An appendix sketches an extension of the Fourier treatment to asymmetric errors using biased Fourier–Walsh bases and tensor-product transforms. The paper notes discrepancies between two Google readout-calibration datasets and ambiguities in the Google simulator error settings, leaving that simulation comparison inconclusive. It calls for further experimental samples and controlled simulations, including larger circuits. The empirical finding concerns the absence of additional measured zero bias, rather than establishing the absence of amplitude damping.

No sign of AI-generated textIncrementalOverclaimsMissing comparison

Central claim may not hold: The abstract's claim that the observed bias reflects only readout asymmetry is not established because the analysis does not separate gate-induced bias from uncertainty or mismatch in the readout calibrations. Table t:google-readout-data-av contains empirical zero–one differences above the original calibration at 40, 41, and 43 qubits, contradicting the stated universal inequality. The description of empirical bias as roughly 10%–20% below calibration is inconsistent across calibration sets and qubit counts, including a 34.5% deficit for the original 12-qubit calibration and excesses at 43 qubits. Appendix B and Table t:googleexp misreport the original 12-qubit readout calibration and its derived difference and symmetric average, which should be 0.0335, 0.0383, and 0.05265, respectively.

Written by gpt-6.1-sol from the paper's full text. Automated: it can be wrong.

Comments
29 pages, 6 figures, 10 tables

Related papers

Random Circuit Sampling: Fourier Expansion and Statistics

Gil Kalai, Yosef Rinott, Tomer Shoham

Considerable effort in experimental quantum computing is devoted to noisy intermediate scale quantum computers (NISQ computers). Understanding the effect of noise is important for various aspects of this endeavor including notable claims for achieving quantum supremacy and attempts to demonstrate quantum error correcting codes. In this paper we use Fourier methods combined with statistical analysis to study the effect of noise. In particular, we use Fourier analysis to refine the linear cross-entropy fidelity estimator. We use both analytical methods and simulations to study the effect of readout and gate errors, and we use our analysis to study the samples of Google's 2019 quantum supremacy experiment.

arXiv:2404.00935•Apr 1, 2024•2 citations

Google's Quantum Supremacy Claim: Data, Documentation, and Discussion

Gil Kalai, Yosef Rinott, Tomer Shoham

In October 2019, Nature published a paper describing an experiment that took place at Google. The paper claims to demonstrate quantum (computational) supremacy on a 53-qubit quantum computer. Since September 2019 we have been involved in a long-term project to study various statistical aspects of the Google experiment. We have been trying to gather the relevant data and information in order to reconstruct and verify those parts of the Google experiment that are based on classical computations (except when the required computation is too heavy), and to perform a statistical analysis on the data. This document describes the available data and information for the Google experiment, some main questions in the evaluation of the experiment, and some of our results and plans.

arXiv:2210.12753•Oct 23, 2022•15 citations

TQEA: Temporal Quantum Error Analysis

Betis Baheri, Daniel Chen, Bo Fang +6 more

The growth of need of quantum computers in many domains such as machine learning, numerical scientific simulation and finance has urged the quantum computers to produce more stable and less error-prone results. However, to mitigate the impact of the noise inside each quantum device remains a present challenge. In this paper, we investigate the temporal behavior of noisy intermediate-scale quantum (NISQ) computer errors based on calibration data and the characteristics of individual devices. In particular, we collect calibration data of IBM-Q machines over 90 days and compare the quantum error robustness across processor types, quantum topology and quantum volumes. We analyze the aging effect by comparing the quantum error data from four IBM quantum computers during 2019-2021 showing that only one computer experienced significant error growth overtime. In this study, we simply analyze the collected data and run temporal test analysis to observe the behaviour of IBM-Q computers.

IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S)•Jun 1, 2021•7 citations

Questions and Concerns About Google's Quantum Supremacy Claim

Gil Kalai, Yosef Rinott, Tomer Shoham

In October 2019, Nature published a paper [6] describing an experimental work that was performed at Google. The paper claims to demonstrate quantum (computational) supremacy on a 53-qubit quantum computer. Since then we have been involved in a long-term project to study various statistical aspects of the Google experiment. In [30] we studied Google's statistical framework that we found to be very sound and offered some technical improvements. This document describes three main concerns (based on statistical analysis) about the Google 2019 experiment. The first concern is that the data do not agree with Google's noise model (or any other specific model). The second concern is that a crucial simple formula for a priori estimation of the fidelity seems to involve an unexpected independence assumption, and yet it gives very accurate predictions. The third concern is about statistical properties of the calibration process.

arXiv:2305.01064•May 1, 2023•13 citations

Reproducibility in Quantum Computing

Samudra Dasgupta, Travis S. Humble

Reproducibility is important for validating the performance of applications in quantum computing as a measure of consistency in computation. Current noisy, intermediate-scale devices quantum (NISQ) devices are strongly affected by intrinsic noise that leads to a variety of computational error mechanisms. Here we assess reproducibility of NISQ computing by focusing on a specific simple error mechanism that arises during noisy readout. Using an asymmetric channel for binary readout, we develop an analytic bound on the Hellinger distance between computational outputs for different readout parameters. We validate this model using characterization and testing of the IBM toronto device, which displays a range of readout parameters. We find that to ensure reproducibility, one must avoid using register elements characterized by fidelity asymmetry exceeding a threshold.

IEEE Computer Society Annual Symposium on VLSI•Jul 1, 2021•8 citations

Comparative Analysis of Asymmetric Readout Errors on Variational Quantum Classifiers: Scaling from 2 to 4 Qubits

Feras Shita

Abstract Variational Quantum Classifiers (VQCs) represent a promising approach forquantum-enhanced machine learning on Noisy Intermediate-Scale Quantum(NISQ) processors. This paper presents a comprehensive comparative studyinvestigating the impact of asymmetric readout errors on VQC performanceacross system scales. Through systematic numerical simulations of both 2-qubitand 4-qubit architectures trained on synthetic binary classification tasks, weanalyze how qubit role dependence and scalability interact with noise resilience.Our 2-qubit results demonstrate the classical optimizer’s remarkable capacityto compensate for measurement qubit noise, achieving 28.3% lower empiricalloss than theoretical predictions, while auxiliary qubit noise proves significantlymore detrimental. Extending to 4-qubit systems reveals persistent compensatorymechanisms, though with different quantitative patterns: 10% measurementqubit noise yields optimal accuracy (0.500 vs. 0.380 ideal), representing a 31.6%improvement. We observe consistent theoretical-empirical alignment across scales,with theoretical MSE values for 4-qubit systems ranging from 0.9423-0.9462for 5-20% error rates. The study demonstrates that while fundamental noiseresilience patterns persist during scaling, quantitative trade-offs and optimaloperating points shift, providing crucial insights for practical VQC deploymenton asymmetric NISQ hardware.

•Feb 18, 2026•0 citations
This paper continues our analysis of NISQ experiments and especially the Google 2019 ``quantum supremacy" experiment. In arXiv:2008.05177 we proposed statistical tools to analyze symmetric and asymmetric readout errors, and the symmetric case was extensively developed and studied in arXiv:2404.00935, where we used Fourier methods combined with statistical tools.
Here we extend and complement our earlier study and analyze asymmetric readout errors for data from experiments and simulations.
Our study was further motivated by a paper by Fefferman et al. arXiv:2306.16659, who showed that the effect of amplitude damping gate errors is to have larger fractions of zeroes in the samples produced by the quantum computer. We show that this effect of gate errors is not observed in the Google experimental data, where, for the entire range of the number of qubits, 12≤n≤5312 \le n \le 5312≤n≤53, the fraction of zeroes and ones reflects only the asymmetry of reported readout errors, and report on simulations with n=12,14n=12,14n=12,14 using IBM's and Google's simulators.
The paper asks whether non-unital gate noise, particularly amplitude damping, produces an excess of measured zeroes beyond that explained by asymmetric readout errors in random-circuit sampling experiments. It extends earlier statistical analyses using the model R(q1→0,q0→1)[sPC+(1−s)/2n]R(q_{1\to0},q_{0\to1})[s\mathcal P_C+(1-s)/2^n]R(q1→0​,q0→1​)[sPC​+(1−s)/2n], comparing observed bit frequencies and maximum-likelihood parameter estimates with reported readout calibrations.
For Google’s 2019 data across 12≤n≤5312\le n\le5312≤n≤53, the observed zero–one imbalance is generally below the calibration-based readout imbalance, with no additional zero bias identified. For 12 qubits, mean fitted rates are q1→0=0.046q_{1\to0}=0.046q1→0​=0.046 and q0→1=0.022q_{0\to1}=0.022q0→1​=0.022, versus calibration values approximately 0.0500.0500.050 and 0.0210.0210.021; for 14 qubits, fitted rates are 0.0420.0420.042 and 0.0200.0200.020. In 12-qubit IBM Fake Guadalupe simulations, fitted rates are instead 0.0810.0810.081 and 0.0480.0480.048, compared with physical readout rates 0.02780.02780.0278 and 0.00720.00720.0072. The increased asymmetry is interpreted as potentially reflecting gate noise.
Additional analyses cover five-qubit IBM experiments and temporal drift in bit frequencies in Sycamore and Zuchongzhi datasets. An appendix sketches an extension of the Fourier treatment to asymmetric errors using biased Fourier–Walsh bases and tensor-product transforms.
The paper notes discrepancies between two Google readout-calibration datasets and ambiguities in the Google simulator error settings, leaving that simulation comparison inconclusive. It calls for further experimental samples and controlled simulations, including larger circuits. The empirical finding concerns the absence of additional measured zero bias, rather than establishing the absence of amplitude damping.
Considerable effort in experimental quantum computing is devoted to noisy intermediate scale quantum computers (NISQ computers). Understanding the effect of noise is important for various aspects of this endeavor including notable claims for achieving quantum supremacy and attempts to demonstrate quantum error correcting codes. In this paper we use Fourier methods combined with statistical analysis to study the effect of noise. In particular, we use Fourier analysis to refine the linear cross-entropy fidelity estimator. We use both analytical methods and simulations to study the effect of readout and gate errors, and we use our analysis to study the samples of Google's 2019 quantum supremacy experiment.
In October 2019, Nature published a paper describing an experiment that took place at Google. The paper claims to demonstrate quantum (computational) supremacy on a 53-qubit quantum computer. Since September 2019 we have been involved in a long-term project to study various statistical aspects of the Google experiment. We have been trying to gather the relevant data and information in order to reconstruct and verify those parts of the Google experiment that are based on classical computations (except when the required computation is too heavy), and to perform a statistical analysis on the data. This document describes the available data and information for the Google experiment, some main questions in the evaluation of the experiment, and some of our results and plans.
The growth of need of quantum computers in many domains such as machine learning, numerical scientific simulation and finance has urged the quantum computers to produce more stable and less error-prone results. However, to mitigate the impact of the noise inside each quantum device remains a present challenge. In this paper, we investigate the temporal behavior of noisy intermediate-scale quantum (NISQ) computer errors based on calibration data and the characteristics of individual devices. In particular, we collect calibration data of IBM-Q machines over 90 days and compare the quantum error robustness across processor types, quantum topology and quantum volumes. We analyze the aging effect by comparing the quantum error data from four IBM quantum computers during 2019-2021 showing that only one computer experienced significant error growth overtime. In this study, we simply analyze the collected data and run temporal test analysis to observe the behaviour of IBM-Q computers.
In October 2019, Nature published a paper [6] describing an experimental work that was performed at Google. The paper claims to demonstrate quantum (computational) supremacy on a 53-qubit quantum computer. Since then we have been involved in a long-term project to study various statistical aspects of the Google experiment. In [30] we studied Google's statistical framework that we found to be very sound and offered some technical improvements. This document describes three main concerns (based on statistical analysis) about the Google 2019 experiment. The first concern is that the data do not agree with Google's noise model (or any other specific model). The second concern is that a crucial simple formula for a priori estimation of the fidelity seems to involve an unexpected independence assumption, and yet it gives very accurate predictions. The third concern is about statistical properties of the calibration process.
Reproducibility is important for validating the performance of applications in quantum computing as a measure of consistency in computation. Current noisy, intermediate-scale devices quantum (NISQ) devices are strongly affected by intrinsic noise that leads to a variety of computational error mechanisms. Here we assess reproducibility of NISQ computing by focusing on a specific simple error mechanism that arises during noisy readout. Using an asymmetric channel for binary readout, we develop an analytic bound on the Hellinger distance between computational outputs for different readout parameters. We validate this model using characterization and testing of the IBM toronto device, which displays a range of readout parameters. We find that to ensure reproducibility, one must avoid using register elements characterized by fidelity asymmetry exceeding a threshold.
Abstract Variational Quantum Classifiers (VQCs) represent a promising approach forquantum-enhanced machine learning on Noisy Intermediate-Scale Quantum(NISQ) processors. This paper presents a comprehensive comparative studyinvestigating the impact of asymmetric readout errors on VQC performanceacross system scales. Through systematic numerical simulations of both 2-qubitand 4-qubit architectures trained on synthetic binary classification tasks, weanalyze how qubit role dependence and scalability interact with noise resilience.Our 2-qubit results demonstrate the classical optimizer’s remarkable capacityto compensate for measurement qubit noise, achieving 28.3% lower empiricalloss than theoretical predictions, while auxiliary qubit noise proves significantlymore detrimental. Extending to 4-qubit systems reveals persistent compensatorymechanisms, though with different quantitative patterns: 10% measurementqubit noise yields optimal accuracy (0.500 vs. 0.380 ideal), representing a 31.6%improvement. We observe consistent theoretical-empirical alignment across scales,with theoretical MSE values for 4-qubit systems ranging from 0.9423-0.9462for 5-20% error rates. The study demonstrates that while fundamental noiseresilience patterns persist during scaling, quantitative trade-offs and optimaloperating points shift, providing crucial insights for practical VQC deploymenton asymmetric NISQ hardware.