Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2012.12231 · Bulletin of the American Physical Society

Wildcard error: Quantifying unmodeled errors in quantum processors

Robin Blume-Kohout, Kenneth Rudinger, Erik Nielsen, Timothy J Proctor, Kevin C Young

Published Dec 22, 2020• 15 citations
arXivHTMLPDF

Abstract

Error models for quantum computing processors describe their deviation from ideal behavior and predict the consequences in applications. But those processors' experimental behavior -- the observed outcome statistics of quantum circuits -- are rarely consistent with error models, even in characterization experiments like randomized benchmarking (RB) or gate set tomography (GST), where the error model was specifically extracted from the data in question. We show how to resolve these inconsistencies, and quantify the rate of unmodeled errors, by augmenting error models with a parameterized wildcard error model. Adding wildcard error to an error model relaxes and weakens its predictions in a controlled way. The amount of wildcard error required to restore consistency with data quantifies how much unmodeled error was observed, in a way that facilitates direct comparison to standard gate error rates. Using both simulated and experimental data, we show how to use wildcard error to reconcile error models derived from RB and GST experiments with inconsistent data, to capture non-Markovianity, and to quantify all of a processor's observed error.

DOI
10.48550/arxiv.2012.12231

Related papers

Efficient flexible characterization of quantum processors with nested error models

Erik Nielsen, Kenneth Rudinger, Timothy J Proctor +2 more

Abstract We present a simple and powerful technique for finding a good error model for a quantum processor. The technique iteratively tests a nested sequence of models against data obtained from the processor, and keeps track of the best-fit model and its wildcard error (a metric of the amount of unmodeled error) at each step. Each best-fit model, along with a quantification of its unmodeled error, constitutes a characterization of the processor. We explain how quantum processor models can be compared with experimental data and to each other. We demonstrate the technique by using it to characterize a simulated noisy two-qubit processor.

arXiv:2103.02188•New Journal of Physics•Sep 1, 2021•11 citations

Probing Context-Dependent Errors in Quantum Processors

Kenneth Rudinger, Timothy J Proctor, Dylan Langharst +3 more

Gates in error-prone quantum information processors are often modeled using sets of one-and two-qubit process matrices, the standard model of quantum errors.However, the results of quantum circuits on real processors often depend on additional external "context" variables.Such contexts may include the state of a spectator qubit, the time of data collection, or the temperature of control electronics.In this article, we demonstrate a suite of simple, widely applicable, and statistically rigorous methods for detecting context dependence in quantum-circuit experiments.They can be used on any data that comprise two or more "pools" of measurement results obtained by repeating the same set of quantum circuits in different contexts.These tools may be integrated seamlessly into standard quantum device characterization techniques, like randomized benchmarking or tomography.We experimentally demonstrate these methods by detecting and quantifying crosstalk and drift on the publicly accessible 16-qubit ibmqx3.

arXiv:1810.05651•Physical Review X•Jun 3, 2019•80 citations

Validation of QCVV Models for Quantum Computers.

Megan Dahlhauser, Kevin C Young, Timothy J Proctor +1 more

Highlights• Generalized for many common quantum characterization, verification, and validation models • Identify if a model is consistent with data, and if not, where the inconsistencies are • Explore trends of inconsistencies with various features, such as circuit depth or gate types • Report quantifiable differences among experiment, model, and target SummaryWe are developing methods to determine and report characterization performance on circuit prediction tasks using statistical tests and simulation.We are demonstrating this process in experiment using gate set tomography to evaluate performance on circuit prediction tasks.We aim to create a validation process that is an effective tool in identifying characterization shortcomings and upgrading methodologies to create more accurate characterizations of quantum devices.

•Oct 1, 2022•0 citations

Benchmarking quantum logic operations relative to thresholds for fault tolerance

Akel Hashim, Stefan Seritan, Timothy J Proctor +6 more

Abstract Contemporary methods for benchmarking noisy quantum processors typically measure average error rates or process infidelities. However, thresholds for fault-tolerant quantum error correction are given in terms of worst-case error rates—defined via the diamond norm—which can differ from average error rates by orders of magnitude. One method for resolving this discrepancy is to randomize the physical implementation of quantum gates, using techniques like randomized compiling (RC). In this work, we use gate set tomography to perform precision characterization of a set of two-qubit logic gates to study RC on a superconducting quantum processor. We find that, under RC, gate errors are accurately described by a stochastic Pauli noise model without coherent errors, and that spatially correlated coherent errors and non-Markovian errors are strongly suppressed. We further show that the average and worst-case error rates are equal for randomly compiled gates, and measure a maximum worst-case error of 0.0197(3) for our gate set. Our results show that randomized benchmarks are a viable route to both verifying that a quantum processor’s error rates are below a fault-tolerance threshold, and to bounding the failure rates of near-term algorithms, if—and only if—gates are implemented via randomization methods which tailor noise.

arXiv:2207.08786•npj Quantum Information•Oct 26, 2023•23 citations

Comparing Experiments to the Fault-Tolerance Threshold

Richard Kueng, David M. Long, Andrew C. Doherty +1 more

Achieving error rates that meet or exceed the fault-tolerance threshold is a central goal for quantum computing experiments, and measuring these error rates using randomized benchmarking is now routine. However, direct comparison between measured error rates and thresholds is complicated by the fact that benchmarking estimates average error rates while thresholds reflect worst-case behavior when a gate is used as part of a large computation. These two measures of error can differ by orders of magnitude in the regime of interest. Here we facilitate comparison between the experimentally accessible average error rates and the worst-case quantities that arise in current threshold theorems by deriving relations between the two for a variety of physical noise sources. Our results indicate that it is coherent errors that lead to an enormous mismatch between average and worst case, and we quantify how well these errors must be controlled to ensure fair comparison between average error probabilities and fault-tolerance thresholds.

arXiv:1510.05653•Physical Review Letters•Oct 21, 2016•141 citations

Physical Gate-Set Tomography

Brandon Ruzic, Kevin C Young, Stefan Seritan

Physical models of quantum gates can directly incorporate experimental degrees of freedom, such as laser power or microwave phase, but the forward simulation required to use these models can result in impractical overhead in computational time.In this poster, we develop a method for efficient, accurate interpolation of quantum process matrices over physical parameter space, and we apply our method to study the sensitivity of quantum applications at both the gate level and circuit level.We then implement an extension of gate-set tomography (GST) that provides a comprehensive view into the errors suffered by a quantum information processor.In its standard form, GST fits a general Markovian model to experimental data in terms of process matrices that are often difficult to interpret.Our extension to this method uses process matrices interpolated over physical parameters in the optimization loop of GST to directly estimate physical model parameters, providing a clear description of the errors in a quantum processor, while reducing the required number of GST sequences by orders of magnitude compared to its standard form.

•Mar 1, 2024•0 citations
Error models for quantum computing processors describe their deviation from ideal behavior and predict the consequences in applications. But those processors' experimental behavior -- the observed outcome statistics of quantum circuits -- are rarely consistent with error models, even in characterization experiments like randomized benchmarking (RB) or gate set tomography (GST), where the error model was specifically extracted from the data in question. We show how to resolve these inconsistencies, and quantify the rate of unmodeled errors, by augmenting error models with a parameterized wildcard error model. Adding wildcard error to an error model relaxes and weakens its predictions in a controlled way. The amount of wildcard error required to restore consistency with data quantifies how much unmodeled error was observed, in a way that facilitates direct comparison to standard gate error rates. Using both simulated and experimental data, we show how to use wildcard error to reconcile error models derived from RB and GST experiments with inconsistent data, to capture non-Markovianity, and to quantify all of a processor's observed error.
Abstract We present a simple and powerful technique for finding a good error model for a quantum processor. The technique iteratively tests a nested sequence of models against data obtained from the processor, and keeps track of the best-fit model and its wildcard error (a metric of the amount of unmodeled error) at each step. Each best-fit model, along with a quantification of its unmodeled error, constitutes a characterization of the processor. We explain how quantum processor models can be compared with experimental data and to each other. We demonstrate the technique by using it to characterize a simulated noisy two-qubit processor.
Gates in error-prone quantum information processors are often modeled using sets of one-and two-qubit process matrices, the standard model of quantum errors.However, the results of quantum circuits on real processors often depend on additional external "context" variables.Such contexts may include the state of a spectator qubit, the time of data collection, or the temperature of control electronics.In this article, we demonstrate a suite of simple, widely applicable, and statistically rigorous methods for detecting context dependence in quantum-circuit experiments.They can be used on any data that comprise two or more "pools" of measurement results obtained by repeating the same set of quantum circuits in different contexts.These tools may be integrated seamlessly into standard quantum device characterization techniques, like randomized benchmarking or tomography.We experimentally demonstrate these methods by detecting and quantifying crosstalk and drift on the publicly accessible 16-qubit ibmqx3.
Highlights• Generalized for many common quantum characterization, verification, and validation models • Identify if a model is consistent with data, and if not, where the inconsistencies are • Explore trends of inconsistencies with various features, such as circuit depth or gate types • Report quantifiable differences among experiment, model, and target SummaryWe are developing methods to determine and report characterization performance on circuit prediction tasks using statistical tests and simulation.We are demonstrating this process in experiment using gate set tomography to evaluate performance on circuit prediction tasks.We aim to create a validation process that is an effective tool in identifying characterization shortcomings and upgrading methodologies to create more accurate characterizations of quantum devices.
Abstract Contemporary methods for benchmarking noisy quantum processors typically measure average error rates or process infidelities. However, thresholds for fault-tolerant quantum error correction are given in terms of worst-case error rates—defined via the diamond norm—which can differ from average error rates by orders of magnitude. One method for resolving this discrepancy is to randomize the physical implementation of quantum gates, using techniques like randomized compiling (RC). In this work, we use gate set tomography to perform precision characterization of a set of two-qubit logic gates to study RC on a superconducting quantum processor. We find that, under RC, gate errors are accurately described by a stochastic Pauli noise model without coherent errors, and that spatially correlated coherent errors and non-Markovian errors are strongly suppressed. We further show that the average and worst-case error rates are equal for randomly compiled gates, and measure a maximum worst-case error of 0.0197(3) for our gate set. Our results show that randomized benchmarks are a viable route to both verifying that a quantum processor’s error rates are below a fault-tolerance threshold, and to bounding the failure rates of near-term algorithms, if—and only if—gates are implemented via randomization methods which tailor noise.
Achieving error rates that meet or exceed the fault-tolerance threshold is a central goal for quantum computing experiments, and measuring these error rates using randomized benchmarking is now routine. However, direct comparison between measured error rates and thresholds is complicated by the fact that benchmarking estimates average error rates while thresholds reflect worst-case behavior when a gate is used as part of a large computation. These two measures of error can differ by orders of magnitude in the regime of interest. Here we facilitate comparison between the experimentally accessible average error rates and the worst-case quantities that arise in current threshold theorems by deriving relations between the two for a variety of physical noise sources. Our results indicate that it is coherent errors that lead to an enormous mismatch between average and worst case, and we quantify how well these errors must be controlled to ensure fair comparison between average error probabilities and fault-tolerance thresholds.
Physical models of quantum gates can directly incorporate experimental degrees of freedom, such as laser power or microwave phase, but the forward simulation required to use these models can result in impractical overhead in computational time.In this poster, we develop a method for efficient, accurate interpolation of quantum process matrices over physical parameter space, and we apply our method to study the sensitivity of quantum applications at both the gate level and circuit level.We then implement an extension of gate-set tomography (GST) that provides a comprehensive view into the errors suffered by a quantum information processor.In its standard form, GST fits a general Markovian model to experimental data in terms of process matrices that are often difficult to interpret.Our extension to this method uses process matrices interpolated over physical parameters in the optimization loop of GST to directly estimate physical model parameters, providing a clear description of the errors in a quantum processor, while reducing the required number of GST sequences by orders of magnitude compared to its standard form.