Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2504.11204 · Communications in computer and information science

BenchQC Scalable and Modular Benchmarking of Industrial Quantum Computing Applications

Florian Geißler, Eric Stopfer, Christian Ufrecht, Nico Meyer, Daniel D. Scherer, Friedrich Wagner, Johannes M. Oberreuter, Zao Chen, Alessandro Farace, Daria Gutina, Ulrich Schwenk, Kimberly Lange, Vanessa Junk, Thomas Husslein, Marvin Erdmann, Florian J. Kiwit, Benjamin Decker, Greshma Shaji, Etienne Granet, Henrik Dreyer, Theodora-Augustina Drăgan, Jeanette Miriam Lorenz

Published Jan 1, 2026• 3 citations
arXivHTMLPDF
DOI
10.1007/978-3-032-13852-1_21

Related papers

Scalable and targeted benchmarking of quantum computers

Timothy J Proctor, Kenneth Rudinger, Mohan Sarovar +3 more

Bulletin of the American Physical Society•Mar 15, 2021•0 citations

Measuring what matters: A scalable framework for application-level quantum benchmarking

Willie Aboumrad, Claudio Girotto, Joshua Goings +16 more

As quantum computing systems continue to mature, there is an increasing need for benchmarking methodologies that capture performance in terms of meaningful, application-level metrics. In this work, we present a scalable framework for application-level quantum benchmarking that is designed to support internal system evaluation and cross-platform comparison across technology providers. Our framework is guided by a set of core principles, including measurability, simplicity, scalability, and extensibility. We present 13 benchmark families that reflect realistic workloads across multiple domains. This enables the systematic evaluation of the quality of solutions, the total execution time, total used energy, as well as Time-to-Solution. The benchmarks are designed to be reproducible, interpretable across stakeholder groups, and adaptable to evolving system capabilities. The framework aims to bridge the gap between low-level performance metrics and real-world value, providing a unified approach to assessing quantum systems. The resulting benchmarks support development and validation and contribute to the foundation of industry-wide benchmarking standards.

quant-pharXiv:2604.11781•Apr 14, 2026•2 citations

Characterization and Benchmarking of Quantum Computers using Cycle Benchmarking Techniques

Megan Lilly, Travis S. Humble

Bulletin of the American Physical Society•Mar 15, 2021•0 citations

Benchmarking Quantum Generative Learning: A Study on Scalability and Noise Resilience using QUARK

Florian J. Kiwit, Maximilian A. Wolf, Marwa Marso +4 more

Abstract Quantum computing promises a disruptive impact on machine learning algorithms, taking advantage of the exponentially large Hilbert space available. However, it is not clear how to scale quantum machine learning (QML) to industrial-level applications. This paper investigates the scalability and noise resilience of quantum generative learning applications. We consider the training performance in the presence of statistical noise due to finite-shot noise statistics and quantum noise due to decoherence to analyze the scalability of QML methods. We employ rigorous benchmarking techniques to track progress and identify challenges in scaling QML algorithms, and show how characterization of QML systems can be accelerated, simplified, and made reproducible when the QUARK framework is used. We show that QGANs are not as affected by the curse of dimensionality as QCBMs and to which extent QCBMs are resilient to noise.

arXiv:2403.18662•Künstliche Intell.•Aug 19, 2024•11 citations

Cycle Benchmarking for Scalable Verification of Quantum Circuit Performance

Joseph Emerson, Joel J. Wallman

Bulletin of the American Physical Society•Mar 9, 2018•0 citations

BenchQC: A Benchmarking Toolkit for Quantum Computation

Nia Pollard, Kamal Kumar Choudhary

ABSTRACT The Variational Quantum Eigensolver (VQE) is a widely studied hybrid classical‐quantum algorithm for approximating ground‐state energies in molecular and materials systems. This study benchmarks the performance of the VQE for calculating ground‐state energies of small aluminum clusters (, , and ) within a quantum‐density functional theory (DFT) embedding framework, systematically varying key parameters: (I) classical optimizers, (II) circuit types, (III) number of repetitions, (IV) simulator types, (V) basis sets, and (VI) noise models. All calculations were performed using quantum simulators to evaluate VQE performance under both idealized and noise‐augmented conditions. Our findings demonstrate that certain optimizers converge efficiently, while circuit choice and basis set selection have a marked impact on energy estimates, with higher‐level basis sets closely matching classical computation data from Numerical Python Solver (NumPy) and Computational Chemistry Comparison and Benchmark DataBase (CCCBDB). To approximate realistic conditions, we employed IBM noise models to simulate the effects of hardware noise. The results showed close agreement with CCCBDB benchmarks, with percent errors consistently below 0.2%. The results demonstrate that VQE can approximate energy estimates under simulated conditions for small aluminum clusters and highlight the importance of optimizing quantum‐DFT parameters to balance computational cost and precision. This work contributes to ongoing efforts to benchmark VQE in practical settings and lays the groundwork for future benchmarking tools for quantum chemistry and materials applications.

arXiv:2502.09595•Journal of Computational Chemistry•Aug 4, 2025•10 citations
As quantum computing systems continue to mature, there is an increasing need for benchmarking methodologies that capture performance in terms of meaningful, application-level metrics. In this work, we present a scalable framework for application-level quantum benchmarking that is designed to support internal system evaluation and cross-platform comparison across technology providers. Our framework is guided by a set of core principles, including measurability, simplicity, scalability, and extensibility. We present 13 benchmark families that reflect realistic workloads across multiple domains. This enables the systematic evaluation of the quality of solutions, the total execution time, total used energy, as well as Time-to-Solution. The benchmarks are designed to be reproducible, interpretable across stakeholder groups, and adaptable to evolving system capabilities. The framework aims to bridge the gap between low-level performance metrics and real-world value, providing a unified approach to assessing quantum systems. The resulting benchmarks support development and validation and contribute to the foundation of industry-wide benchmarking standards.
Abstract Quantum computing promises a disruptive impact on machine learning algorithms, taking advantage of the exponentially large Hilbert space available. However, it is not clear how to scale quantum machine learning (QML) to industrial-level applications. This paper investigates the scalability and noise resilience of quantum generative learning applications. We consider the training performance in the presence of statistical noise due to finite-shot noise statistics and quantum noise due to decoherence to analyze the scalability of QML methods. We employ rigorous benchmarking techniques to track progress and identify challenges in scaling QML algorithms, and show how characterization of QML systems can be accelerated, simplified, and made reproducible when the QUARK framework is used. We show that QGANs are not as affected by the curse of dimensionality as QCBMs and to which extent QCBMs are resilient to noise.
ABSTRACT The Variational Quantum Eigensolver (VQE) is a widely studied hybrid classical‐quantum algorithm for approximating ground‐state energies in molecular and materials systems. This study benchmarks the performance of the VQE for calculating ground‐state energies of small aluminum clusters (, , and ) within a quantum‐density functional theory (DFT) embedding framework, systematically varying key parameters: (I) classical optimizers, (II) circuit types, (III) number of repetitions, (IV) simulator types, (V) basis sets, and (VI) noise models. All calculations were performed using quantum simulators to evaluate VQE performance under both idealized and noise‐augmented conditions. Our findings demonstrate that certain optimizers converge efficiently, while circuit choice and basis set selection have a marked impact on energy estimates, with higher‐level basis sets closely matching classical computation data from Numerical Python Solver (NumPy) and Computational Chemistry Comparison and Benchmark DataBase (CCCBDB). To approximate realistic conditions, we employed IBM noise models to simulate the effects of hardware noise. The results showed close agreement with CCCBDB benchmarks, with percent errors consistently below 0.2%. The results demonstrate that VQE can approximate energy estimates under simulated conditions for small aluminum clusters and highlight the importance of optimizing quantum‐DFT parameters to balance computational cost and precision. This work contributes to ongoing efforts to benchmark VQE in practical settings and lays the groundwork for future benchmarking tools for quantum chemistry and materials applications.