Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2504.14027 · ACM Transactions on Quantum Computing

Comparative Benchmarking of Utility-Scale Quantum Emulators

Anna Ouskova Leonteva, Guido Masella, Maxime Outteryck, Asier Piñeiro Orioli, S. Whitlock

Published Nov 18, 2025• 8 citations
arXivHTMLPDF

Abstract

Evaluating quantum algorithms at utility-scale—involving more than 100 qubits—is a key step toward advancing real-world applications of quantum computing. In this study, we benchmark seven state-of-the-art quantum emulators employing techniques such as tensor networks, matrix product states (MPS), decision diagrams, and factorized ket based methods, running on CPU based hardware and focusing on effectively exact simulations. Performance is assessed on 13 benchmark circuits from the MQTBench library, spanning circuit sizes from 4 to 1,024 qubits. Our results reveal that MPS-based emulators outperform other approaches overall, successfully solving 8 benchmarks up to the maximum size of 1,024 qubits and 12 benchmarks up to at least 100 qubits in less than 5 minutes. We find evidence that all circuits except a random one can be simulated in polynomial time. This work demonstrates that quantum emulators can faithfully simulate a broad range of large and complex universal quantum circuits with high fidelity, far beyond the limits of statevector simulators and today’s quantum hardware.

DOI
10.1145/3776567

Related papers

Classical Simulation Techniques for Large-Scale Quantum Systems

Pierre Lindberg

Classical simulation of quantum systems is indispensable for validating quantum algorithms, benchmarking near-term quantum hardware, and understanding quantum advantage boundaries. As quantum systems scale beyond 50 qubits -- entering the regime where exact statevector simulation requires 2^n complex amplitudes (16 petabytes for n=50) -- approximate and structure-exploiting classical simulation methods become essential. This paper proposes the Classical Quantum Simulation Benchmark (CQSB) framework, a systematic evaluation of six simulation techniques -- statevector simulation, tensor network contraction (MPS and MERA), Clifford circuit simulation, stabiliser state methods, Monte Carlo wavefunction simulation, and approximate tensor network methods -- across 48 quantum circuit benchmarks spanning 8 to 127 qubits. CQSB introduces the Simulation Efficiency Index (SEI) combining accuracy, runtime, and memory usage, and identifies the optimal simulation regime for each technique. Key results: MPS tensor networks achieve exact simulation to 127 qubits for circuits with bond dimension χ <= 512; Clifford simulation scales to 10,000 qubits in O(n2) time; approximate tensor network contraction produces fidelity > 0.95 for 72-qubit random circuits within 4.8 hours on a 256-GPU cluster. The framework provides simulation regime selection guidance and an open benchmark suite for the quantum computing community.

Quantum Frontiers Journal•Jul 14, 2025•0 citations

Harnessing CUDA-Q’s MPS for Tensor Network Simulations of Large-Scale Quantum Circuits

Gabin Schieffer, Stefano Markidis, Ivy Bo Peng

Quantum computer simulators are an indispensable tool for prototyping quantum algorithms and verifying the functioning of existing quantum computer hardware. The current largest quantum computers feature more than one thousand qubits, challenging their classical simulators. Statevector quantum simulators are challenged by the exponential increase of representable quantum states with respect to the number of qubits, making more than fifty qubits practically unfeasible. A more appealing approach for simulating quantum computers is adopting the tensor network approach, whose memory requirements fundamentally depend on the level of entanglement in the quantum circuit, and allows simulating the current largest quantum computers. This work investigates and evaluates the CUDA-Q tensor network simulators on an Nvidia Grace Hopper system, particularly the Matrix Product State (MPS) formulation. We compare the performance of the CUDA-Q state vector implementation and validate the correctness of MPS simulations. Our results highlight that tensor network-based methods provide a significant opportunity to simulate large-qubit circuits, albeit approximately. We also show that current GPUaccelerated computation cannot fully utilize GPU efficiently in the case of MPS simulations.

arXiv:2501.15939•Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP)•Mar 12, 2025•11 citations

Realizing Quantum Kernel Models at Scale with Matrix Product State Simulation

Mekena Metcalf, Pablo Andrés-Martínez, Nathan Fitzpatrick

Data representation in quantum state space offers an alternative function space for machine learning tasks. However, benchmarking these algorithms at a practical scale has been limited by ineffective simulation methods. We develop a quantum kernel framework using a Matrix Product State (MPS) simulator and employ it to perform a classification task with 165 features and 6400 training data points, well beyond the scale of any prior work. We make use of a circuit ansatz on a linear chain of qubits with increasing interaction distance between qubits. We assess the MPS simulator performance on CPUs and GPUs and, by systematically increasing the qubit interaction distance, we identify a crossover point beyond which the GPU implementation runs faster. We show that quantum kernel model performance improves as the feature dimension and training data increases, which is the first evidence of quantum model performance at scale.

arXiv:2411.09336•International Conference for High Performance Computing, Networking, Storage and Analysis (SC)•Nov 17, 2024•3 citations

Benchmarking quantum computing statevector simulators on high-performance computing

Jesús Cerrudo-Herrera, Daniel Talaván-Vega, Paloma Rodríguez-Oliver +2 more

The increasing complexity of quantum algorithms and the limitations of current Noisy Intermediate-Scale Quantum (NISQ) hardware underscore the importance of efficient classical simulators. To support informed decision-making by users of quantum circuit simulators, we benchmark seven statevector-based quantum circuit simulators (Qiskit, Qulacs, Qibo, Qsimov, Cirq, Pennylane and the Intel Quantum Simulator (IQS)) on a multicore node of the Lusitania high-performance computing (HPC) system. We evaluate their performance in terms of execution time, memory usage and core scalability using Grover’s algorithm, the quantum Fourier transform (QFT), and quantum volume (QV) circuits, across qubit counts ranging from 3 to 30. Our results reveal that Qulacs offers the best performance for circuits below 22 qubits, while Qiskit becomes the fastest for larger and more complex circuits. Qiskit and Qulacs achieve the most efficient parallel performance across multiple cores, while others display limited scaling benefits. IQS shows the lowest memory consumption in QFT and QV benchmarks for systems under 24 qubits; however, it suffers from higher execution times, particularly for Grover’s algorithm. The experimental implementation of Qsimov consistently underperforms in both runtime and scalability; for this reason, it is employed as a baseline in our measurements, serving to highlight the importance of performance optimizations in statevector-based quantum circuit simulators. Previous findings provide a comprehensive performance landscape to guide researchers in selecting appropriate simulators for both standard and large-scale quantum workloads on HPC infrastructures.

SIMULATION•Apr 22, 2026•0 citations

A Comprehensive Cross-Model Framework for Benchmarking the Performance of Quantum Hamiltonian Simulations

Avimita Chatterjee, Sonny Rappaport, Anish Giri +5 more

Quantum Hamiltonian simulation is one of the most promising applications of quantum computing and forms the basis for many quantum algorithms. Benchmarking them is an important gauge of progress in quantum computing technology. We present a methodology and software framework to evaluate various facets of the performance of gate-based quantum computers on Trotterized quantum Hamiltonian evolution. We propose three distinct modes for benchmarking: (i) comparing simulation on a real device to that on a noiseless classical simulator, (ii) comparing simulation on a real device with exact diagonalization results, and (iii) using scalable mirror circuit techniques to assess hardware performance in scenarios beyond classical simulation methods. We demonstrate this framework on five Hamiltonian models from the HamLib library: the Fermi and Bose-Hubbard models, the transverse field Ising model, the Heisenberg model, and the Max3SAT problem. Experiments were conducted using Qiskit's Aer simulator, BlueQubit's CPU cluster and GPU simulators, and IBM's quantum hardware. Our framework, extendable to other Hamiltonians, provides comprehensive performance profiles that reveal hardware and algorithmic limitations and measure both fidelity and execution times, identifying crossover points where quantum hardware outperforms CPU/GPU simulators.

arXiv:2409.06919•IEEE Transactions on Quantum Engineering•Jan 1, 2025•13 citations

High Performance Emulation of Quantum Circuits

Thomas Häner, Damian S. Steiger, Mikhail Smelyanskiy +1 more

As quantum computers of non-trivial size become available in the near future, it is imperative to develop tools to emulate small quantum computers. This allows for validation and debugging of algorithms as well as exploring hardware-software co-design to guide the development of quantum hardware and architectures. The simulation of quantum computers entails multiplications of sparse matrices with very large dense vectors of dimension 2n, where n denotes the number of qubits, making this a memory-bound and network bandwidth-limited application. We introduce the concept of a quantum computer emulator as a component of a software framework for quantum computing, enabling a significant performance advantage over simulators by emulating quantum algorithms at a high level rather than simulating individual gate operations. We describe various optimization approaches and present benchmarking results, establishing the superiority of quantum computer emulators in terms of performance.

arXiv:1604.06460•International Conference for High Performance Computing, Networking, Storage and Analysis (SC)•Nov 1, 2016•72 citations
Evaluating quantum algorithms at utility-scale—involving more than 100 qubits—is a key step toward advancing real-world applications of quantum computing. In this study, we benchmark seven state-of-the-art quantum emulators employing techniques such as tensor networks, matrix product states (MPS), decision diagrams, and factorized ket based methods, running on CPU based hardware and focusing on effectively exact simulations. Performance is assessed on 13 benchmark circuits from the MQTBench library, spanning circuit sizes from 4 to 1,024 qubits. Our results reveal that MPS-based emulators outperform other approaches overall, successfully solving 8 benchmarks up to the maximum size of 1,024 qubits and 12 benchmarks up to at least 100 qubits in less than 5 minutes. We find evidence that all circuits except a random one can be simulated in polynomial time. This work demonstrates that quantum emulators can faithfully simulate a broad range of large and complex universal quantum circuits with high fidelity, far beyond the limits of statevector simulators and today’s quantum hardware.
Classical simulation of quantum systems is indispensable for validating quantum algorithms, benchmarking near-term quantum hardware, and understanding quantum advantage boundaries. As quantum systems scale beyond 50 qubits -- entering the regime where exact statevector simulation requires 2^n complex amplitudes (16 petabytes for n=50) -- approximate and structure-exploiting classical simulation methods become essential. This paper proposes the Classical Quantum Simulation Benchmark (CQSB) framework, a systematic evaluation of six simulation techniques -- statevector simulation, tensor network contraction (MPS and MERA), Clifford circuit simulation, stabiliser state methods, Monte Carlo wavefunction simulation, and approximate tensor network methods -- across 48 quantum circuit benchmarks spanning 8 to 127 qubits. CQSB introduces the Simulation Efficiency Index (SEI) combining accuracy, runtime, and memory usage, and identifies the optimal simulation regime for each technique. Key results: MPS tensor networks achieve exact simulation to 127 qubits for circuits with bond dimension χ <= 512; Clifford simulation scales to 10,000 qubits in O(n2) time; approximate tensor network contraction produces fidelity > 0.95 for 72-qubit random circuits within 4.8 hours on a 256-GPU cluster. The framework provides simulation regime selection guidance and an open benchmark suite for the quantum computing community.
Quantum computer simulators are an indispensable tool for prototyping quantum algorithms and verifying the functioning of existing quantum computer hardware. The current largest quantum computers feature more than one thousand qubits, challenging their classical simulators. Statevector quantum simulators are challenged by the exponential increase of representable quantum states with respect to the number of qubits, making more than fifty qubits practically unfeasible. A more appealing approach for simulating quantum computers is adopting the tensor network approach, whose memory requirements fundamentally depend on the level of entanglement in the quantum circuit, and allows simulating the current largest quantum computers. This work investigates and evaluates the CUDA-Q tensor network simulators on an Nvidia Grace Hopper system, particularly the Matrix Product State (MPS) formulation. We compare the performance of the CUDA-Q state vector implementation and validate the correctness of MPS simulations. Our results highlight that tensor network-based methods provide a significant opportunity to simulate large-qubit circuits, albeit approximately. We also show that current GPUaccelerated computation cannot fully utilize GPU efficiently in the case of MPS simulations.
Data representation in quantum state space offers an alternative function space for machine learning tasks. However, benchmarking these algorithms at a practical scale has been limited by ineffective simulation methods. We develop a quantum kernel framework using a Matrix Product State (MPS) simulator and employ it to perform a classification task with 165 features and 6400 training data points, well beyond the scale of any prior work. We make use of a circuit ansatz on a linear chain of qubits with increasing interaction distance between qubits. We assess the MPS simulator performance on CPUs and GPUs and, by systematically increasing the qubit interaction distance, we identify a crossover point beyond which the GPU implementation runs faster. We show that quantum kernel model performance improves as the feature dimension and training data increases, which is the first evidence of quantum model performance at scale.
The increasing complexity of quantum algorithms and the limitations of current Noisy Intermediate-Scale Quantum (NISQ) hardware underscore the importance of efficient classical simulators. To support informed decision-making by users of quantum circuit simulators, we benchmark seven statevector-based quantum circuit simulators (Qiskit, Qulacs, Qibo, Qsimov, Cirq, Pennylane and the Intel Quantum Simulator (IQS)) on a multicore node of the Lusitania high-performance computing (HPC) system. We evaluate their performance in terms of execution time, memory usage and core scalability using Grover’s algorithm, the quantum Fourier transform (QFT), and quantum volume (QV) circuits, across qubit counts ranging from 3 to 30. Our results reveal that Qulacs offers the best performance for circuits below 22 qubits, while Qiskit becomes the fastest for larger and more complex circuits. Qiskit and Qulacs achieve the most efficient parallel performance across multiple cores, while others display limited scaling benefits. IQS shows the lowest memory consumption in QFT and QV benchmarks for systems under 24 qubits; however, it suffers from higher execution times, particularly for Grover’s algorithm. The experimental implementation of Qsimov consistently underperforms in both runtime and scalability; for this reason, it is employed as a baseline in our measurements, serving to highlight the importance of performance optimizations in statevector-based quantum circuit simulators. Previous findings provide a comprehensive performance landscape to guide researchers in selecting appropriate simulators for both standard and large-scale quantum workloads on HPC infrastructures.
Quantum Hamiltonian simulation is one of the most promising applications of quantum computing and forms the basis for many quantum algorithms. Benchmarking them is an important gauge of progress in quantum computing technology. We present a methodology and software framework to evaluate various facets of the performance of gate-based quantum computers on Trotterized quantum Hamiltonian evolution. We propose three distinct modes for benchmarking: (i) comparing simulation on a real device to that on a noiseless classical simulator, (ii) comparing simulation on a real device with exact diagonalization results, and (iii) using scalable mirror circuit techniques to assess hardware performance in scenarios beyond classical simulation methods. We demonstrate this framework on five Hamiltonian models from the HamLib library: the Fermi and Bose-Hubbard models, the transverse field Ising model, the Heisenberg model, and the Max3SAT problem. Experiments were conducted using Qiskit's Aer simulator, BlueQubit's CPU cluster and GPU simulators, and IBM's quantum hardware. Our framework, extendable to other Hamiltonians, provides comprehensive performance profiles that reveal hardware and algorithmic limitations and measure both fidelity and execution times, identifying crossover points where quantum hardware outperforms CPU/GPU simulators.
As quantum computers of non-trivial size become available in the near future, it is imperative to develop tools to emulate small quantum computers. This allows for validation and debugging of algorithms as well as exploring hardware-software co-design to guide the development of quantum hardware and architectures. The simulation of quantum computers entails multiplications of sparse matrices with very large dense vectors of dimension 2n, where n denotes the number of qubits, making this a memory-bound and network bandwidth-limited application. We introduce the concept of a quantum computer emulator as a component of a software framework for quantum computing, enabling a significant performance advantage over simulators by emulating quantum algorithms at a high level rather than simulating individual gate operations. We describe various optimization approaches and present benchmarking results, establishing the superiority of quantum computer emulators in terms of performance.