Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2105.10162 · PLoS ONE

Variational quantum classifiers through the lens of the Hessian

Pinaki Sen, Amandeep Singh Bhatia, Kamalpreet Singh Bhangu, Ahmed Elbeltagi

Published Jan 20, 2022• 39 citations
arXivHTMLPDF

Abstract

In quantum computing, the variational quantum algorithms (VQAs) are well suited for finding optimal combinations of things in specific applications ranging from chemistry all the way to finance. The training of VQAs with gradient descent optimization algorithm has shown a good convergence. At an early stage, the simulation of variational quantum circuits on noisy intermediate-scale quantum (NISQ) devices suffers from noisy outputs. Just like classical deep learning, it also suffers from vanishing gradient problems. It is a realistic goal to study the topology of loss landscape, to visualize the curvature information and trainability of these circuits in the existence of vanishing gradients. In this paper, we calculate the Hessian and visualize the loss landscape of variational quantum classifiers at different points in parameter space. The curvature information of variational quantum classifiers (VQC) is interpreted and the loss function's convergence is shown. It helps us better understand the behavior of variational quantum circuits to tackle optimization problems efficiently. We investigated the variational quantum classifiers via Hessian on quantum computers, starting with a simple 4-bit parity problem to gain insight into the practical behavior of Hessian, then thoroughly analyzed the behavior of Hessian's eigenvalues on training the variational quantum classifier for the Diabetes dataset. Finally, we show how the adaptive Hessian learning rate can influence the convergence while training the variational circuits.

DOI
10.1371/journal.pone.0262346

Related papers

Characterizing the loss landscape of variational quantum circuits

Patrick Huembeli, Alexandre Dauphin

Abstract Machine learning techniques enhanced by noisy intermediate-scale quantum (NISQ) devices and especially variational quantum circuits (VQC) have recently attracted much interest and have already been benchmarked for certain problems. Inspired by classical deep learning, VQCs are trained by gradient descent methods which allow for efficient training over big parameter spaces. For NISQ sized circuits, such methods show good convergence. There are however still many open questions related to the convergence of the loss function and to the trainability of these circuits in situations of vanishing gradients. Furthermore, it is not clear how ‘good’ the minima are in terms of generalization and stability against perturbations of the data and there is, therefore, a need for tools to quantitatively study the convergence of the VQCs. In this work, we introduce a way to compute the Hessian of the loss function of VQCs and show how to characterize the loss landscape with it. The eigenvalues of the Hessian give information on the local curvature and we discuss how this information can be interpreted and compared to classical neural networks. We benchmark our results on several examples, starting with a simple analytic toy model to provide some intuition about the behaviour of the Hessian, then going to bigger circuits, and also train VQCs on data. Finally, we show how the Hessian can be used to adjust the learning rate for faster convergence during the training of variational circuits.

arXiv:2008.02785•Quantum Science and Technology•Jan 14, 2021•78 citations

Training Variational Quantum Circuits through Genetic Algorithms

Giovanni Acampora, Angela Chiatto, Autilia Vitiello

Recently, Variational Quantum Circuits (VQCs) are attracting considerable attention among quantum algorithms thanks to their robustness to the noise characterizing the current quantum devices. In detail, VQCs involve parameterized quan-tum circuits to be trained by means of a classical optimizer that makes queries to the quantum device. VQCs play a key role in several applications including quantum classifiers where the Hilbert space is used as feature space. Currently, the most used classical optimizer to learn V QCs is the gradient descent method. However, the so-called barren plateaus issue causes gradients of cost functions to become exceedingly small as the dimension of the classification problem is increased. As consequence, gradient descent method could be not efficient in real-world classification problems. This paper proposes to apply Genetic Algorithms (GAs) to train VQCs used as quantum classifiers. As shown in the experiments, the application of GAs results in accurate solutions obtained with a reduced number of queries to quantum devices.

IEEE Congress on Evolutionary Computation (CEC)•Jul 18, 2022•17 citations

Bayesian Variational Quantum Classifiers for Uncertainty-Aware Quantum Machine Learning

Bhavna Saini, Vivek Kumar Verma, Nidhi Kushwaha +1 more

Quantum machine learning is increasingly being explored as a way to tackle complex data analysis problems by combining quantum computing with modern learning techniques. In particular, variational quantum classifiers have attracted considerable attention because they can be implemented on current noisy intermediate-scale quantum (NISQ) devices. Despite their potential, most existing variational quantum classifiers rely on deterministic optimization of circuit parameters. Such approaches can struggle when the available training data are limited or noisy, often leading to unstable predictions and reduced reliability. To address these challenges, recent research has begun incorporating Bayesian learning principles into variational quantum models. By treating circuit parameters as probabilistic variables rather than fixed values, Bayesian variational quantum classifiers allow uncertainty to be explicitly modeled during the learning process. This makes it possible to obtain predictions that are not only accurate but also accompanied by meaningful confidence estimates. In this paper, we present a detailed analysis of Bayesian variational quantum classifiers and their role in enabling uncertainty-aware quantum machine learning. The discussion covers the foundations of variational quantum circuits, Bayesian parameter estimation, and probabilistic prediction mechanisms within hybrid quantum-classical learning frameworks. Different training and inference strategies, including variational Bayesian optimization and sampling-based methods, are examined to highlight their effectiveness in capturing parameter uncertainty in quantum circuits. We also discuss emerging application areas, such as healthcare analytics, financial forecasting, and scientific data analysis, where uncertainty-aware quantum learning models can provide valuable insights.

International Conference on Data Science for Cyber-Physical Systems Resilience using Advanced Applications (ICDCA)•Jun 1, 2026•0 citations

The Average Relative Entropy and Transpilation Depth determines the noise robustness in Variational Quantum Classifiers

Aakash Ravindra Shinde, Arianne Meijer - van de Griend, Jukka K. Nurminen

Variational Quantum Algorithms (VQAs) have been extensively researched for applications in Quantum Machine Learning (QML), Optimization, and Molecular simulations. Although designed for Noisy Intermediate-Scale Quantum (NISQ) devices, VQAs are predominantly evaluated classically due to uncertain results on noisy devices and limited resource availability. Raising concern over the reproducibility of simulated VQAs on noisy hardware. While prior studies indicate that VQAs may exhibit noise resilience in specific parameterized shallow quantum circuits, there are no definitive measures to establish what defines a shallow circuit or the optimal circuit depth for VQAs on a noisy platform. These challenges extend naturally to Variational Quantum Classification (VQC) algorithms, a subclass of VQAs for supervised learning. In this article, we propose a relative entropy-based metric to verify whether a VQC model would perform similarly on a noisy device as it does on simulations. We establish a strong correlation between the average relative entropy difference in classes, transpilation circuit depth, and their performance difference on a noisy quantum device. Our results further indicate that circuit depth alone is insufficient to characterize shallow circuits. We present empirical evidence to support these assertions across a diverse array of techniques for implementing VQC, datasets, and multiple noisy quantum devices.

quant-pharXiv:2603.21300•Mar 24, 2026•0 citations

Normalized Gradient Descent for Variational Quantum Algorithms

Yudai Suzuki, Hiroshi Yano, Rudy Raymond +1 more

Variational quantum algorithms (VQAs) are promising methods that leverage noisy quantum computers and classical computing techniques for practical applications. In VQAs, the classical optimizers such as gradient-based optimizers are utilized to adjust the parameters of the quantum circuit so that the objective function is minimized. However, they often suffer from the so-called vanishing gradient or barren plateau issue. On the other hand, the normalized gradient descent (NGD) method, which employs the normalized gradient vector to update the parameters, has been successfully utilized in several optimization problems. Here, we study the performance of the NGD methods in the optimization of VQAs for the first time. Our goal is two-fold. The first is to examine the effectiveness of NGD and its variants for overcoming the vanishing gradient problems. The second is to propose a new NGD that can attain the faster convergence than the ordinary NGD. We performed numerical simulations of these gradient-based optimizers in the context of quantum chemistry where VQAs are used to find the ground state of a given Hamiltonian. The results show the effective convergence property of the NGD methods in VQAs, compared to the relevant optimizers without normalization. Moreover, we make use of some normalized gradient vectors at the past iteration steps to propose the novel historical NGD that has a theoretical guarantee to accelerate the convergence speed, which is observed in the numerical experiments as well.

arXiv:2106.10981•IEEE International Conference on Quantum Computing and Engineering (QCE)•Oct 1, 2021•17 citations

ORQVIZ: Visualizing High-Dimensional Landscapes in Variational Quantum Algorithms

Manuel S. Rudolph, Sukin Sim, Asad Raza +5 more

Variational Quantum Algorithms (VQAs) are promising candidates for finding practical applications of near to mid-term quantum computers. There has been an increasing effort to study the intricacies of VQAs, such as the presence or absence of barren plateaus and the design of good quantum circuit ansätze. Many of these studies can be linked to the loss landscape that is optimized as part of the algorithm, and there is high demand for quality software tools for flexibly studying these loss landscapes. In our work, we collect a variety of techniques that have been used to visualize the training of deep artificial neural networks and apply them to visualize the high-dimensional loss landscapes of VQAs. We review and apply the techniques to three types of VQAs: the Quantum Approximate Optimization Algorithm, the Quantum Circuit Born Machine, and the Variational Quantum Eigensolver. Additionally, we investigate the impact of noise due to finite sampling in the estimation of loss functions. For each case, we demonstrate how our visualization techniques can verify observations from past studies and provide new insights. This work is accompanied by the release of the open-source Python package $\textit{orqviz}$, which provides code to compute and flexibly plot 1D and 2D scans, Principal Component Analysis scans, Hessians, and the Nudged Elastic Band algorithm. $\textit{orqviz}$ enables flexible visual analysis of high-dimensional VQA landscapes and can be found at: $\textbf{github.com/zapatacomputing/orqviz}$.

arXiv:2111.04695•Nov 8, 2021•27 citations
In quantum computing, the variational quantum algorithms (VQAs) are well suited for finding optimal combinations of things in specific applications ranging from chemistry all the way to finance. The training of VQAs with gradient descent optimization algorithm has shown a good convergence. At an early stage, the simulation of variational quantum circuits on noisy intermediate-scale quantum (NISQ) devices suffers from noisy outputs. Just like classical deep learning, it also suffers from vanishing gradient problems. It is a realistic goal to study the topology of loss landscape, to visualize the curvature information and trainability of these circuits in the existence of vanishing gradients. In this paper, we calculate the Hessian and visualize the loss landscape of variational quantum classifiers at different points in parameter space. The curvature information of variational quantum classifiers (VQC) is interpreted and the loss function's convergence is shown. It helps us better understand the behavior of variational quantum circuits to tackle optimization problems efficiently. We investigated the variational quantum classifiers via Hessian on quantum computers, starting with a simple 4-bit parity problem to gain insight into the practical behavior of Hessian, then thoroughly analyzed the behavior of Hessian's eigenvalues on training the variational quantum classifier for the Diabetes dataset. Finally, we show how the adaptive Hessian learning rate can influence the convergence while training the variational circuits.
Abstract Machine learning techniques enhanced by noisy intermediate-scale quantum (NISQ) devices and especially variational quantum circuits (VQC) have recently attracted much interest and have already been benchmarked for certain problems. Inspired by classical deep learning, VQCs are trained by gradient descent methods which allow for efficient training over big parameter spaces. For NISQ sized circuits, such methods show good convergence. There are however still many open questions related to the convergence of the loss function and to the trainability of these circuits in situations of vanishing gradients. Furthermore, it is not clear how ‘good’ the minima are in terms of generalization and stability against perturbations of the data and there is, therefore, a need for tools to quantitatively study the convergence of the VQCs. In this work, we introduce a way to compute the Hessian of the loss function of VQCs and show how to characterize the loss landscape with it. The eigenvalues of the Hessian give information on the local curvature and we discuss how this information can be interpreted and compared to classical neural networks. We benchmark our results on several examples, starting with a simple analytic toy model to provide some intuition about the behaviour of the Hessian, then going to bigger circuits, and also train VQCs on data. Finally, we show how the Hessian can be used to adjust the learning rate for faster convergence during the training of variational circuits.
Recently, Variational Quantum Circuits (VQCs) are attracting considerable attention among quantum algorithms thanks to their robustness to the noise characterizing the current quantum devices. In detail, VQCs involve parameterized quan-tum circuits to be trained by means of a classical optimizer that makes queries to the quantum device. VQCs play a key role in several applications including quantum classifiers where the Hilbert space is used as feature space. Currently, the most used classical optimizer to learn V QCs is the gradient descent method. However, the so-called barren plateaus issue causes gradients of cost functions to become exceedingly small as the dimension of the classification problem is increased. As consequence, gradient descent method could be not efficient in real-world classification problems. This paper proposes to apply Genetic Algorithms (GAs) to train VQCs used as quantum classifiers. As shown in the experiments, the application of GAs results in accurate solutions obtained with a reduced number of queries to quantum devices.
Quantum machine learning is increasingly being explored as a way to tackle complex data analysis problems by combining quantum computing with modern learning techniques. In particular, variational quantum classifiers have attracted considerable attention because they can be implemented on current noisy intermediate-scale quantum (NISQ) devices. Despite their potential, most existing variational quantum classifiers rely on deterministic optimization of circuit parameters. Such approaches can struggle when the available training data are limited or noisy, often leading to unstable predictions and reduced reliability. To address these challenges, recent research has begun incorporating Bayesian learning principles into variational quantum models. By treating circuit parameters as probabilistic variables rather than fixed values, Bayesian variational quantum classifiers allow uncertainty to be explicitly modeled during the learning process. This makes it possible to obtain predictions that are not only accurate but also accompanied by meaningful confidence estimates. In this paper, we present a detailed analysis of Bayesian variational quantum classifiers and their role in enabling uncertainty-aware quantum machine learning. The discussion covers the foundations of variational quantum circuits, Bayesian parameter estimation, and probabilistic prediction mechanisms within hybrid quantum-classical learning frameworks. Different training and inference strategies, including variational Bayesian optimization and sampling-based methods, are examined to highlight their effectiveness in capturing parameter uncertainty in quantum circuits. We also discuss emerging application areas, such as healthcare analytics, financial forecasting, and scientific data analysis, where uncertainty-aware quantum learning models can provide valuable insights.
Variational Quantum Algorithms (VQAs) have been extensively researched for applications in Quantum Machine Learning (QML), Optimization, and Molecular simulations. Although designed for Noisy Intermediate-Scale Quantum (NISQ) devices, VQAs are predominantly evaluated classically due to uncertain results on noisy devices and limited resource availability. Raising concern over the reproducibility of simulated VQAs on noisy hardware. While prior studies indicate that VQAs may exhibit noise resilience in specific parameterized shallow quantum circuits, there are no definitive measures to establish what defines a shallow circuit or the optimal circuit depth for VQAs on a noisy platform. These challenges extend naturally to Variational Quantum Classification (VQC) algorithms, a subclass of VQAs for supervised learning. In this article, we propose a relative entropy-based metric to verify whether a VQC model would perform similarly on a noisy device as it does on simulations. We establish a strong correlation between the average relative entropy difference in classes, transpilation circuit depth, and their performance difference on a noisy quantum device. Our results further indicate that circuit depth alone is insufficient to characterize shallow circuits. We present empirical evidence to support these assertions across a diverse array of techniques for implementing VQC, datasets, and multiple noisy quantum devices.
Variational quantum algorithms (VQAs) are promising methods that leverage noisy quantum computers and classical computing techniques for practical applications. In VQAs, the classical optimizers such as gradient-based optimizers are utilized to adjust the parameters of the quantum circuit so that the objective function is minimized. However, they often suffer from the so-called vanishing gradient or barren plateau issue. On the other hand, the normalized gradient descent (NGD) method, which employs the normalized gradient vector to update the parameters, has been successfully utilized in several optimization problems. Here, we study the performance of the NGD methods in the optimization of VQAs for the first time. Our goal is two-fold. The first is to examine the effectiveness of NGD and its variants for overcoming the vanishing gradient problems. The second is to propose a new NGD that can attain the faster convergence than the ordinary NGD. We performed numerical simulations of these gradient-based optimizers in the context of quantum chemistry where VQAs are used to find the ground state of a given Hamiltonian. The results show the effective convergence property of the NGD methods in VQAs, compared to the relevant optimizers without normalization. Moreover, we make use of some normalized gradient vectors at the past iteration steps to propose the novel historical NGD that has a theoretical guarantee to accelerate the convergence speed, which is observed in the numerical experiments as well.
Variational Quantum Algorithms (VQAs) are promising candidates for finding practical applications of near to mid-term quantum computers. There has been an increasing effort to study the intricacies of VQAs, such as the presence or absence of barren plateaus and the design of good quantum circuit ansätze. Many of these studies can be linked to the loss landscape that is optimized as part of the algorithm, and there is high demand for quality software tools for flexibly studying these loss landscapes. In our work, we collect a variety of techniques that have been used to visualize the training of deep artificial neural networks and apply them to visualize the high-dimensional loss landscapes of VQAs. We review and apply the techniques to three types of VQAs: the Quantum Approximate Optimization Algorithm, the Quantum Circuit Born Machine, and the Variational Quantum Eigensolver. Additionally, we investigate the impact of noise due to finite sampling in the estimation of loss functions. For each case, we demonstrate how our visualization techniques can verify observations from past studies and provide new insights. This work is accompanied by the release of the open-source Python package orqviz\textit{orqviz}orqviz, which provides code to compute and flexibly plot 1D and 2D scans, Principal Component Analysis scans, Hessians, and the Nudged Elastic Band algorithm. orqviz\textit{orqviz}orqviz enables flexible visual analysis of high-dimensional VQA landscapes and can be found at: github.com/zapatacomputing/orqviz\textbf{github.com/zapatacomputing/orqviz}github.com/zapatacomputing/orqviz.