Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2303.16202 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings

CCuantuMM: Cycle-Consistent Quantum-Hybrid Matching of Multiple Shapes

Harshil Singh Bhatia, Edith Tretschk, Zorah Lähner, Marcel Seelbach Benkner, Michael Moeller, Christian Theobalt, Vladislav Golyanik

Published Jun 1, 2023• 12 citations
arXivHTMLPDF

Abstract

Jointly matching multiple, non-rigidly deformed 3D shapes is a challenging,$\mathcal{NP}$-hard problem. A perfect matching is necessarily cycle-consistent: Following the pairwise point correspondences along several shapes must end up at the starting vertex of the original shape. Unfortunately, existing quantum shape-matching methods do not support multiple shapes and even less cycle consistency. This paper addresses the open challenges and introduces the first quantum-hybrid approach for 3D shape multi-matching; in addition, it is also cycle-consistent. Its iterative formulation is admissible to modern adiabatic quantum hardware and scales linearly with the total number of input shapes. Both these characteristics are achieved by reducing the N-shape case to a sequence of three-shape matchings, the derivation of which is our main technical contribution. Thanks to quantum annealing, high-quality solutions with low energy are retrieved for the intermediate$\mathcal{NP}$- hard objectives. On benchmark datasets, the proposed approach significantly outperforms extensions to multi-shape matching of a previous quantum-hybrid two-shape matching method and is on-par with classical multi-matching methods. Our source code is available at 4dqv.mpiinf.mpg.de/CCuantuMM/.

DOI
10.1109/cvpr52729.2023.00131

Related papers

Q-Match: Iterative Shape Matching via Quantum Annealing

Marcel Seelbach Benkner, Zorah Lähner, Vladislav Golyanik +3 more

Finding shape correspondences can be formulated as an ${\mathcal{N}}{\mathcal{P}} - hard$ quadratic assignment problem (QAP) that becomes infeasible for shapes with high sampling density. A promising research direction is to tackle such quadratic optimization problems over binary variables with quantum annealing, which allows for some problems a more efficient search in the solution space. Unfortunately, enforcing the linear equality constraints in QAPs via a penalty significantly limits the success probability of such methods on currently available quantum hardware. To address this limitation, this paper proposes Q-Match, i.e., a new iterative quantum method for QAPs inspired by the α-expansion algorithm, which allows solving problems of an order of magnitude larger than current quantum methods. It implicitly enforces the QAP constraints by updating the current estimates in a cyclic fashion. Further, Q-Match can be applied iteratively, on a subset of well-chosen correspondences, al-lowing us to scale to real-world problems. Using the latest quantum annealer, the D-Wave Advantage, we evaluate the proposed method on a subset of QAPLIB as well as on isometric shape matching problems from the FAUST dataset.

arXiv:2105.02878•IEEE/CVF International Conference on Computer Vision (ICCV)•Oct 1, 2021•28 citations

Outlier-Robust Multi-Model Fitting on Quantum Annealers

Saurabh Pandey, Luca Magri, Federica Arrigoni +1 more

Multi-model fitting (MMF) presents a significant challenge in Computer Vision, particularly due to its combinatorial nature. While recent advancements in quantum computing offer promise for addressing NP-hard problems, existing quantum-based approaches for model fitting are either limited to a single model or consider multi-model scenarios within outlier-free datasets. This paper introduces a novel approach, the robust quantum multi-model fitting (R-QuMF) algorithm, designed to handle outliers effectively. Our method leverages the intrinsic capabilities of quantum hardware to tackle combinatorial challenges inherent in MMF tasks, and it does not require prior knowledge of the exact number of models, thereby enhancing its practical applicability. By formulating the problem as a maximum set coverage task for adiabatic quantum computers (AQC), R-QuMF outperforms existing quantum techniques, demonstrating superior performance across various synthetic and real-world 3D datasets. Our findings underscore the potential of quantum computing in addressing the complexities of MMF, especially in real-world scenarios with noisy and outlier-prone data11Project page: https://4dqv.mpi-inf.mpg.de/RQMMF/.

IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)•Jun 11, 2025•1 citation

Quantum Multi-Model Fitting

Matteo Farina, Luca Magri, Willi Menapace +3 more

Geometric model fitting is a challenging but fundamental computer vision problem. Recently, quantum optimization has been shown to enhance robust fitting for the case of a single model, while leaving the question of multi-model fitting open. In response to this challenge, this paper shows that the latter case can significantly benefit from quantum hardware and proposes the first quantum approach to multimodel fitting (MMF). We formulate MMF as a problem that can be efficiently sampled by modern adiabatic quantum computers without the relaxation of the objective function. We also propose an iterative and decomposed version of our method, which supports real-world-sized problems. The experimental evaluation demonstrates promising results on a variety of datasets. The source code is available at: https://github.com/FarinaMatteo/qmmf.

arXiv:2303.15444•IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings•Jun 1, 2023•14 citations

Solving Combinatorial Optimization Problems in Computer Vision via Quantum Annealing

Marcel Seelbach Benkner

Since the ability of quantum computing to speed up certain, specific computations has a solid theoretical underpinning, it is a natural question to ask if problems in computer vision also benefit from it. This doctoral thesis is in particular concerned with the question if the recently emerging optimization method of quantum annealing is useful for solving combinatorial optimization problems that arise in computer vision. The computer vision problem that is mainly investigated here is the problem of shape matching. The task of shape matching is to obtain the correspondences of two objects in a scene that are described with point clouds. Most often, one is concerned with finding the correspondences for a person who is recorded in 3D two times but with a different pose. The reason why this computer vision problem was picked as an interesting candidate for an application of quantum annealing is because it can be formulated as a difficult combinatorial optimization problem with a quadratic objective. This is close to the type of optimization problem that recent quantum annealing devices try to solve. The biggest difference is that in quantum annealing one a priori has unconstrained problems so that one cannot include equality constraints in the optimization. In the first work of this thesis, multiple methods are presented to overcome this difference and for really small shape matching problems experiments with simulated quantum annealing and with quantum annealing on D-Wave quantum computers were presented. In the second work of this thesis an iterative method was developed so that it was even possible to solve shape matching problems with over 500 vertices. Finally, a third publication looked at problems where one needs to find the correspondences between multiple shapes. Besides applications of quantum annealing for shape matching, this thesis also contains work on solving the motion segmentation problem with quantum annealing and work about integrating a quantum annealer in a neural network to solve computer vision problems. The integration of the quantum annealer in a neural network can also be viewed as the task to learn an appropriate formulation of a computer vision problem in a way that is solvable with a current quantum annealer. Finally, we also present work about an iterative method for compensating limited connectivity in quantum annealing devices. This work has no particular computer vision application in mind, but investigates the performance of the different approaches on Max-Cut problems. The thesis is structured in a cumulative way, so that the individual publications are presented separately. On a broader picture, the works are motivated by the following questions: What could be the impact of quantum annealing on computer vision and how could computer vision algorithms that use quantum annealing look like? And from another perspective: How would the field of computer vision be changed if there were massive advances in building quadratic, unconstrained, binary optimization problem solvers with or even without utilizing quantum computing?

•Jan 1, 2025•0 citations

Quantum-Hybrid Stereo Matching With Nonlinear Regularization and Spatial Pyramids

Cameron Braunstein, Eddy Ilg, Vladislav Golyanik

Quantum visual computing is advancing rapidly. This paper presents a new formulation for stereo matching with nonlinear regularizers and spatial pyramids on quantum annealers as a maximum a posteriori inference problem that minimizes the energy of a Markov Random Field. Our approach is hybrid (i.e., quantum-classical) and is compatible with modern D-Wave quantum annealers, i.e., it includes a quadratic unconstrained binary optimization (QUBO) objective. Previous quantum annealing techniques for stereo matching are limited to using linear regularizers, and thus, they do not exploit the fundamental advantages of the quantum computing paradigm in solving combinatorial optimization problems. In contrast, our method utilizes the full potential of quantum annealing for stereo matching, as nonlinear regularizers create optimization problems which are $\mathcal{N}\mathcal{P}$-hard. On the Middlebury benchmark, we achieve an improved root mean squared accuracy over the previous state of the art in quantum stereo matching of $2 \%$ and $22.5 \%$ when using different solvers.

arXiv:2312.16118•International Conference on 3D Vision (3DV)•Mar 18, 2024•3 citations

Adiabatic Quantum Graph Matching with Permutation Matrix Constraints

Marcel Seelbach Benkner, Vladislav Golyanik, Christian Theobalt +1 more

Matching problems on 3D shapes and images are challenging as they are frequently formulated as combinatorial quadratic assignment problems (QAPs) with permutation matrix constraints, which are NP-hard. In this work, we address such problems with emerging quantum computing technology and propose several reformulations of QAPs as unconstrained problems suitable for efficient execution on quantum hardware. We investigate several ways to inject permutation matrix constraints in a quadratic unconstrained binary optimization problem which can be mapped to quantum hardware. We focus on obtaining a sufficient spectral gap, which further increases the probability to measure optimal solutions and valid permutation matrices in a single run. We perform our experiments on the quantum computer D-Wave 2000Q (2^11 qubits, adiabatic). Despite the observed discrepancy between simulated adiabatic quantum computing and execution on real quantum hardware, our reformulation of permutation matrix constraints increases the robustness of the numerical computations over other penalty approaches in our experiments. The proposed algorithm has the potential to scale to higher dimensions on future quantum computing architectures, which opens up multiple new directions for solving matching problems in 3D computer vision and graphics.

arXiv:2107.04032•Jul 8, 2021•1 citation
Jointly matching multiple, non-rigidly deformed 3D shapes is a challenging,NP\mathcal{NP}NP-hard problem. A perfect matching is necessarily cycle-consistent: Following the pairwise point correspondences along several shapes must end up at the starting vertex of the original shape. Unfortunately, existing quantum shape-matching methods do not support multiple shapes and even less cycle consistency. This paper addresses the open challenges and introduces the first quantum-hybrid approach for 3D shape multi-matching; in addition, it is also cycle-consistent. Its iterative formulation is admissible to modern adiabatic quantum hardware and scales linearly with the total number of input shapes. Both these characteristics are achieved by reducing the N-shape case to a sequence of three-shape matchings, the derivation of which is our main technical contribution. Thanks to quantum annealing, high-quality solutions with low energy are retrieved for the intermediateNP\mathcal{NP}NP- hard objectives. On benchmark datasets, the proposed approach significantly outperforms extensions to multi-shape matching of a previous quantum-hybrid two-shape matching method and is on-par with classical multi-matching methods. Our source code is available at 4dqv.mpiinf.mpg.de/CCuantuMM/.
Finding shape correspondences can be formulated as an NP−hard{\mathcal{N}}{\mathcal{P}} - hardNP−hard quadratic assignment problem (QAP) that becomes infeasible for shapes with high sampling density. A promising research direction is to tackle such quadratic optimization problems over binary variables with quantum annealing, which allows for some problems a more efficient search in the solution space. Unfortunately, enforcing the linear equality constraints in QAPs via a penalty significantly limits the success probability of such methods on currently available quantum hardware. To address this limitation, this paper proposes Q-Match, i.e., a new iterative quantum method for QAPs inspired by the α-expansion algorithm, which allows solving problems of an order of magnitude larger than current quantum methods. It implicitly enforces the QAP constraints by updating the current estimates in a cyclic fashion. Further, Q-Match can be applied iteratively, on a subset of well-chosen correspondences, al-lowing us to scale to real-world problems. Using the latest quantum annealer, the D-Wave Advantage, we evaluate the proposed method on a subset of QAPLIB as well as on isometric shape matching problems from the FAUST dataset.
Multi-model fitting (MMF) presents a significant challenge in Computer Vision, particularly due to its combinatorial nature. While recent advancements in quantum computing offer promise for addressing NP-hard problems, existing quantum-based approaches for model fitting are either limited to a single model or consider multi-model scenarios within outlier-free datasets. This paper introduces a novel approach, the robust quantum multi-model fitting (R-QuMF) algorithm, designed to handle outliers effectively. Our method leverages the intrinsic capabilities of quantum hardware to tackle combinatorial challenges inherent in MMF tasks, and it does not require prior knowledge of the exact number of models, thereby enhancing its practical applicability. By formulating the problem as a maximum set coverage task for adiabatic quantum computers (AQC), R-QuMF outperforms existing quantum techniques, demonstrating superior performance across various synthetic and real-world 3D datasets. Our findings underscore the potential of quantum computing in addressing the complexities of MMF, especially in real-world scenarios with noisy and outlier-prone data11Project page: https://4dqv.mpi-inf.mpg.de/RQMMF/.
Geometric model fitting is a challenging but fundamental computer vision problem. Recently, quantum optimization has been shown to enhance robust fitting for the case of a single model, while leaving the question of multi-model fitting open. In response to this challenge, this paper shows that the latter case can significantly benefit from quantum hardware and proposes the first quantum approach to multimodel fitting (MMF). We formulate MMF as a problem that can be efficiently sampled by modern adiabatic quantum computers without the relaxation of the objective function. We also propose an iterative and decomposed version of our method, which supports real-world-sized problems. The experimental evaluation demonstrates promising results on a variety of datasets. The source code is available at: https://github.com/FarinaMatteo/qmmf.
Since the ability of quantum computing to speed up certain, specific computations has a solid theoretical underpinning, it is a natural question to ask if problems in computer vision also benefit from it. This doctoral thesis is in particular concerned with the question if the recently emerging optimization method of quantum annealing is useful for solving combinatorial optimization problems that arise in computer vision. The computer vision problem that is mainly investigated here is the problem of shape matching. The task of shape matching is to obtain the correspondences of two objects in a scene that are described with point clouds. Most often, one is concerned with finding the correspondences for a person who is recorded in 3D two times but with a different pose. The reason why this computer vision problem was picked as an interesting candidate for an application of quantum annealing is because it can be formulated as a difficult combinatorial optimization problem with a quadratic objective. This is close to the type of optimization problem that recent quantum annealing devices try to solve. The biggest difference is that in quantum annealing one a priori has unconstrained problems so that one cannot include equality constraints in the optimization. In the first work of this thesis, multiple methods are presented to overcome this difference and for really small shape matching problems experiments with simulated quantum annealing and with quantum annealing on D-Wave quantum computers were presented. In the second work of this thesis an iterative method was developed so that it was even possible to solve shape matching problems with over 500 vertices. Finally, a third publication looked at problems where one needs to find the correspondences between multiple shapes. Besides applications of quantum annealing for shape matching, this thesis also contains work on solving the motion segmentation problem with quantum annealing and work about integrating a quantum annealer in a neural network to solve computer vision problems. The integration of the quantum annealer in a neural network can also be viewed as the task to learn an appropriate formulation of a computer vision problem in a way that is solvable with a current quantum annealer. Finally, we also present work about an iterative method for compensating limited connectivity in quantum annealing devices. This work has no particular computer vision application in mind, but investigates the performance of the different approaches on Max-Cut problems. The thesis is structured in a cumulative way, so that the individual publications are presented separately. On a broader picture, the works are motivated by the following questions: What could be the impact of quantum annealing on computer vision and how could computer vision algorithms that use quantum annealing look like? And from another perspective: How would the field of computer vision be changed if there were massive advances in building quadratic, unconstrained, binary optimization problem solvers with or even without utilizing quantum computing?
Quantum visual computing is advancing rapidly. This paper presents a new formulation for stereo matching with nonlinear regularizers and spatial pyramids on quantum annealers as a maximum a posteriori inference problem that minimizes the energy of a Markov Random Field. Our approach is hybrid (i.e., quantum-classical) and is compatible with modern D-Wave quantum annealers, i.e., it includes a quadratic unconstrained binary optimization (QUBO) objective. Previous quantum annealing techniques for stereo matching are limited to using linear regularizers, and thus, they do not exploit the fundamental advantages of the quantum computing paradigm in solving combinatorial optimization problems. In contrast, our method utilizes the full potential of quantum annealing for stereo matching, as nonlinear regularizers create optimization problems which are NP\mathcal{N}\mathcal{P}NP-hard. On the Middlebury benchmark, we achieve an improved root mean squared accuracy over the previous state of the art in quantum stereo matching of 2%2 \%2% and 22.5%22.5 \%22.5% when using different solvers.
Matching problems on 3D shapes and images are challenging as they are frequently formulated as combinatorial quadratic assignment problems (QAPs) with permutation matrix constraints, which are NP-hard. In this work, we address such problems with emerging quantum computing technology and propose several reformulations of QAPs as unconstrained problems suitable for efficient execution on quantum hardware. We investigate several ways to inject permutation matrix constraints in a quadratic unconstrained binary optimization problem which can be mapped to quantum hardware. We focus on obtaining a sufficient spectral gap, which further increases the probability to measure optimal solutions and valid permutation matrices in a single run. We perform our experiments on the quantum computer D-Wave 2000Q (2^11 qubits, adiabatic). Despite the observed discrepancy between simulated adiabatic quantum computing and execution on real quantum hardware, our reformulation of permutation matrix constraints increases the robustness of the numerical computations over other penalty approaches in our experiments. The proposed algorithm has the potential to scale to higher dimensions on future quantum computing architectures, which opens up multiple new directions for solving matching problems in 3D computer vision and graphics.