Black-Box Optimization of QUBO-Based Machine Learning Models Using Tensor Train Sampling
Hadi Salloum, Osama Orabi, Salman Ahmdi, Yaroslav Aleksandrovich Kholodov, Xiao Yu, Witold Pedrycz C, Mirko Farina
Abstract
The Probabilistic Optimizer with TEnsor Sampling (PROTES) is a gradient-free optimization method for multidimensional arrays and discretized multivariate functions based on the tensor train (TT) format. This novel tensor-network methodology demonstrates significant promise for complex Quadratic Unconstrained Binary Optimization (QUBO) problems. We establish the first application of PROTES to machine learning model training via QUBO formulations and provide the inaugural comparative analysis against D-Wave quantum annealing. Our results reveal a critical performance dichotomy: For smallscale, structurally complex QUBO instances, PROTES achieves superior solution accuracy with enhanced computational stability compared to quantum annealing, while maintaining competitive efficiency. Conversely, Quantum Annealing retains scalability advantages for larger problem dimensions. These findings delineate precise operational domains for tensor-network versus quantum optimization paradigms, establishing PROTES as the preferred solver for compact, high-complexity QUBO problems. This research provides fundamental insights for strategic solver selection and advances the engineering of hybrid quantumclassical optimization frameworks.