On scalable quantum-inspired distributed machine learning
Jean-Michel Sellier, Hardik Dalal
Abstract
Recently a new approach to train machine learning models, such as neural networks, has been introduced. This method is based on the simulation of a type of quantum systems, in particular systems of one-dimensional electrons coupled by a force, which offers important advantages. First, by exploiting simulations of the quantum tunnelling effect, a different, and faster, convergence in the training phase can be obtained. Secondly, it does not require the computation of any kind of gradient (in other words, it can be considered a derivative-free or gradient-free optimizer) thus allowing the training of complex models impossible to train otherwise, for instance with the gradient descent method, or variations of it. Finally, it allows the use of parallelization schemes which can scale linearly with the dimensions of problem at hand, i.e., the method is nearly "embarrassingly parallelizable". This opens the way towards scalable and performant distributed machine learning capabilities. The goal of this paper is to focus specifically on this very advantage, suggest various strategies for parallelization, and discuss their consequences.