1: \begin{abstract}
2: % Today it is impossible to imagine modern machine learning, optimization, etc. problems without big data. Often when talking about machine learning we already mean big data. That is why it is important to solve such problems efficiently. A significant breakthrough in solving such problems was the concept of batching, that is, to parallelize the solution of the problem on several machines, thereby reducing the solution time. In this paper, we study the solution of a convex black-box problem in a overparameterization condition when the gradient is not available, but a zero-order oracle (the value of the objective function) is available. Considering the smooth case, we use gradient approximation via $l_2$ randomization to create a novel gradient-free algorithm. We also show the effectiveness of the proposed algorithm and verify the theoretical results of convergence using a model example in the Experiments Section.
3: This paper is devoted to solving a convex stochastic optimization problem in a overparameterization setup for the case where the original gradient computation is not available, but an objective function value can be computed. For this class of problems we provide a novel gradient-free algorithm, whose creation approach is based on applying a gradient approximation with $l_2$ randomization instead of a gradient oracle in the biased Accelerated SGD algorithm, which generalizes the convergence results of the AC-SA algorithm to the case where the gradient oracle returns a noisy (inexact) objective function value. We also perform a detailed analysis to find the maximum admissible level of adversarial noise at which we can guarantee to achieve the desired accuracy. We verify the theoretical results of convergence using a model example.
4:
5: \keywords{Black-Box Optimization \and Overparametrization \and Accelerated Zero-Order SGD Method \and Biased Gradient Oracle.}
6: \end{abstract}
7: