1: \begin{abstract}

2: We consider an optimization problem with strongly convex objective and linear inequalities constraints. To be able to deal with a large number of constraints we provide a

3: penalty reformulation of the problem. As penalty functions we use  a version of the one-sided Huber losses.

4: The smoothness properties of these functions allow us to choose time-varying penalty parameters in such a way

5: that the incremental procedure with the diminishing step-size converges to the exact solution with the rate $O(1/{\sqrt k})$. To the best of our knowledge, we present the first result on the convergence rate for the penalty-based gradient method, in which the penalty parameters vary with time.

6: 

7: \end{abstract}

8: